Versions Compared

Old Version 3

changes.mady.by.user Oleksandr Liutyi

Saved on

compared with

New Version Current

changes.mady.by.user Oleksandr Liutyi

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

fio

Code Block
apt install -y fio ioping


Intenal eMMC (296MB/s-296MB/s) SCA64G 58.2 GiB

Code Block
root@g9:~# fio --filename=/dev/mmcblk0p3 --rw=read --direct=1 --bs=1M --ioengine=libaio --runtime=60 --numjobs=1 --time_based --group_reporting --name=seq_read --iodepth=16
seq_read: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=16
fio-3.36
Starting 1 process
Jobs: 1 (f=1): [R(1)][100.0%][r=284MiB/s][r=284 IOPS][eta 00m:00s]
seq_read: (groupid=0, jobs=1): err= 0: pid=10358: Fri Apr  4 15:24:22 2025
  read: IOPS=282, BW=283MiB/s (296MB/s)(16.6GiB/60057msec)
    slat (usec): min=93, max=1862, avg=155.44, stdev=29.98
    clat (msec): min=8, max=105, avg=56.43, stdev= 2.72
     lat (msec): min=8, max=105, avg=56.59, stdev= 2.72
    clat percentiles (msec):
     |  1.00th=[   55],  5.00th=[   56], 10.00th=[   56], 20.00th=[   56],
     | 30.00th=[   57], 40.00th=[   57], 50.00th=[   57], 60.00th=[   57],
     | 70.00th=[   57], 80.00th=[   57], 90.00th=[   57], 95.00th=[   57],
     | 99.00th=[   64], 99.50th=[   81], 99.90th=[   89], 99.95th=[   93],
     | 99.99th=[  103]
   bw (  KiB/s): min=223232, max=294323, per=100.00%, avg=289521.04, stdev=8081.61, samples=119
   iops        : min=  218, max=  287, avg=282.44, stdev= 7.88, samples=119
  lat (msec)   : 10=0.01%, 20=0.02%, 50=0.05%, 100=99.91%, 250=0.01%
  cpu          : usr=1.31%, sys=5.58%, ctx=18129, majf=0, minf=4107
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=99.9%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=16972,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=283MiB/s (296MB/s), 283MiB/s-283MiB/s (296MB/s-296MB/s), io=16.6GiB (17.8GB), run=60057-60057msec

Disk stats (read/write):
  mmcblk0: ios=33853/0, sectors=34665472/0, merge=0/1, ticks=1876970/0, in_queue=1876971, util=93.19%

Raid 1 of two nvme (3305MB/s-3305MB/s)

Code Block
root@g9:~# fio --filename=/dev/md0p1 --rw=read --direct=1 --bs=1M --ioengine=libaio --runtime=60 --numjobs=1 --time_based --group_reporting --name=seq_read --iodepth=16
seq_read: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=16
fio-3.36
Starting 1 process
Jobs: 1 (f=1): [R(1)][100.0%][r=3155MiB/s][r=3155 IOPS][eta 00m:00s]
seq_read: (groupid=0, jobs=1): err= 0: pid=10342: Fri Apr  4 15:22:24 2025
  read: IOPS=3151, BW=3152MiB/s (3305MB/s)(185GiB/60005msec)
    slat (usec): min=38, max=483, avg=109.55, stdev=40.31
    clat (usec): min=1404, max=20568, avg=4964.45, stdev=215.28
     lat (usec): min=1619, max=20666, avg=5074.00, stdev=212.23
    clat percentiles (usec):
     |  1.00th=[ 4883],  5.00th=[ 4883], 10.00th=[ 4883], 20.00th=[ 4948],
     | 30.00th=[ 4948], 40.00th=[ 4948], 50.00th=[ 4948], 60.00th=[ 4948],
     | 70.00th=[ 4948], 80.00th=[ 5014], 90.00th=[ 5014], 95.00th=[ 5014],
     | 99.00th=[ 5211], 99.50th=[ 5473], 99.90th=[ 7767], 99.95th=[ 8356],
     | 99.99th=[10814]
   bw (  MiB/s): min= 3045, max= 3182, per=100.00%, avg=3154.12, stdev=17.16, samples=119
   iops        : min= 3045, max= 3182, avg=3154.11, stdev=17.21, samples=119
  lat (msec)   : 2=0.01%, 4=0.01%, 10=99.96%, 20=0.02%, 50=0.01%
  cpu          : usr=0.83%, sys=39.16%, ctx=188785, majf=0, minf=4109
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=100.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=189121,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3152MiB/s (3305MB/s), 3152MiB/s-3152MiB/s (3305MB/s-3305MB/s), io=185GiB (198GB), run=60005-60005msec

Disk stats (read/write):
    md0: ios=1510146/16093, sectors=386597376/4104680, merge=0/0, ticks=5250573/34132, in_queue=5284705, util=72.00%, aggrios=756484/8065, aggsectors=193659904/2058484, aggrmerge=0/17, aggrticks=2632221/16445, aggrin_queue=2648729, aggrutil=99.84%
  nvme0n1: ios=756484/12, sectors=193659904/0, merge=0/0, ticks=3409719/51, in_queue=3409821, util=99.77%
  nvme1n1: ios=756484/16119, sectors=193659904/4116968, merge=0/34, ticks=1854723/32840, in_queue=1887638, util=99.84%

single nvme1 (1671MB/s-1671MB/s) ShiJi 128GB M.2-NVMe

Code Block
root@g9:~# fio --filename=/dev/nvme0n1 --rw=read --direct=1 --bs=1M --ioengine=libaio --runtime=60 --numjobs=1 --time_based --group_reporting --name=seq_read --iodepth=16
seq_read: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=16
fio-3.36
Starting 1 process
Jobs: 1 (f=1): [R(1)][100.0%][r=1593MiB/s][r=1592 IOPS][eta 00m:00s]
seq_read: (groupid=0, jobs=1): err= 0: pid=10372: Fri Apr  4 15:26:48 2025
  read: IOPS=1593, BW=1594MiB/s (1671MB/s)(93.4GiB/60010msec)
    slat (usec): min=44, max=1228, avg=223.13, stdev=40.51
    clat (usec): min=2829, max=18640, avg=9813.77, stdev=158.12
     lat (usec): min=3150, max=18797, avg=10036.91, stdev=150.55
    clat percentiles (usec):
     |  1.00th=[ 9634],  5.00th=[ 9765], 10.00th=[ 9765], 20.00th=[ 9765],
     | 30.00th=[ 9765], 40.00th=[ 9765], 50.00th=[ 9765], 60.00th=[ 9765],
     | 70.00th=[ 9896], 80.00th=[ 9896], 90.00th=[ 9896], 95.00th=[ 9896],
     | 99.00th=[ 9896], 99.50th=[ 9896], 99.90th=[10028], 99.95th=[11731],
     | 99.99th=[14877]
   bw (  MiB/s): min= 1590, max= 1602, per=100.00%, avg=1595.04, stdev= 3.40, samples=119
   iops        : min= 1590, max= 1602, avg=1595.04, stdev= 3.40, samples=119
  lat (msec)   : 4=0.01%, 10=99.90%, 20=0.08%
  cpu          : usr=0.83%, sys=40.70%, ctx=95629, majf=0, minf=4107
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=100.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=95638,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=1594MiB/s (1671MB/s), 1594MiB/s-1594MiB/s (1671MB/s-1671MB/s), io=93.4GiB (100GB), run=60010-60010msec

Disk stats (read/write):
  nvme0n1: ios=763682/0, sectors=195501848/0, merge=0/0, ticks=7333711/0, in_queue=7333711, util=99.91%


single nvme2 (1686MB/s-1686MB/s) Samsung PM951 NVMe SAMSUNG 512GB

Code Block
root@g9:~# fio --filename=/dev/nvme1n1 --rw=read --direct=1 --bs=1M --ioengine=libaio --runtime=60 --numjobs=1 --time_based --group_reporting --name=seq_read --iodepth=16
seq_read: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=16
fio-3.36
Starting 1 process
Jobs: 1 (f=1): [R(1)][100.0%][r=1610MiB/s][r=1609 IOPS][eta 00m:00s]
seq_read: (groupid=0, jobs=1): err= 0: pid=10381: Fri Apr  4 15:28:00 2025
  read: IOPS=1607, BW=1608MiB/s (1686MB/s)(94.2GiB/60010msec)
    slat (usec): min=83, max=1234, avg=225.86, stdev=13.67
    clat (usec): min=3067, max=18420, avg=9722.94, stdev=142.61
     lat (usec): min=3363, max=18645, avg=9948.81, stdev=139.30
    clat percentiles (usec):
     |  1.00th=[ 9634],  5.00th=[ 9765], 10.00th=[ 9765], 20.00th=[ 9765],
     | 30.00th=[ 9765], 40.00th=[ 9765], 50.00th=[ 9765], 60.00th=[ 9765],
     | 70.00th=[ 9765], 80.00th=[ 9765], 90.00th=[ 9765], 95.00th=[ 9765],
     | 99.00th=[ 9765], 99.50th=[ 9765], 99.90th=[10814], 99.95th=[12125],
     | 99.99th=[13829]
   bw (  MiB/s): min= 1596, max= 1610, per=100.00%, avg=1609.31, stdev= 1.53, samples=119
   iops        : min= 1596, max= 1610, avg=1609.31, stdev= 1.53, samples=119
  lat (msec)   : 4=0.01%, 10=99.86%, 20=0.13%
  cpu          : usr=0.65%, sys=41.18%, ctx=96375, majf=0, minf=4107
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=100.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=96487,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=1608MiB/s (1686MB/s), 1608MiB/s-1608MiB/s (1686MB/s-1686MB/s), io=94.2GiB (101GB), run=60010-60010msec

Disk stats (read/write):
  nvme1n1: ios=770390/0, sectors=197219840/0, merge=0/0, ticks=7331818/0, in_queue=7331818, util=99.92%

ioping

eMMC SCA64G 58.2 GiB - 6.22 ms

Code Block
root@g9:~# ioping /dev/mmcblk0p3
4 KiB <<< /dev/mmcblk0p3 (block device 55.2 GiB): request=1 time=5.95 ms (warmup)
4 KiB <<< /dev/mmcblk0p3 (block device 55.2 GiB): request=2 time=6.14 ms
4 KiB <<< /dev/mmcblk0p3 (block device 55.2 GiB): request=3 time=6.18 ms
4 KiB <<< /dev/mmcblk0p3 (block device 55.2 GiB): request=4 time=6.22 ms
4 KiB <<< /dev/mmcblk0p3 (block device 55.2 GiB): request=5 time=6.21 ms
4 KiB <<< /dev/mmcblk0p3 (block device 55.2 GiB): request=6 time=6.27 ms
4 KiB <<< /dev/mmcblk0p3 (block device 55.2 GiB): request=7 time=6.20 ms

RAID 1 - 1.66 ms

Code Block
root@g9:~# ioping /dev/md0p1
4 KiB <<< /dev/md0p1 (block device 595.9 GiB): request=1 time=840.5 us (warmup)
4 KiB <<< /dev/md0p1 (block device 595.9 GiB): request=2 time=1.65 ms
4 KiB <<< /dev/md0p1 (block device 595.9 GiB): request=3 time=1.71 ms
4 KiB <<< /dev/md0p1 (block device 595.9 GiB): request=4 time=1.66 ms
4 KiB <<< /dev/md0p1 (block device 595.9 GiB): request=5 time=1.61 ms
4 KiB <<< /dev/md0p1 (block device 595.9 GiB): request=6 time=1.55 ms
4 KiB <<< /dev/md0p1 (block device 595.9 GiB): request=7 time=1.66 ms
4 KiB <<< /dev/md0p1 (block device 595.9 GiB): request=8 time=349.7 us (fast)
4 KiB <<< /dev/md0p1 (block device 595.9 GiB): request=9 time=1.80 ms
4 KiB <<< /dev/md0p1 (block device 595.9 GiB): request=10 time=1.30 ms
4 KiB <<< /dev/md0p1 (block device 595.9 GiB): request=11 time=351.0 us (fast)


NVMe 1 - ShiJi 128GB M.2-NVMe - 0.3 ms

Code Block
root@g9:~# ioping /dev/nvme0n1
4 KiB <<< /dev/nvme0n1 (block device 119.2 GiB): request=1 time=219.6 us (warmup)
4 KiB <<< /dev/nvme0n1 (block device 119.2 GiB): request=2 time=311.8 us
4 KiB <<< /dev/nvme0n1 (block device 119.2 GiB): request=3 time=360.2 us
4 KiB <<< /dev/nvme0n1 (block device 119.2 GiB): request=4 time=195.3 us
4 KiB <<< /dev/nvme0n1 (block device 119.2 GiB): request=5 time=390.5 us
4 KiB <<< /dev/nvme0n1 (block device 119.2 GiB): request=6 time=203.0 us


NVMe 2 - PM951 NVMe SAMSUNG 512GB - 1.60 ms

Code Block
root@g9:~# ioping /dev/nvme1n1
4 KiB <<< /dev/nvme1n1 (block device 476.9 GiB): request=1 time=1.55 ms (warmup)
4 KiB <<< /dev/nvme1n1 (block device 476.9 GiB): request=2 time=2.05 ms
4 KiB <<< /dev/nvme1n1 (block device 476.9 GiB): request=3 time=1.44 ms
4 KiB <<< /dev/nvme1n1 (block device 476.9 GiB): request=4 time=1.99 ms
4 KiB <<< /dev/nvme1n1 (block device 476.9 GiB): request=5 time=995.8 us

...