[root@sin21-ibnrushd ~]# fio --name=randrw --rw=randrw --direct=1 --ioengine=libaio --bs=64k --numjobs=1 --rwmixread=90 --size=4g --runtime=600 --group_reporting
randrw: (g=0): rw=randrw, bs=(R) 64.0KiB-64.0KiB, (W) 64.0KiB-64.0KiB, (T) 64.0KiB-64.0KiB, ioengine=libaio, iodepth=1
fio-3.7
Starting 1 process
randrw: Laying out IO file (1 file / 4096MiB)
Jobs: 1 (f=1): [m(1)][100.0%][r=267MiB/s,w=28.5MiB/s][r=4274,w=456 IOPS][eta 00m:00s]
randrw: (groupid=0, jobs=1): err= 0: pid=6716: Mon Feb 8 21:17:39 2021
read: IOPS=4163, BW=260MiB/s (273MB/s)(3685MiB/14160msec)
slat (usec): min=5, max=238, avg= 8.98, stdev= 4.52
clat (usec): min=94, max=10979, avg=189.57, stdev=127.58
lat (usec): min=106, max=11002, avg=198.85, stdev=127.99
clat percentiles (usec):
| 1.00th=[ 127], 5.00th=[ 159], 10.00th=[ 163], 20.00th=[ 167],
| 30.00th=[ 172], 40.00th=[ 176], 50.00th=[ 180], 60.00th=[ 184],
| 70.00th=[ 190], 80.00th=[ 200], 90.00th=[ 217], 95.00th=[ 233],
| 99.00th=[ 351], 99.50th=[ 404], 99.90th=[ 1352], 99.95th=[ 2868],
| 99.99th=[ 5997]
bw ( KiB/s): min=225792, max=292608, per=99.94%, avg=266308.46, stdev=22547.12, samples=28
iops : min= 3528, max= 4572, avg=4161.04, stdev=352.31, samples=28
write: IOPS=464, BW=29.0MiB/s (30.5MB/s)(411MiB/14160msec)
slat (usec): min=5, max=228, avg=11.97, stdev= 5.53
clat (usec): min=166, max=4542, avg=344.29, stdev=103.97
lat (usec): min=180, max=4554, avg=356.55, stdev=104.33
clat percentiles (usec):
| 1.00th=[ 217], 5.00th=[ 273], 10.00th=[ 289], 20.00th=[ 314],
| 30.00th=[ 322], 40.00th=[ 330], 50.00th=[ 334], 60.00th=[ 343],
| 70.00th=[ 351], 80.00th=[ 363], 90.00th=[ 383], 95.00th=[ 433],
| 99.00th=[ 594], 99.50th=[ 693], 99.90th=[ 1713], 99.95th=[ 2024],
| 99.99th=[ 4555]
bw ( KiB/s): min=24320, max=34176, per=99.77%, avg=29671.00, stdev=2948.76, samples=28
iops : min= 380, max= 534, avg=463.61, stdev=46.07, samples=28
lat (usec) : 100=0.01%, 250=87.58%, 500=11.88%, 750=0.33%, 1000=0.07%
lat (msec) : 2=0.06%, 4=0.05%, 10=0.02%, 20=0.01%
cpu : usr=1.12%, sys=5.81%, ctx=65540, majf=0, minf=32
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=58956,6580,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=260MiB/s (273MB/s), 260MiB/s-260MiB/s (273MB/s-273MB/s), io=3685MiB (3864MB), run=14160-14160msec
WRITE: bw=29.0MiB/s (30.5MB/s), 29.0MiB/s-29.0MiB/s (30.5MB/s-30.5MB/s), io=411MiB (431MB), run=14160-14160msec