randrw_16th_8k: (g=0): rw=randrw, bs=(R) 8192B-8192B, (W) 8192B-8192B, (T) 8192B-8192B, ioengine=psync, iodepth=1 ... fio-3.1 Starting 16 threads randrw_16th_8k: (groupid=0, jobs=16): err= 0: pid=5320: Mon Mar 25 03:21:00 2019 read: IOPS=264, BW=2117KiB/s (2168kB/s)(124MiB/60045msec) clat (usec): min=148, max=491768, avg=39432.35, stdev=23039.80 lat (usec): min=148, max=491768, avg=39432.76, stdev=23039.81 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 29], 40.00th=[ 32], 50.00th=[ 35], 60.00th=[ 39], | 70.00th=[ 43], 80.00th=[ 50], 90.00th=[ 64], 95.00th=[ 80], | 99.00th=[ 116], 99.50th=[ 133], 99.90th=[ 247], 99.95th=[ 439], | 99.99th=[ 485] bw ( KiB/s): min= 16, max= 272, per=6.27%, avg=132.82, stdev=48.78, samples=1913 iops : min= 2, max= 34, avg=16.60, stdev= 6.10, samples=1913 write: IOPS=268, BW=2149KiB/s (2201kB/s)(126MiB/60045msec) clat (usec): min=4, max=477942, avg=20673.33, stdev=26613.06 lat (usec): min=4, max=477952, avg=20673.98, stdev=26613.15 clat percentiles (usec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 12], | 30.00th=[ 22], 40.00th=[ 31], 50.00th=[ 17957], 60.00th=[ 26346], | 70.00th=[ 31851], 80.00th=[ 38011], 90.00th=[ 50594], 95.00th=[ 65799], | 99.00th=[103285], 99.50th=[115868], 99.90th=[196084], 99.95th=[270533], | 99.99th=[476054] bw ( KiB/s): min= 16, max= 384, per=6.27%, avg=134.82, stdev=66.25, samples=1914 iops : min= 2, max= 48, avg=16.85, stdev= 8.28, samples=1914 lat (usec) : 10=8.31%, 20=6.12%, 50=9.41%, 100=0.68%, 250=0.02% lat (usec) : 500=0.01%, 750=0.01% lat (msec) : 2=0.01%, 4=0.07%, 10=0.27%, 20=5.26%, 50=55.06% lat (msec) : 100=13.19%, 250=1.52%, 500=0.07% cpu : usr=0.03%, sys=0.25%, ctx=41774, majf=0, minf=0 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwt: total=15893,16131,0, short=0,0,0, dropped=0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 Run status group 0 (all jobs): READ: bw=2117KiB/s (2168kB/s), 2117KiB/s-2117KiB/s (2168kB/s-2168kB/s), io=124MiB (130MB), run=60045-60045msec WRITE: bw=2149KiB/s (2201kB/s), 2149KiB/s-2149KiB/s (2201kB/s-2201kB/s), io=126MiB (132MB), run=60045-60045msec Disk stats (read/write): sdc: ios=15435/10391, merge=0/1, ticks=122505/4115, in_queue=126193, util=98.26%