OVH Community, votre nouvel espace communautaire.

Quelques I/O Benchmarking PCC/dédiés


Dga
20/05/2014, 11h02
Pour éviter de créer un autre sujet je poste ça ici

Filebench depuis différents stockage pour de l'hébergement mail.

#filebench > load varmail > run 600

Pascal [ZR]
22/12/2013, 22h58
Ok merci, je vais tester ça.
ipernet
22/12/2013, 15h52
Hello Pascal

Les tests ont été fait suite à Inspecting disk IO performance with fio

Les commandes sont les mêmes, voici les tests lancés avec fio:

Code:
$ cat random-read-test.fio 
; random read of 128mb of data

[random-read]
rw=randread
size=128m
directory=/tmp/fio-testing/data

et

Code:
$ cat random-read-test-aio.fio 
[random-read]
rw=randread
size=128m
directory=/tmp/fio-testing/data
ioengine=libaio
iodepth=8
direct=1
invalidate=1

Bonnes fêtes!
Pascal [ZR]
22/12/2013, 09h53
Merci pour ce partage, c'est intéressant.
Peux-tu donner ta ligne de commande exacte ?
ipernet
15/12/2013, 16h38
Hello


Après une lecture de Inspecting disk IO performance with fio j'en ai profité pour faire les deux premiers tests fio présentés dans l'article sur quelques dédiés et sur mon PCC.

Ceci n'est qu'à titre informatif dans ma situation, j'ai fait simplement attention de n'être pas "CPU bound" sur ces tests et les machines/VMs sont toutes idle voir à vide, sous Slackware64.


Dédié 1

2x Hitachi HDS723020BLA642 Raid 1 SOFT.


  • fio random-read-test.fio

​
Code:
random-read: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=1
fio-2.1.4
Starting 1 process
random-read: Laying out IO file(s) (1 file(s) / 128MB)
Jobs: 1 (f=1): [r] [97.6% done] [3220KB/0KB/0KB /s] [805/0/0 iops] [eta 00m:03s]
random-read: (groupid=0, jobs=1): err= 0: pid=7067: Sun Dec 15 16:30:57 2013
read : io=131072KB, bw=1086.4KB/s, iops=271, runt=120651msec
   clat (usec): min=72, max=312920, avg=3676.88, stdev=5316.42
     lat (usec): min=72, max=312920, avg=3677.26, stdev=5316.42
    clat percentiles (usec):
     |  1.00th=[  109],  5.00th=[  123], 10.00th=[  137], 20.00th=[  155],
     | 30.00th=[  179], 40.00th=[ 1368], 50.00th=[ 2896], 60.00th=[ 4320],
     | 70.00th=[ 5728], 80.00th=[ 7136], 90.00th=[ 8512], 95.00th=[ 9280],
     | 99.00th=[ 9920], 99.50th=[12352], 99.90th=[50944], 99.95th=[73216],
     | 99.99th=[211968]
    bw (KB  /s): min=  236, max= 5053, per=99.16%, avg=1076.85, stdev=406.22
    lat (usec) : 100=0.25%, 250=38.44%, 500=0.83%, 750=0.03%, 1000=0.05%
    lat (msec) : 2=3.81%, 4=14.36%, 10=41.47%, 20=0.33%, 50=0.31%
    lat (msec) : 100=0.07%, 250=0.03%, 500=0.01%
  cpu          : usr=0.24%, sys=0.85%, ctx=32772, majf=0, minf=27
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=32768/w=0/d=0, short=r=0/w=0/d=0


Run status group 0 (all jobs):
   READ: io=131072KB, aggrb=1086KB/s, minb=1086KB/s, maxb=1086KB/s, mint=120651msec, maxt=120651msec


Disk stats (read/write):
    md1: ios=32619/107, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=16384/790, aggrmerge=0/334, aggrticks=59762/41744, aggrin_queue=101498, aggrutil=98.89%
  sda: ios=32746/790, merge=0/334, ticks=119248/58320, in_queue=177552, util=98.89%
  sdb: ios=22/790, merge=0/334, ticks=276/25168, in_queue=25444, util=2.82%

  • fio random-read-test-aio.fio

Code:
random-read: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=8
fio-2.1.4
Starting 1 process
Jobs: 1 (f=1): [r] [97.7% done] [5376KB/0KB/0KB /s] [1344/0/0 iops] [eta 00m:01s]
random-read: (groupid=0, jobs=1): err= 0: pid=9946: Sun Dec 15 17:07:30 2013
read : io=131072KB, bw=3145.8KB/s, iops=786, runt= 41667msec
   slat (usec): min=5, max=167, avg=18.00, stdev= 4.82
    clat (usec): min=92, max=216678, avg=10146.15, stdev=12437.65
     lat (usec): min=105, max=216686, avg=10164.60, stdev=12437.47
    clat percentiles (usec):
     |  1.00th=[  131],  5.00th=[  215], 10.00th=[  342], 20.00th=[ 1928],
     | 30.00th=[ 3248], 40.00th=[ 4896], 50.00th=[ 6688], 60.00th=[ 8640],
     | 70.00th=[11072], 80.00th=[15296], 90.00th=[23680], 95.00th=[33024],
     | 99.00th=[59136], 99.50th=[68096], 99.90th=[115200], 99.95th=[144384],
     | 99.99th=[205824]
    bw (KB  /s): min= 1697, max= 6648, per=98.77%, avg=3106.38, stdev=689.49
    lat (usec) : 100=0.03%, 250=7.85%, 500=3.89%, 750=1.24%, 1000=1.14%
    lat (msec) : 2=6.54%, 4=14.23%, 10=31.24%, 20=20.65%, 50=11.50%
    lat (msec) : 100=1.56%, 250=0.14%
  cpu          : usr=0.67%, sys=2.12%, ctx=31506, majf=0, minf=33
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=100.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=32768/w=0/d=0, short=r=0/w=0/d=0


Run status group 0 (all jobs):
   READ: io=131072KB, aggrb=3145KB/s, minb=3145KB/s, maxb=3145KB/s, mint=41667msec, maxt=41667msec


Disk stats (read/write):
    md1: ios=32684/15, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=16384/135, aggrmerge=0/95, aggrticks=166140/3866, aggrin_queue=169996, aggrutil=99.62%
  sda: ios=16364/135, merge=0/95, ticks=164272/4552, in_queue=168820, util=99.62%
  sdb: ios=16404/135, merge=0/95, ticks=168008/3180, in_queue=171172, util=99.52%

Dédié 2 (un host-64)

2x TOSHIBA DT01ACA200 / Raid 1 SOFT.


  • fio random-read-test.fio

​
Code:
random-read: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=1
fio-2.1.4
Starting 1 process
random-read: Laying out IO file(s) (1 file(s) / 128MB)
Jobs: 1 (f=1): [r] [98.3% done] [4012KB/0KB/0KB /s] [1003/0/0 iops] [eta 00m:02s]
random-read: (groupid=0, jobs=1): err= 0: pid=22534: Sun Dec 15 16:38:39 2013
 read : io=131072KB, bw=1147.7KB/s, iops=286, runt=114267msec
   clat (usec): min=57, max=84356, avg=3484.78, stdev=3423.74
    lat (usec): min=57, max=84357, avg=3484.97, stdev=3423.74
   clat percentiles (usec):
    |  1.00th=[   60],  5.00th=[   63], 10.00th=[   66], 20.00th=[   70],
    | 30.00th=[   74], 40.00th=[ 1560], 50.00th=[ 2960], 60.00th=[ 4320],
    | 70.00th=[ 5664], 80.00th=[ 7008], 90.00th=[ 8384], 95.00th=[ 9024],
    | 99.00th=[ 9664], 99.50th=[10176], 99.90th=[18304], 99.95th=[23936],
    | 99.99th=[43776]
   bw (KB  /s): min=  696, max= 3866, per=97.71%, avg=1120.74, stdev=287.03
   lat (usec) : 100=37.33%, 250=0.75%, 500=0.03%, 750=0.05%, 1000=0.05%
   lat (msec) : 2=4.84%, 4=14.57%, 10=41.82%, 20=0.47%, 50=0.08%
   lat (msec) : 100=0.01%
 cpu          : usr=0.14%, sys=0.43%, ctx=32789, majf=0, minf=23
 IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
    submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    issued    : total=r=32768/w=0/d=0, short=r=0/w=0/d=0


Run status group 0 (all jobs):
  READ: io=131072KB, aggrb=1147KB/s, minb=1147KB/s, maxb=1147KB/s, mint=114267msec, maxt=114267msec


Disk stats (read/write):
   md2: ios=32653/135, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=16388/122, aggrmerge=0/74, aggrticks=56796/1402, aggrin_queue=58194, aggrutil=99.24%
 sda: ios=32751/122, merge=0/74, ticks=113432/1764, in_queue=115188, util=99.24%
 sdb: ios=26/122, merge=0/74, ticks=160/1040, in_queue=1200, util=0.83%

  • fio random-read-test-aio.fio

Code:
random-read: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=8
fio-2.1.4
Starting 1 process
Jobs: 1 (f=1): [r] [97.6% done] [6256KB/0KB/0KB /s] [1564/0/0 iops] [eta 00m:01s]
random-read: (groupid=0, jobs=1): err= 0: pid=25675: Sun Dec 15 17:11:44 2013
 read : io=131072KB, bw=3342.6KB/s, iops=835, runt= 39213msec
   slat (usec): min=4, max=43, avg= 7.74, stdev= 2.01
   clat (usec): min=51, max=173857, avg=9558.57, stdev=12464.35
    lat (usec): min=57, max=173866, avg=9566.48, stdev=12464.37
   clat percentiles (usec):
    |  1.00th=[   62],  5.00th=[  139], 10.00th=[  193], 20.00th=[  466],
    | 30.00th=[ 1496], 40.00th=[ 3280], 50.00th=[ 5792], 60.00th=[ 8256],
    | 70.00th=[10944], 80.00th=[15680], 90.00th=[24192], 95.00th=[33536],
    | 99.00th=[58624], 99.50th=[71168], 99.90th=[98816], 99.95th=[116224],
    | 99.99th=[142336]
   bw (KB  /s): min= 1644, max= 8515, per=99.48%, avg=3324.71, stdev=877.78
   lat (usec) : 100=2.97%, 250=12.62%, 500=5.20%, 750=3.98%, 1000=1.81%
   lat (msec) : 2=6.74%, 4=9.48%, 10=24.10%, 20=19.59%, 50=11.81%
   lat (msec) : 100=1.60%, 250=0.09%
 cpu          : usr=0.40%, sys=1.04%, ctx=32133, majf=0, minf=33
 IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=100.0%, 16=0.0%, 32=0.0%, >=64=0.0%
    submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete  : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    issued    : total=r=32768/w=0/d=0, short=r=0/w=0/d=0


Run status group 0 (all jobs):
  READ: io=131072KB, aggrb=3342KB/s, minb=3342KB/s, maxb=3342KB/s, mint=39213msec, maxt=39213msec


Disk stats (read/write):
   md2: ios=32486/104, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=16383/185, aggrmerge=0/160, aggrticks=156442/4926, aggrin_queue=161362, aggrutil=99.54%
 sda: ios=16590/187, merge=0/160, ticks=151772/5408, in_queue=157176, util=99.54%
 sdb: ios=16177/184, merge=1/161, ticks=161112/4444, in_queue=165548, util=99.49%

Dédié 3

2x Intel 320 Series SSDs / INTEL SSDSA2CW120G3 / Raid 1 SOFT.


  • fio random-read-test.fio

Code:
random-read: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=1
fio-2.1.4
Starting 1 process
random-read: Laying out IO file(s) (1 file(s) / 128MB)
Jobs: 1 (f=1): [r] [100.0% done] [19600KB/0KB/0KB /s] [4900/0/0 iops] [eta 00m:00s]
random-read: (groupid=0, jobs=1): err= 0: pid=29972: Sun Dec 15 16:45:35 2013
 read : io=131072KB, bw=18466KB/s, iops=4616, runt=  7098msec
   clat (usec): min=49, max=11354, avg=212.24, stdev=227.74
    lat (usec): min=49, max=11354, avg=212.51, stdev=227.74
   clat percentiles (usec):
    |  1.00th=[  171],  5.00th=[  177], 10.00th=[  183], 20.00th=[  187],
    | 30.00th=[  189], 40.00th=[  195], 50.00th=[  199], 60.00th=[  201],
    | 70.00th=[  205], 80.00th=[  211], 90.00th=[  219], 95.00th=[  227],
    | 99.00th=[  251], 99.50th=[  852], 99.90th=[ 4128], 99.95th=[ 5472],
    | 99.99th=[ 6112]
   bw (KB  /s): min=11320, max=20728, per=99.87%, avg=18442.29, stdev=2819.62
   lat (usec) : 50=0.01%, 100=0.30%, 250=98.68%, 500=0.48%, 750=0.03%
   lat (usec) : 1000=0.04%
   lat (msec) : 2=0.17%, 4=0.16%, 10=0.13%, 20=0.01%
 cpu          : usr=3.61%, sys=10.15%, ctx=32772, majf=0, minf=25
 IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
    submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    issued    : total=r=32768/w=0/d=0, short=r=0/w=0/d=0


Run status group 0 (all jobs):
  READ: io=131072KB, aggrb=18466KB/s, minb=18466KB/s, maxb=18466KB/s, mint=7098msec, maxt=7098msec


Disk stats (read/write):
   md1: ios=31813/0, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=16384/152, aggrmerge=0/88, aggrticks=3164/1904, aggrin_queue=5052, aggrutil=86.54%
 sda: ios=32768/152, merge=0/89, ticks=6328/1924, in_queue=8220, util=86.54%
 sdb: ios=0/153, merge=0/88, ticks=0/1884, in_queue=1884, util=0.82%

  • fio random-read-test-aio.fio

Code:
random-read: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=8
fio-2.1.4
Starting 1 process
Jobs: 1 (f=1)
random-read: (groupid=0, jobs=1): err= 0: pid=31017: Sun Dec 15 17:06:38 2013
 read : io=131072KB, bw=128125KB/s, iops=32031, runt=  1023msec
   slat (usec): min=2, max=90, avg= 7.77, stdev= 8.56
   clat (usec): min=123, max=2337, avg=237.14, stdev=80.85
    lat (usec): min=138, max=2342, avg=245.12, stdev=80.18
   clat percentiles (usec):
    |  1.00th=[  161],  5.00th=[  169], 10.00th=[  177], 20.00th=[  187],
    | 30.00th=[  199], 40.00th=[  213], 50.00th=[  227], 60.00th=[  241],
    | 70.00th=[  253], 80.00th=[  270], 90.00th=[  306], 95.00th=[  346],
    | 99.00th=[  450], 99.50th=[  516], 99.90th=[ 1144], 99.95th=[ 1912],
    | 99.99th=[ 2288]
   bw (KB  /s): min=128568, max=129240, per=100.00%, avg=128904.00, stdev=475.18
   lat (usec) : 250=67.75%, 500=31.62%, 750=0.50%, 1000=0.01%
   lat (msec) : 2=0.07%, 4=0.05%
 cpu          : usr=7.44%, sys=36.40%, ctx=16028, majf=0, minf=33
 IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=100.0%, 16=0.0%, 32=0.0%, >=64=0.0%
    submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete  : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    issued    : total=r=32768/w=0/d=0, short=r=0/w=0/d=0


Run status group 0 (all jobs):
  READ: io=131072KB, aggrb=128125KB/s, minb=128125KB/s, maxb=128125KB/s, mint=1023msec, maxt=1023msec


Disk stats (read/write):
   md1: ios=26773/10, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=16383/12, aggrmerge=0/0, aggrticks=3708/0, aggrin_queue=3706, aggrutil=83.86%
 sda: ios=16540/12, merge=1/0, ticks=3700/0, in_queue=3696, util=82.79%
 sdb: ios=16227/12, merge=0/0, ticks=3716/0, in_queue=3716, util=83.86%

VM PCC sur Host S++

VMDisque sur Datastore 1.2TB (Cache SSD R+W)



  • fio random-read-test.fio

Code:
random-read: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=1
fio-2.1.4
Starting 1 process
random-read: Laying out IO file(s) (1 file(s) / 128MB)
Jobs: 1 (f=1): [r] [100.0% done] [15756KB/0KB/0KB /s] [3939/0/0 iops] [eta 00m:00s]
random-read: (groupid=0, jobs=1): err= 0: pid=31590: Sun Dec 15 16:22:57 2013
 read : io=131072KB, bw=16491KB/s, iops=4122, runt=  7948msec
   clat (usec): min=175, max=5313, avg=240.12, stdev=54.03
    lat (usec): min=175, max=5313, avg=240.27, stdev=54.03
   clat percentiles (usec):
    |  1.00th=[  217],  5.00th=[  221], 10.00th=[  221], 20.00th=[  225],
    | 30.00th=[  227], 40.00th=[  231], 50.00th=[  241], 60.00th=[  245],
    | 70.00th=[  249], 80.00th=[  251], 90.00th=[  255], 95.00th=[  258],
    | 99.00th=[  306], 99.50th=[  346], 99.90th=[  644], 99.95th=[  948],
    | 99.99th=[ 2704]
   bw (KB  /s): min=15736, max=16984, per=100.00%, avg=16495.47, stdev=358.10
   lat (usec) : 250=77.63%, 500=22.25%, 750=0.03%, 1000=0.04%
   lat (msec) : 2=0.03%, 4=0.01%, 10=0.01%
 cpu          : usr=1.17%, sys=5.46%, ctx=32770, majf=0, minf=27
 IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
    submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    issued    : total=r=32768/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  READ: io=131072KB, aggrb=16491KB/s, minb=16491KB/s, maxb=16491KB/s, mint=7948msec, maxt=7948msec

Disk stats (read/write):
 sda: ios=32372/8, merge=0/3, ticks=7520/0, in_queue=7520, util=93.88%


  • fio random-read-test-aio.fio

Code:
random-read: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=8
fio-2.1.4
Starting 1 process
Jobs: 1 (f=1): [r] [-.-% done] [88707KB/0KB/0KB /s] [22.2K/0/0 iops] [eta 00m:00s]
random-read: (groupid=0, jobs=1): err= 0: pid=442: Sun Dec 15 17:06:25 2013
read : io=131072KB, bw=62002KB/s, iops=15500, runt=  2114msec
  slat (usec): min=5, max=743, avg= 8.43, stdev= 6.57
   clat (usec): min=69, max=52475, avg=502.80, stdev=1378.13
    lat (usec): min=197, max=52494, avg=511.40, stdev=1378.52
   clat percentiles (usec):
    |  1.00th=[  221],  5.00th=[  251], 10.00th=[  266], 20.00th=[  290],
    | 30.00th=[  330], 40.00th=[  346], 50.00th=[  354], 60.00th=[  362],
    | 70.00th=[  370], 80.00th=[  382], 90.00th=[  434], 95.00th=[  478],
    | 99.00th=[ 6112], 99.50th=[ 9280], 99.90th=[20096], 99.95th=[25216],
    | 99.99th=[37120]
   bw (KB  /s): min= 7848, max=90416, per=97.58%, avg=60500.00, stdev=38441.82
   lat (usec) : 100=0.01%, 250=4.69%, 500=91.10%, 750=0.88%, 1000=1.00%
   lat (msec) : 2=0.35%, 4=0.50%, 10=1.02%, 20=0.36%, 50=0.10%
   lat (msec) : 100=0.01%
 cpu          : usr=4.26%, sys=14.15%, ctx=12898, majf=0, minf=32
 IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=100.0%, 16=0.0%, 32=0.0%, >=64=0.0%
    submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete  : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    issued    : total=r=32768/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  READ: io=131072KB, aggrb=62001KB/s, minb=62001KB/s, maxb=62001KB/s, mint=2114msec, maxt=2114msec

Disk stats (read/write):
 sda: ios=32140/0, merge=0/0, ticks=15790/0, in_queue=15780, util=92.04%


VPS OVH à 8 euros


  • fio random-read-test.fio

Code:
random-read: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=1
fio-2.1.4
Starting 1 process
Jobs: 1 (f=1): [r] [100.0% done] [11872KB/0KB/0KB /s] [2968/0/0 iops] [eta 00m:00s]
random-read: (groupid=0, jobs=1): err= 0: pid=6702: Sun Dec 15 18:16:37 2013
 read : io=131072KB, bw=11972KB/s, iops=2993, runt= 10948msec
    clat (usec): min=208, max=15274, avg=328.47, stdev=174.11
     lat (usec): min=209, max=15275, avg=329.30, stdev=174.13
    clat percentiles (usec):
     |  1.00th=[  241],  5.00th=[  255], 10.00th=[  262], 20.00th=[  274],
     | 30.00th=[  278], 40.00th=[  286], 50.00th=[  290], 60.00th=[  298],
     | 70.00th=[  314], 80.00th=[  390], 90.00th=[  430], 95.00th=[  454],
     | 99.00th=[  900], 99.50th=[ 1064], 99.90th=[ 1768], 99.95th=[ 2384],
     | 99.99th=[ 6688]
    bw (KB  /s): min= 9624, max=13816, per=100.00%, avg=11999.24, stdev=1018.65
    lat (usec) : 250=2.62%, 500=94.91%, 750=1.20%, 1000=0.60%
    lat (msec) : 2=0.60%, 4=0.04%, 10=0.02%, 20=0.01%
  cpu          : usr=1.74%, sys=8.18%, ctx=32898, majf=0, minf=21
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=32768/w=0/d=0, short=r=0/w=0/d=0


Run status group 0 (all jobs):
   READ: io=131072KB, aggrb=11972KB/s, minb=11972KB/s, maxb=11972KB/s, mint=10948msec, maxt=10948msec

  • fio random-read-test-aio.fio

Code:
random-read: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=8
fio-2.1.4
Starting 1 process
Jobs: 1 (f=1): [r] [100.0% done] [10428KB/0KB/0KB /s] [2607/0/0 iops] [eta 00m:00s]
random-read: (groupid=0, jobs=1): err= 0: pid=6705: Sun Dec 15 18:18:26 2013
 read : io=131072KB, bw=10691KB/s, iops=2672, runt= 12260msec
    slat (usec): min=216, max=308803, avg=367.40, stdev=2164.48
    clat (usec): min=4, max=310749, avg=2615.63, stdev=5766.74
     lat (usec): min=291, max=311057, avg=2984.17, stdev=6169.15
    clat percentiles (usec):
     |  1.00th=[ 1928],  5.00th=[ 1976], 10.00th=[ 2008], 20.00th=[ 2040],
     | 30.00th=[ 2064], 40.00th=[ 2128], 50.00th=[ 2192], 60.00th=[ 2256],
     | 70.00th=[ 2384], 80.00th=[ 2544], 90.00th=[ 2800], 95.00th=[ 3344],
     | 99.00th=[ 6688], 99.50th=[11968], 99.90th=[54016], 99.95th=[115200],
     | 99.99th=[309248]
    bw (KB  /s): min= 5118, max=13304, per=100.00%, avg=10792.78, stdev=1995.34
    lat (usec) : 10=0.01%, 500=0.01%, 750=0.01%
    lat (msec) : 2=8.12%, 4=88.83%, 10=2.41%, 20=0.32%, 50=0.19%
    lat (msec) : 100=0.04%, 250=0.06%, 500=0.02%
  cpu          : usr=1.70%, sys=8.23%, ctx=32914, majf=0, minf=27
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=100.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=32768/w=0/d=0, short=r=0/w=0/d=0


Run status group 0 (all jobs):
   READ: io=131072KB, aggrb=10691KB/s, minb=10691KB/s, maxb=10691KB/s, mint=12260msec, maxt=12260msec