对应数据只能在新服务器上跑，会把文件系统破坏掉

硬盘

顺序读

  1. fio -name iops -rw=read -bs=4k -runtime=60 -iodepth 32 -filename /dev/sdb1 -ioengine libaio -direct=1
  3. iops: (groupid=0, jobs=1): err= 0: pid=6843: Tue Aug 10 14:35:45 2021
  4.   read: IOPS=48.4k, BW=189MiB/s (198MB/s)(11.1GiB/60001msec)
  5.     slat (usec): min=2, max=374, avg= 8.55, stdev= 3.75
  6.     clat (usec): min=81, max=158699, avg=651.63, stdev=532.29
  7.      lat (usec): min=87, max=158711, avg=660.41, stdev=532.27
  8.     clat percentiles (usec):
  9.      |  1.00th=[  523],  5.00th=[  578], 10.00th=[  603], 20.00th=[  619],
  10.      | 30.00th=[  635], 40.00th=[  644], 50.00th=[  652], 60.00th=[  652],
  11.      | 70.00th=[  660], 80.00th=[  668], 90.00th=[  685], 95.00th=[  717],
  12.      | 99.00th=[  857], 99.50th=[ 1090], 99.90th=[ 1434], 99.95th=[ 1565],
  13.      | 99.99th=[ 2212]
  14.    bw (  KiB/s): min=127304, max=194800, per=99.99%, avg=193460.55, stdev=6225.46, samples=119
  15.    iops        : min=31826, max=48700, avg=48365.12, stdev=1556.36, samples=119
  16.   lat (usec)   : 100=0.01%, 250=0.01%, 500=0.47%, 750=97.14%, 1000=1.72%
  17.   lat (msec)   : 2=0.65%, 4=0.01%, 10=0.01%, 20=0.01%, 250=0.01%
  18.   cpu          : usr=14.63%, sys=49.46%, ctx=1754517, majf=0, minf=109
  19.   IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
  20.      submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  21.      complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
  22.      issued rwts: total=2902311,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  23.      latency   : target=0, window=0, percentile=100.00%, depth=32
  25. Run status group 0 (all jobs):
  26.    READ: bw=189MiB/s (198MB/s), 189MiB/s-189MiB/s (198MB/s-198MB/s), io=11.1GiB (11.9GB), run=60001-60001msec
  28. Disk stats (read/write):
  29.   sda: ios=2896476/4, merge=120/0, ticks=1885242/48, in_queue=1877620, util=99.66%

read: IOPS=27.9k, BW=109MiB/s (114MB/s)(6529MiB/60003msec)
read: IOPS=48.4k, BW=189MiB/s (198MB/s)(11.1GiB/60001msec)

随机读

  1. fio -name iops -rw=randread -bs=4k -runtime=60 -iodepth 32 -filename /dev/sda4 -ioengine libaio -direct=1
  2. iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=32
  3. fio-3.12
  4. Starting 1 process
  5. Jobs: 1 (f=1): [r(1)][100.0%][r=169MiB/s][r=43.3k IOPS][eta 00m:00s]
  6. iops: (groupid=0, jobs=1): err= 0: pid=6884: Tue Aug 10 14:39:54 2021
  7.   read: IOPS=43.1k, BW=168MiB/s (177MB/s)(9.87GiB/60001msec)
  8.     slat (usec): min=5, max=210, avg= 9.14, stdev= 5.00
  9.     clat (usec): min=180, max=161609, avg=731.22, stdev=590.64
  10.      lat (usec): min=193, max=161622, avg=740.61, stdev=590.68
  11.     clat percentiles (usec):
  12.      |  1.00th=[  355],  5.00th=[  453], 10.00th=[  510], 20.00th=[  586],
  13.      | 30.00th=[  635], 40.00th=[  676], 50.00th=[  709], 60.00th=[  742],
  14.      | 70.00th=[  783], 80.00th=[  848], 90.00th=[  947], 95.00th=[ 1045],
  15.      | 99.00th=[ 1385], 99.50th=[ 1713], 99.90th=[ 2704], 99.95th=[ 2966],
  16.      | 99.99th=[ 3392]
  17.    bw (  KiB/s): min=111248, max=174312, per=99.99%, avg=172459.16, stdev=5658.98, samples=120
  18.    iops        : min=27812, max=43578, avg=43114.76, stdev=1414.74, samples=120
  19.   lat (usec)   : 250=0.04%, 500=8.87%, 750=52.96%, 1000=31.41%
  20.   lat (msec)   : 2=6.40%, 4=0.32%, 10=0.01%, 250=0.01%
  21.   cpu          : usr=14.60%, sys=43.49%, ctx=522879, majf=0, minf=56
  22.   IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
  23.      submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  24.      complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
  25.      issued rwts: total=2587264,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  26.      latency   : target=0, window=0, percentile=100.00%, depth=32
  28. Run status group 0 (all jobs):
  29.    READ: bw=168MiB/s (177MB/s), 168MiB/s-168MiB/s (177MB/s-177MB/s), io=9.87GiB (10.6GB), run=60001-60001msec
  31. Disk stats (read/write):
  32.   sda: ios=2582415/0, merge=0/0, ticks=1799474/0, in_queue=1799160, util=99.66%

read: IOPS=591, BW=2365KiB/s (2421kB/s)(140MiB/60442msec)
read: IOPS=43.1k, BW=168MiB/s (177MB/s)(9.87GiB/60001msec)

顺序写

  1. fio -name iops -rw=write -bs=4k -runtime=60 -iodepth 32 -filename /home/rails/a -size=1G -ioengine libaio -direct=1
  3. iops: (groupid=0, jobs=1): err= 0: pid=7083: Tue Aug 10 15:09:54 2021
  4.   write: IOPS=38.9k, BW=152MiB/s (159MB/s)(9108MiB/60001msec); 0 zone resets
  5.     slat (usec): min=3, max=314, avg= 7.37, stdev= 2.78
  6.     clat (usec): min=357, max=319143, avg=814.47, stdev=1732.07
  7.      lat (usec): min=364, max=319150, avg=822.12, stdev=1732.23
  8.     clat percentiles (usec):
  9.      |  1.00th=[  594],  5.00th=[  627], 10.00th=[  644], 20.00th=[  644],
  10.      | 30.00th=[  644], 40.00th=[  644], 50.00th=[  644], 60.00th=[  652],
  11.      | 70.00th=[  652], 80.00th=[  750], 90.00th=[ 1004], 95.00th=[ 1369],
  12.      | 99.00th=[ 3130], 99.50th=[ 3949], 99.90th=[14484], 99.95th=[21103],
  13.      | 99.99th=[47973]
  14.    bw (  KiB/s): min=44608, max=189296, per=99.99%, avg=155426.98, stdev=36562.01, samples=120
  15.    iops        : min=11152, max=47324, avg=38856.72, stdev=9140.51, samples=120
  16.   lat (usec)   : 500=0.03%, 750=80.00%, 1000=9.84%
  17.   lat (msec)   : 2=7.15%, 4=2.51%, 10=0.33%, 20=0.09%, 50=0.04%
  18.   lat (msec)   : 100=0.01%, 250=0.01%, 500=0.01%
  19.   cpu          : usr=14.27%, sys=36.11%, ctx=1883545, majf=0, minf=20
  20.   IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
  21.      submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  22.      complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
  23.      issued rwts: total=0,2331710,0,0 short=0,0,0,0 dropped=0,0,0,0
  24.      latency   : target=0, window=0, percentile=100.00%, depth=32
  26. Run status group 0 (all jobs):
  27.   WRITE: bw=152MiB/s (159MB/s), 152MiB/s-152MiB/s (159MB/s-159MB/s), io=9108MiB (9551MB), run=60001-60001msec
  29. Disk stats (read/write):
  30.   sda: ios=0/2327637, merge=0/120, ticks=0/1882989, in_queue=1864252, util=99.21%

write: IOPS=2341, BW=9366KiB/s (9591kB/s)(549MiB/60003msec); 0 zone resets
write: IOPS=38.9k, BW=152MiB/s (159MB/s)(9108MiB/60001msec); 0 zone resets

随机写

  1. fio -name iops -rw=randwrite -bs=4k -runtime=60 -iodepth 32 -filename /home/rails/a -size=1G -ioengine libaio -direct=1
  2. iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=32
  3. fio-3.12
  4. Starting 1 process
  5. Jobs: 1 (f=1): [w(1)][100.0%][w=113MiB/s][w=28.9k IOPS][eta 00m:00s]
  6. iops: (groupid=0, jobs=1): err= 0: pid=7060: Tue Aug 10 15:07:01 2021
  7.   write: IOPS=31.7k, BW=124MiB/s (130MB/s)(7438MiB/60001msec); 0 zone resets
  8.     slat (usec): min=5, max=243, avg= 9.23, stdev= 3.58
  9.     clat (usec): min=292, max=133213, avg=997.10, stdev=2402.32
  10.      lat (usec): min=300, max=133239, avg=1006.72, stdev=2402.54
  11.     clat percentiles (usec):
  12.      |  1.00th=[   578],  5.00th=[   627], 10.00th=[   635], 20.00th=[   644],
  13.      | 30.00th=[   644], 40.00th=[   644], 50.00th=[   644], 60.00th=[   758],
  14.      | 70.00th=[   881], 80.00th=[   955], 90.00th=[  1352], 95.00th=[  1778],
  15.      | 99.00th=[  4817], 99.50th=[  6652], 99.90th=[ 39584], 99.95th=[ 54264],
  16.      | 99.99th=[102237]
  17.    bw (  KiB/s): min=57176, max=173920, per=99.99%, avg=126922.08, stdev=20981.92, samples=120
  18.    iops        : min=14294, max=43480, avg=31730.48, stdev=5245.49, samples=120
  19.   lat (usec)   : 500=0.06%, 750=59.77%, 1000=22.15%
  20.   lat (msec)   : 2=14.55%, 4=2.13%, 10=1.00%, 20=0.16%, 50=0.11%
  21.   lat (msec)   : 100=0.06%, 250=0.01%
  22.   cpu          : usr=14.27%, sys=34.62%, ctx=1432499, majf=0, minf=33
  23.   IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
  24.      submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  25.      complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
  26.      issued rwts: total=0,1904140,0,0 short=0,0,0,0 dropped=0,0,0,0
  27.      latency   : target=0, window=0, percentile=100.00%, depth=32
  29. Run status group 0 (all jobs):
  30.   WRITE: bw=124MiB/s (130MB/s), 124MiB/s-124MiB/s (130MB/s-130MB/s), io=7438MiB (7799MB), run=60001-60001msec
  32. Disk stats (read/write):
  33.   sda: ios=28/1899312, merge=0/0, ticks=197/1894890, in_queue=1879008, util=99.74%

write: IOPS=111, BW=448KiB/s (458kB/s)(26.3MiB/60221msec); 0 zone resets
write: IOPS=31.7k, BW=124MiB/s (130MB/s)(7438MiB/60001msec); 0 zone resets