RAID阵性能测试对比

在一项目中，客户想了解RAID5，6的性能报告，于是在实验室针对客户的要求做了测试。

本次测试的硬件：LSI9361-8i并搭载12块SAS硬盘。

本次测试系统使用的是：CentOS Linux release 7.9.2009 (Core)

RAID5：

[root@Vxworks hddtest]# fio -filename=/hddtest/date.file -direct=1 -thread -iodepth=32 -rw=randwrite -ioengine=libaio -bs=4k -numjobs=1 -runtime=600 -group_reporting -randrepeat=0 -norandommap -time_based -name=mytest
mytest: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=32
fio-3.3
Starting 1 thread
Jobs: 1 (f=1): [w(1)][100.0%][r=0KiB/s,w=7079KiB/s][r=0,w=1769 IOPS][eta 00m:00s]
mytest: (groupid=0, jobs=1): err= 0: pid=150604: Fri May 26 07:38:20 2023
write: IOPS=1705, BW=6821KiB/s (6985kB/s)(4000MiB/600488msec)
slat (usec): min=2, max=377080, avg=16.07, stdev=516.79
clat (usec): min=45, max=2802.7k, avg=18745.21, stdev=57769.04
lat (usec): min=60, max=2802.8k, avg=18761.70, stdev=57770.60
clat percentiles (usec):
| 1.00th=[ 225], 5.00th=[ 293], 10.00th=[ 330],
| 20.00th=[ 375], 30.00th=[ 416], 40.00th=[ 453],
| 50.00th=[ 494], 60.00th=[ 553], 70.00th=[ 4080],
| 80.00th=[ 34866], 90.00th=[ 48497], 95.00th=[ 64226],
| 99.00th=[ 278922], 99.50th=[ 434111], 99.90th=[ 683672],
| 99.95th=[ 775947], 99.99th=[1384121]
bw ( KiB/s): min= 16, max=215640, per=100.00%, avg=6856.30, stdev=6226.98, samples=1195
iops : min= 4, max=53910, avg=1714.05, stdev=1556.75, samples=1195
lat (usec) : 50=0.01%, 100=0.03%, 250=1.95%, 500=49.36%, 750=15.04%
lat (usec) : 1000=0.58%
lat (msec) : 2=0.96%, 4=1.93%, 10=1.85%, 20=1.14%, 50=17.81%
lat (msec) : 100=7.09%, 250=1.12%, 500=0.78%, 750=0.30%, 1000=0.04%
lat (msec) : 2000=0.02%, >=2000=0.01%
cpu : usr=0.90%, sys=2.83%, ctx=26354, majf=0, minf=279
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued rwt: total=0,1024028,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
WRITE: bw=6821KiB/s (6985kB/s), 6821KiB/s-6821KiB/s (6985kB/s-6985kB/s), io=4000MiB (4194MB), run=600488-600488msec
Disk stats (read/write):
sdc: ios=0/1024257, merge=0/119, ticks=0/18820600, in_queue=18823711, util=100.00%

RAID6：

[root@VxWorks data]# fio -filename=/infokist/data/date.file -direct=1 -thread -iodepth=32 -rw=randwrite -ioengine=libaio -bs=4k -numjobs=1 -runtime=600 -group_reporting -randrepeat=0 -norandommap -time_based -name=mytest
mytest: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=32
fio-3.3
Starting 1 thread
Jobs: 1 (f=1): [w(1)][100.0%][r=0KiB/s,w=1789KiB/s][r=0,w=447 IOPS][eta 00m:00s]
mytest: (groupid=0, jobs=1): err= 0: pid=10541: Wed May 24 08:51:18 2023
write: IOPS=459, BW=1838KiB/s (1882kB/s)(1078MiB/600423msec)
slat (usec): min=3, max=270123, avg=50.85, stdev=1637.21
clat (usec): min=304, max=9495.5k, avg=69596.41, stdev=155079.04
lat (usec): min=319, max=9495.5k, avg=69647.87, stdev=155088.17
clat percentiles (usec):
| 1.00th=[ 816], 5.00th=[ 18744], 10.00th=[ 24249],
| 20.00th=[ 31327], 30.00th=[ 36963], 40.00th=[ 42730],
| 50.00th=[ 49546], 60.00th=[ 56886], 70.00th=[ 65799],
| 80.00th=[ 79168], 90.00th=[ 103285], 95.00th=[ 132645],
| 99.00th=[ 392168], 99.50th=[1035994], 99.90th=[2365588],
| 99.95th=[3003122], 99.99th=[4328522]
bw ( KiB/s): min= 16, max= 2480, per=100.00%, avg=1845.18, stdev=194.04, samples=1196
iops : min= 4, max= 620, avg=461.23, stdev=48.52, samples=1196
lat (usec) : 500=0.44%, 750=0.43%, 1000=0.58%
lat (msec) : 2=0.95%, 4=0.13%, 10=0.05%, 20=3.49%, 50=44.94%
lat (msec) : 100=37.95%, 250=9.66%, 500=0.50%, 750=0.21%, 1000=0.14%
lat (msec) : 2000=0.36%, >=2000=0.16%
cpu : usr=0.72%, sys=1.67%, ctx=258793, majf=0, minf=189
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued rwt: total=0,275840,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
WRITE: bw=1838KiB/s (1882kB/s), 1838KiB/s-1838KiB/s (1882kB/s-1882kB/s), io=1078MiB (1130MB), run=600423-600423msec
Disk stats (read/write):
sdb: ios=0/278091, merge=0/244, ticks=0/19680780, in_queue=19681832, util=100.00%