rbd bench-write工具使用（存储技术）

rbdbench-write介绍rbdbench-write是ceph集群自带的块设备基准性能测试工具，通过librbd方式对rbdimage进行块设备写性能测试。环境要求存储节点：可以直接运行不需要配置，客户端节点：要求在Centos7上安装运行，需要安装配置好ceph环境（参照谢菲写的文档）使用说明语法格式rbdbench-write的语法：rbdbench-write<poolname/rbdimagename>可选如下参数：--io-size：缺省单位byte，默认4096bytes=4K，可用单位：B、K、M、G、T；--io-threads：线程数，默认16；--io-total：总写入字节，缺省单位byte，默认值1024M，可用单位：B、K、M、G、T；--io-pattern<seq|rand>：写模式，seq：顺序写；rand：随机写；默认为seq即顺序写；执行工具在ucs2.0集群节点、ceph客户端上都可以执行该工具测试，命令都是一样的1．在ucs2.0集群节点上： ##顺序写##顺序写[root@m-ceph-16~]#rbdbench-writehot-pool/rbd-001--io-size512K--io-threads10--io-total1G--io-patternseqbench-writeio_size524288io_threads10bytes1073741824patternsequentialSECOPSOPS/SECBYTES/SEC1236240.45126063600.512461234.08122726687.523709234.22122800112.164946238.29124932489.1151177236.65124070233.0161413233.43122384527.3671607229.66120408828.7081846230.61120903606.70elapsed:9ops:2048ops/sec:226.21bytes/sec:118601369.39[root@m-ceph-16~]#512K*2048=1024M118601369.39byte=113.1070798778534MB113.1M*9=1024Mcephdf查看，增加的容量（没有写之前used17M）差不多写入的1G接近。在osd中查看对象文件大小，基本都是4M的文件[root@m-ceph-143.7f_head]#cephdfGLOBAL:SIZEAVAILRAWUSED%RAWUSED8977G8799G178G1.99POOLS:NAMEIDUSED%USEDMAXAVAILOBJECTSecpool-0011004889G0hot-pool200732G0hot-pool131169M0.011464G315##随机写##随机写[root@m-ceph-16~]#rbdbench-writehot-pool/rbd-001--io-size512K--io-threads10--io-total1G--io-patternrandbench-writeio_size524288io_threads10bytes1073741824patternrandomSECOPSOPS/SECBYTES/SEC1340349.01182982444.222640322913971326.10170970970.9441293325.24170517651.2951611322.80169242081.9061919314.25164756141.12elapsed:7ops:2048ops/sec:289.26bytes/sec:151653071.65[root@m-ceph-16~]#[root@m-ceph-143.7f_head]#cephdfGLOBAL:SIZEAVAILRAWUSED%RAWUSED8977G8800G177G1.98POOLS:NAMEIDUSED%USEDMAXAVAILOBJECTSecpool-0011004889G0hot-pool200732G0hot-pool134387M0.051465G1980随机写，查看cephdf，写1G的容量，显示的4387M，相当于4个1G的大小。对比顺序写，随机写的object数量多很多，随机写和顺序写不同，不会写满一个对象的4M。估计ceph计算随机写容量的方式也不是很精确，随机写1G的数据，而实际显示的容量要大很多。和顺序写占用空间不同。[root@m-ceph-143.7f_head]#ll-lhtotal6.6M-rw-r--r--1rootroot0Sep911:43__head_0000007F__3-rw-r--r--1rootroot1.5MSep1009:34rbd\udata.16fcd6b8b4567.00000000000007a1__head_64A6557F__3-rw-r--r--1rootroot3.0MSep1009:34rbd\udata.16fcd6b8b4567.000000000000102e__head_066B877F__3-rw-r--r--1rootroot2.5MSep1009:34rbd\udata.16fcd6b8b4567.000000000000184a__head_3F0100FF__3-rw-r--r--1rootroot1.0MSep1009:34rbd\udata.16fcd6b8b4567.0000000000001bc3__head_FC34F2FF__3-rw-r--r--1rootroot3.0MSep1009:34rbd\udata.16fcd6b8b4567.0000000000001c8a__head_461421FF__3-rw-r--r--1rootroot3.5MSep1009:34rbd\udata.16fcd6b8b4567.0000000000001cef__head_D1428CFF__3-rw-r--r--1rootroot2.5MSep1009:34rbd\udata.16fcd6b8b4567.00000000000021b5__head_F08CE3FF__3-rw-r--r--1rootroot1.5MSep1009:34rbd\udata.16fcd6b8b4567.0000000000003df8__head_942929FF__3-rw-r--r--1rootroot512KSep1009:34rbd\udata.16fcd6b8b4567.00000000000040fd__head_729BC27F__3-rw-r--r--1rootroot1.5MSep1009:34rbd\udata.16fcd6b8b4567.0000000000004548__head_CD3E817F__3-rw-r--r--1rootroot2.0MSep1009:34rbd\udata.16fcd6b8b4567.0000000000004b20__head_1FA1687F__3-rw-r--r--1rootroot2.0MSep1009:34rbd\udata.16fcd6b8b4567.0000000000005a35__head_2E069D7F__32．在ceph客户端上使用与集群节点上使用是一样的。[root@localhost~]#rbdbench-writehot-pool/rbd-001--io-size512K--io-threads10--io-total1G--io-patternrandbench-writeio_size524288io_threads10bytes1073741824patternrandomSECOPSOPS/SECBYTES/SEC1234235.42123429570.922441223.54117197450.363660221.20115970132.904882220.54115627205.5551091219.77115223046.0561312215.38112918968.6371524215.83113155180.1881742216.71113617677.7191965216.81113668781.46elapsed:9ops:2048ops/sec:212.98bytes/sec:111663489.21[root@localhost~]#测试完一轮如果需要清空对象，可以按如下操作：查看rbd块的block_name_prefix[root@m-ceph-143.7f_head]#rbdinfohot-pool1/rbd-001rbdimage'