CentOS-系统光纤连接存储的多路径配置及使用方法.doc

CentOS 系统光纤连接存储的多路径配置及使用方法1、安装多路径软件包：device-mapper-1.02.67-2.el5device-mapper-event-1.02.67.2.el5device-mapper-multipath-0.4.7-48.el52、检查安装包的安装情况#rpm aq |grep multipath3、安装上述多路径软件包#rpm-ivhdevice-mapper-1.02.67-2.el5.x86_64.rpm#rpm-ivhdevice-mapper-event-1.02.67-2.el5.x86_64.rpm#rpm-ivhdevice-mapper-multipath-0.4.7-48.el5.x86_64.rpm安装过程中可能会提示需要安装其他的关联软件包:主要与多路径软件相关联的软件包如下:libaio-0.3.107-10.e16.i686.rpmlibaio-0.3.107-10.e16.x86_64.rpmlibaio-devel-0.3.107-10.e16.i686.rpmlibaio-devel-0.3.107-10.e16.x86_64.rpm如服务器可以连接公网的话,可直接用yum来安装,yum会自动将相关联的软件安装上.#yum install y device-mapper*检查安装情况#rpm aq|grep multipath安装完成后需重启机器.4、配置多路径软件multipath4.1 、将多路径软件添加至内核模块中#modprobe dm-multipath#modprobe dm-round-robin检查内核添加情况#lsmod |grep multipath4.2、将多路径软件multipath设置为开机自启动#chkconfig -level 2345 multipathd on检查#chkconfig -list|grep multipathd启动multipath服务#service multipathd restart4.3、配置multipath软件, 编辑/etc/multipath.conf 注意:默认情况下, /etc/multipath.conf是不存在的,需要做如下准备工作:4.3.1 、 cd至/sbin下,用如下命令生成multipath.conf文件:#mpathconf -enable -find_multipaths y -with_module y -with_chkconfig y4.3.2、查看并获取存储分配给服务器的逻辑盘lun的wwid信息#more /etc/multipath/wwids编辑/etc/multipath.conf,编辑multipath的配置文件时,可将自动生成的multipath.conf保留,重新vim个新的multipath文件.#vim /etc/multipath.confrootahltimt3 # vim /etc/multipath.confdefaults find_multipaths yes user_friendly_names noblacklist #-黑名单项:即不使用多路径的硬盘,如服务器本地盘等 wwid 3600508b1001c5ae72efe1fea025cd2e5 #-不使用多路径的本地盘wwid号 devnode hda-z #-不使用多路径的本地盘hd名称multipaths #-使用多路径软件项 multipath #-单块存储盘配置,如有多块存储盘,如多个multipath配置 wwid 360050763008181d6d000000000000021 #-使用多路径的存储盘wwid号 alias IBMStorage001 #该存储盘多路径后的别名 path_grouping_policy multibus path_selector round-robin 0 failback manual rr_weight priorities no_path_retry 5 multipath wwid 360050763008181d6d000000000000022 alias IBMStorage002 path_grouping_policy multibus path_selector round-robin 0 failback manual rr_weight priorities no_path_retry 5 devices device vendor IBM #-存储厂家名称 product V5000 #-存储产品型号 path_grouping_policy multibus getuid_callout /lib/udev/scsi_id -whitelisted -device=/dev/%n path_checker readsector0 path_selector round-robin 0 hardware_handler 0 failback 15 rr_weight priorities no_path_retry queue 保存文件后退出.4.4、启动multipath配置#multipath v2由上图可看出,名称为IBMStorage015的逻辑盘的wwid号为360050763008181d6d000000000000001,产品型号为IBM2145,该逻辑盘大小为200G,共4条链路,每条链路的状态均为running的,即4条链路均正常.(图中环境为存储双控制器-双SAN-服务器双HBA卡,当存储划分一个lun逻辑盘给服务器后,服务器因为一个lun逻辑盘多条链路的原因会在系统中生成4块相同的wwid号的逻辑盘,这样就给系统的使用带来不便,故需要引入多路径软件.当然多路径软件最主要是为了安全,即4条链路中的某一条两条三条出现故障的情况,仍然不影响系统的使用)查看、检查多路径情况# multipath -l|more启用multipath配置后,会在/dev/mapper下生成多路径逻辑盘#cd /dev/mapper#ll至此,多路径multipath配置完成5、LVM使用和管理多路径逻辑盘5.1、fdisk 磁盘分区由上述图中环境可知，单块逻辑盘大小为200G,若需要使用小于200G时,需要将这200G进行fdisk分区,即上图中的p1(分成多块时,会有p2、p3)#fdisk /dev/mapper/IBMStorage004rootahltimt3 mapper# fdisk /dev/mapper/IBMStorage004Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabelBuilding a new DOS disklabel with disk identifier 0xe24e10c0.Changes will remain in memory only, until you decide to write them.After that, of course, the previous content wont be recoverable.Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)WARNING: DOS-compatible mode is deprecated. Its strongly recommended to switch off the mode (command c) and change display units to sectors (command u).Command (m for help): n #-新建分区Command action e extended p primary partition (1-4)p #-分区类型为主分区Partition number (1-4): 1 #-分区号即p?号First cylinder (1-26108, default 1): 1 #-分区在逻辑盘的开始块号Last cylinder, +cylinders or +sizeK,M,G (1-26108, default 26108): 26108 #-分区在逻辑盘的结束块号Command (m for help): t #-编辑分区类型Selected partition 1Hex code (type L to list codes): 8e #-8e为linux使用的逻辑卷类型(查看所有类型可L查看)Changed system type of partition 1 to 8e (Linux LVM)Command (m for help): p #-查看刚刚分区的类型信息Disk /dev/mapper/IBMStorage004: 214.7 GB, 214748364800 bytes255 heads, 63 sectors/track, 26108 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0xe24e10c0 Device Boot Start End Blocks Id System/dev/mapper/IBMStorage004p1 1 26108 209712478+ 8e Linux LVMCommand (m for help): w #-保存后退出The partition table has been altered!Calling ioctl() to re-read partition table.WARNING: Re-reading the partition table failed with error 22: Invalid argument.The kernel still uses the old table. The new table will be used atthe next reboot or after you run partprobe(8) or kpartx(8)Syncing disks.#cd /dev/mapper#ll此图中多出一个IBMStrage004p15.2、创建物理卷#pvcreate /dev/mapper/IBMStorage004p15.3、创建卷组#vgcreate vgdata002 /dev/mapper/IBMStorage004p15.4、创建逻辑卷#lvcreate -L 100G -n lv_data002 vgdata0025.5、格式化逻辑卷# mkfs.ext4 /dev/vgdata002/lv_data002#mount /dev/vgdata002/lv_data002 /wjshtest说明:使用lvm管理逻辑盘后,即可在线对VG、LV等的在线增加/减少等操作。参考命令有：#vgextend vgdata