EMC磁盘连接AIX的方法及多路径冗余软件POWERPATH安装、配置、测试报告.doc

EMC磁盘连接AIX的方法及多路径冗余软件POWERPATH安装、配置、测试报告第一、ODM部分21.安装前准备工作2获取EMC ODM文件22.安装配置过程23、安装后确认3第二、POWERPATH部分4准备工作4安装配置过程4性能测试工作54、powermt提供的其他功能245、测试环境拓扑图26第三、Appendix：28第一、ODM部分1. 安装前准备工作说明：一般情况下，AIX自带的FC驱动也可以让AIX正常识别出EMC的磁盘，但是会显示为other FC disk之类，这样powerpath是无法管理的，所以要加装ODM。获取EMC ODM文件1、 下载EMC odm文件，这是针对emc在aix提供的驱动。下载地址：/pub/elab/aix/ODM_DEFINITIONS 2. 安装配置过程1、 下载的文件类型这个名字：EMC.AIX..tar.Z，通过FTP传到AIX上。使用binary的方式传，否则无法解压。2、 gzip d，tar xvf命令接包。3、 解包之后用installp命令。4、 安装的时候重点先看看包里面的readme文件，里面重点提到的是不管链接那种EMC设备都只能安装一种support软件，对于symmetric而言，只能安装如下3种文件的任意1种。EMC Symmetrix FCP Support Software; IBM Fibre Channel driver support.EMC Symmetrix FCP MPIO Support Software; IBM default PCM MPIO support.EMC Symmetrix FCP PowerMPIO Support Software; PowerPath custom PCM MPIO support.（这次测试大部分时间都耗在这个问题上，以前没有认真看readme，把全部的fileset都全部安装了。一旦把全部fileset安装上，根本无法识别sysmmetrix的盘，这样导致了后面的powerpath也就无法做了费了2天时间啊。）5、 安装结果如下：# lslpp -l |grep EMC.* EMC.Symmetrix.aix.rte COMMITTED EMC Symmetrix AIX Support EMC.Symmetrix.fcp.rte COMMITTED EMC Symmetrix FCP Support6、 如果EMC盘已经在系统上被识别出来了比如：# lsdev -Ccdiskhdisk0 Available 11-08-00-2,0 16 Bit LVD SCSI Disk Drivehdisk1 Available 11-08-00-4,0 16 Bit LVD SCSI Disk Drivehdisk2 Available 3A-08-01 MPIO Other FC SCSI Disk Drivehdisk3 Available 3A-08-01 MPIO Other FC SCSI Disk Drivehdisk4 Available 3A-08-01 MPIO Other FC SCSI Disk Drivehdisk5 Available 3A-08-01 MPIO Other FC SCSI Disk Drivehdisk6 Available 3A-08-01 MPIO Other FC SCSI Disk Drivehdisk7 Available 3A-08-01 MPIO Other FC SCSI Disk Drive 使用了aix自带的驱动，会显示MPIO Other FC SCSI Disk Drive。7、 先删除掉这些hdisk设备，然后重启AIX。（疑问：应该不用重启，直接运行cfgmgr也可以把，但测试中发现确实重启才行）3、安装后确认1、 显示一下disk的名字即可# lsdev -Ccdiskhdisk0 Available 11-08-00-2,0 16 Bit LVD SCSI Disk Drivehdisk1 Available 11-08-00-4,0 16 Bit LVD SCSI Disk Drivehdisk2 Available 34-08-01 EMC Symmetrix FCP Raid1hdisk3 Available 34-08-01 EMC Symmetrix FCP Raid1hdisk4 Available 34-08-01 EMC Symmetrix FCP Raid1hdisk5 Available 34-08-01 EMC Symmetrix FCP Raid1hdisk6 Available 34-08-01 EMC Symmetrix FCP Raid1hdisk7 Available 34-08-01 EMC Symmetrix FCP Raid1hdisk8 Available 34-08-01 EMC Symmetrix FCP Diskhdisk9 Available 34-08-01 EMC Symmetrix FCP Raid1hdisk10 Available 34-08-01 EMC Symmetrix FCP Diskhdisk11 Available 3A-08-01 EMC Symmetrix FCP Raid1hdisk12 Available 3A-08-01 EMC Symmetrix FCP Raid1hdisk13 Available 3A-08-01 EMC Symmetrix FCP Raid1hdisk14 Available 3A-08-01 EMC Symmetrix FCP Raid1hdisk15 Available 3A-08-01 EMC Symmetrix FCP Raid1hdisk16 Available 3A-08-01 EMC Symmetrix FCP Raid1hdisk17 Available 3A-08-01 EMC Symmetrix FCP Raid1第二、POWERPATH部分准备工作1. 获取powerpath安装文件l 到下载即可。2. 获取EMC support matrixl 到的E-Lab按先导来操作Home Support Interoperability and Product Lifecycle Information E-Lab Interoperability Navigator 安装配置过程1. 安装过程l ftp到AIX上面，然后解压之后使用installp安装。2. 配置过程l powermt config 简单，一个命令即可l powermt display dev=all 显示PATH# powermt config powerpath0 created # lspv (hdiskpower*这个设备出现好像要延迟一点时间，不会马上出现，网上还看到说1天以后才出现的情况。估计是盘比较多，路径运算需要很多时间，此时连接拓扑如图1)hdisk0 000a5e2a167bccb3 rootvg activehdisk1 000a5e2a16a41f2a rootvg activehdisk2 none None hdisk3 none None hdisk4 none None hdisk5 none None hdisk6 none None hdisk7 none None hdisk8 none None hdisk9 none None hdisk10 none None hdisk11 none None hdisk12 none None hdisk13 none None hdisk14 none None hdisk15 none None hdisk16 none None hdisk17 none None hdiskpower0 0002530f757a406b None hdiskpower1 0002530f757a532e None hdiskpower2 0002530f757a64a6 None hdiskpower3 0002530f757a9d86 None hdiskpower4 0002530f757abfca None hdiskpower5 0002530f759af8ee None hdiskpower6 0002530f75b96e18 None hdiskpower7 0002530f759b0ccc None 性能测试工作1. 基本功能测试1、hdisk4 已经没有PVID，尝试分配PVID，竟然成功，并且也hdiskpower设备重复# chdev -l hdisk4 -a pv=yeshdisk4 changed# lspvhdisk0 000a5e2a167bccb3 rootvg activehdisk1 000a5e2a16a41f2a rootvg activehdisk2 none None hdisk3 none None hdisk4 0002530f757a532e None hdiskpower1 0002530f757a532e None 2、参数在全部hdiskpower*设备上面建立VG，成功；# lsvg tttVOLUME GROUP: ttt VG IDENTIFIER: 0002530f00004c000000011b760be4b3VG STATE: active PP SIZE: 16 megabyte(s)VG PERMISSION: read/write TOTAL PPs: 2064 (33024 megabytes)MAX LVs: 256 FREE PPs: 2064 (33024 megabytes)LVs: 0 USED PPs: 0 (0 megabytes)OPEN LVs: 0 QUORUM: 5TOTAL PVs: 8 VG DESCRIPTORS: 8STALE PVs: 0 STALE PPs: 0ACTIVE PVs: 8 AUTO ON: yesMAX PPs per PV: 1016 MAX PVs: 32LTG size: 128 kilobyte(s) AUTO SYNC: noHOT SPARE: no BB POLICY: relocatable2、 尝试在hdisk设备上建立vg，竟然也成功，有点奇怪了，选择hdisk4和hdisk5，慢慢观察发现，其实可以看到hdiskpower1 也已经hdiskpower2也已经连接到vg：ttt了,也就是说选hdisk或者hdiskpower都可以，最后都会反映到hdiskpower上。# mkvg -y ttt hdisk4 hdisk50516-1254 mkvg: Changing the PVID in the ODM. ttt# lsvg tttVOLUME GROUP: ttt VG IDENTIFIER: 0002530f00004c000000011b760ebd42VG STATE: active PP SIZE: 4 megabyte(s)VG PERMISSION: read/write TOTAL PPs: 1374 (5496 megabytes)MAX LVs: 256 FREE PPs: 1374 (5496 megabytes)LVs: 0 USED PPs: 0 (0 megabytes)OPEN LVs: 0 QUORUM: 2TOTAL PVs: 2 VG DESCRIPTORS: 3STALE PVs: 0 STALE PPs: 0ACTIVE PVs: 2 AUTO ON: yesMAX PPs per PV: 1016 MAX PVs: 32LTG size: 128 kilobyte(s) AUTO SYNC: noHOT SPARE: no BB POLICY: relocatable # lspv hdisk4 0002530f757a532e ttt activehdisk5 0002530f757a64a6 ttt activehdisk6 none None hdiskpower0 0002530f757a406b None hdiskpower1 0002530f757a532e ttt activehdiskpower2 0002530f757a64a6 ttt active2. 测试路径（path fail-over）的使用1、 在线添加一个路径（可以看到1、cfmgr 2、powermt config 3、盘全部被正常识别，并且路径已经添加,链接情况由图1变成图2，添加了path3）# cfgmgr -l fcs0# lspvhdisk0 000a5e2a167bccb3 rootvg activehdisk1 000a5e2a16a41f2a rootvg activehdisk2 none None hdisk3 none None hdisk4 none None hdisk5 none None hdisk6 none None hdisk7 none None hdisk8 none None hdisk9 none None hdisk10 none None hdisk11 none None hdisk12 none None hdisk13 none None hdisk14 none None hdisk15 none None hdisk16 none None hdisk17 none None hdiskpower0 0002530f757a406b None hdiskpower1 0002530f757a532e None hdiskpower2 0002530f757a64a6 None hdiskpower3 0002530f757a9d86 None hdiskpower4 0002530f757abfca None hdiskpower5 0002530f759af8ee None hdiskpower6 0002530f75b96e18 None hdiskpower7 0002530f759b0ccc None hdisk18 none None hdisk19 0002530f757a406b None hdisk20 0002530f757a532e None hdisk21 0002530f757a64a6 None hdisk22 0002530f757a9d86 None hdisk23 0002530f757abfca None hdisk24 0002530f75b96e18 None # powermt config# lspvhdisk0 000a5e2a167bccb3 rootvg activehdisk1 000a5e2a16a41f2a rootvg activehdisk2 none None hdisk3 none None hdisk4 none None hdisk5 none None hdisk6 none None hdisk7 none None hdisk8 none None hdisk9 none None hdisk10 none None hdisk11 none None hdisk12 none None hdisk13 none None hdisk14 none None hdisk15 none None hdisk16 none None hdisk17 none None hdiskpower0 0002530f757a406b None hdiskpower1 0002530f757a532e None hdiskpower2 0002530f757a64a6 None hdiskpower3 0002530f757a9d86 None hdiskpower4 0002530f757abfca None hdiskpower5 0002530f759af8ee None hdiskpower6 0002530f75b96e18 None hdiskpower7 0002530f759b0ccc None hdisk18 none None hdisk19 none None hdisk20 none None hdisk21 none None hdisk22 none None hdisk23 none None hdisk24 none None # powermt display dev=allPseudo name=hdiskpower6Symmetrix ID=000284500526Logical device ID=0000state=alive; policy=SymmOpt; priority=0; queued-IOs=0=- Host - - Stor - - I/O Path - - Stats -# HW Path I/O Paths Interf. Mode State Q-IOs Errors= 2 fscsi2 hdisk17 FA 4bA active alive 0 1 0 fscsi0 hdisk24 FA 5bA active alive 0 0 1 fscsi1 hdisk9 FA 4aA active alive 0 0Pseudo name=hdiskpower0Symmetrix ID=000284500526Logical device ID=0001state=alive; policy=SymmOpt; priority=0; queued-IOs=0=- Host - - Stor - - I/O Path - - Stats -# HW Path I/O Paths Interf. Mode State Q-IOs Errors= 2 fscsi2 hdisk12 FA 4bA active alive 0 1 0 fscsi0 hdisk19 FA 5bA active alive 0 0 1 fscsi1 hdisk3 FA 4aA active alive 0 0Pseudo name=hdiskpower1Symmetrix ID=000284500526Logical device ID=0002state=alive; policy=SymmOpt; priority=0; queued-IOs=0=- Host - - Stor - - I/O Path - - Stats -# HW Path I/O Paths Interf. Mode State Q-IOs Errors= 2 fscsi2 hdisk13 FA 4bA active alive 0 1 0 fscsi0 hdisk20 FA 5bA active alive 0 0 1 fscsi1 hdisk4 FA 4aA active alive 0 0Pseudo name=hdiskpower2Symmetrix ID=000284500526Logical device ID=0003state=alive; policy=SymmOpt; priority=0; queued-IOs=0=- Host - - Stor - - I/O Path - - Stats -# HW Path I/O Paths Interf. Mode State Q-IOs Errors= 2 fscsi2 hdisk14 FA 4bA active alive 0 1 0 fscsi0 hdisk21 FA 5bA active alive 0 0 1 fscsi1 hdisk5 FA 4aA active alive 0 0Pseudo name=hdiskpower3Symmetrix ID=000284500526Logical device ID=0004state=alive; policy=SymmOpt; priority=0; queued-IOs=0=- Host - - Stor - - I/O Path - - Stats -# HW Path I/O Paths Interf. Mode State Q-IOs Errors= 2 fscsi2 hdisk15 FA 4bA active alive 0 1 0 fscsi0 hdisk22 FA 5bA active alive 0 0 1 fscsi1 hdisk6 FA 4aA active alive 0 0Pseudo name=hdiskpower4Symmetrix ID=000284500526Logical device ID=0005state=alive; policy=SymmOpt; priority=0; queued-IOs=0=- Host - - Stor - - I/O Path - - Stats -# HW Path I/O Paths Interf. Mode State Q-IOs Errors= 2 fscsi2 hdisk16 FA 4bA active alive 0 1 0 fscsi0 hdisk23 FA 5bA active alive 0 0 1 fscsi1 hdisk7 FA 4aA active alive 0 0Pseudo name=hdiskpower5Symmetrix ID=000284500526Logical device ID=0008state=alive; policy=SymmOpt; priority=0; queued-IOs=0=- Host - - Stor - - I/O Path - - Stats -# HW Path I/O Paths Interf. Mode State Q-IOs Errors= 1 fscsi1 hdisk8 FA 4aA active alive 0 0Pseudo name=hdiskpower7Symmetrix ID=000284500526Logical device ID=0009state=alive; policy=SymmOpt; priority=0; queued-IOs=0=- Host - - Stor - - I/O Path - - Stats -# HW Path I/O Paths Interf. Mode State Q-IOs Errors= 1 fscsi1 hdisk10 FA 4aA active alive 0 02、 把path2的光纤拔下，模拟生产中连接断开的情况# errpt |more （可以看到fcs1错误，链接的hdisk3hdiak10全部报错）IDENTIFIER TIMESTAMP T C RESOURCE_NAME DESCRIPTION3767AAFF 0731073208 I H BACK-UP PATH INOPERATIVE516A2BC4 0731073208 P H hdisk8 CONNECTION FAILURE3074FEB7 0731073208 T H fs