安装PowerPath的集群AIX平台使用EMC磁盘系统注意事项 v1.2.doc

安装安装 PowerPath 的集群的集群 AIX 平台平台 使用使用 EMC 磁盘系统磁盘系统 注意事项注意事项 2006 年年 11 月月 EMC 技术解决方案部技术解决方案部 版本记录版本记录 版本号版本号版本日期版本日期修改者修改者说明说明 1 02006 年 11 月 28 日王进创建文档并加入 Symmetrix 部分 1 12006 年 11 月 28 日夏卫东加入 Clariion 部分 1 22006 年 12 月 6 日夏卫东修改 Clariion 的 LV striping 部分 版权说明版权说明 本文件中出现的任何文字叙述 文档格式 插图 照片 方法 过程等内容 除另有特别注明 版权均属美国 EMC 公司所有 受到有关产权及版权法保护 任何个人 机构未经美国 EMC 公司的书面授权许可 不得复制 引用或传播本文件的任何片断 无论通过电子形式或非电子形式 目目 录录 1安装安装 POWERPATH 的集群的集群 AIX 平台使用平台使用 EMC SYMMETRIX 磁盘注意事项磁盘注意事项 4 1 1在 HACMP 中设置EMCPOWERRESET以及BREAK RESERVES IN PARALLEL TRUE 4 1 2LV STRIPING 5 2安装安装 POWERPATH 的集群的集群 AIX 平台使用平台使用 EMC CLARIION 磁盘注意事项磁盘注意事项 6 2 1在 HACMP 中设置EMCPOWERRESET以及BREAK RESERVES IN PARALLEL TRUE 6 2 2在 HACMP POWERPATH环境中设置CFGSCSI ID以提高 HACMP 启动和切换速度 7 2 3LV STRIPING 9 1安装安装 PowerPath 的集群的集群 AIX 平台使用平台使用 EMC Symmetrix 磁盘注意事磁盘注意事 项项 1 1在在 HACMP 中设置中设置 emcpowerreset 以及以及 break reserves in parallel true 为保证 HACMP 能够顺利切换并且最大限度地加快切换速度 需要在 HACMP 配置中遵循以下指导 For HACMP 5 1 and higher SMIT 1 Enter into the SMIT fastpath for HACMP smitty hacmp 2 Select Extended Configuration 3 Select Extended Resource Configuration 4 Select HACMP Extended Resources Configuration 5 Select Configure Custom Disk Methods 6 Select Add Custom Disk Methods 7 The following fields are available enter as follows For IBM Fibre Channel configurations with PowerPath 3 0 3 and higher Disk Type PdDvLn field from CuDv disk pseudo power Method to identify ghost disks SCSI3 Method to determine if a reserve is held SCSI TUR Method to break a reserve usr lpp EMC Symmetrix bin emcpowerreset Break reserves in parallel true Method to make the disk available MKDEV 8 Configure the same custom disk processing method on each node in the cluster and synchronize the cluster resources The cluster verification process ensures that the method that you configured exists and is executable on all nodes The synchronization process ensures that the ODM entries are the same on all nodes but will not synchronize the methods named in the ODM entries Note To help insure emcpowerreset is installed and configured correctly go to etc objrepos and enter the command odmget HACMPdisktype If installed correctly you should see emcpowerreset called on the breakres line See example below HACMPdisktype PdDvLn disk pseudo power ghostdisks SCSI3 checkres SCSI TUR breakres usr lpp EMC Symmetrix bin emcpowerreset parallel true makedev MKDEV reserved1 reserved2 reserved3 In addition after a failover you can look at the hacmp out file and confirm emcpowerreset appears for the FC Path and or hdisk entry See example below Clar Cascade 1 cl disk available 13 ckres rc 2 Clar Cascade 1 cl disk available 13 2 0 Clar Cascade 1 cl disk available 29 usr lpp EMC CLARiiON bin emcpowerreset fscsi1 hdiskpower38 Clar Cascade 1 cl disk available 1228 echo Clar Cascade 1 Clar Cascade 1 Clar Cascade 1 cl disk available 1228 read vg 注注 从从 HACMP V5 4 开始开始 无需配置使用无需配置使用 emcpowerreset 1 2LV Striping EMC 强烈建议在条件许可的情况下 在主机层面进行 LV Striping 设置以提高 IO 性能 通常 Striping 宽度为 4 的倍数 深度取决于客户应用的 IO Size 一般可取 32k 2安装安装 PowerPath 的集群的集群 AIX 平台使用平台使用 EMC Clariion 磁盘注意事项磁盘注意事项 2 1在在 HACMP 中设置中设置 emcpowerreset 以及以及 break reserves in parallel true 为保证 HACMP 能够顺利切换并且最大限度地加快切换速度 需要在 HACMP 配置中遵循以下指导 For HACMP 5 1 and higher SMIT 1 Enter into the SMIT fastpath for HACMP smitty hacmp 2 Select Extended Configuration 3 Select Extended Resource Configuration 4 Select HACMP Extended Resources Configuration 5 Select Configure Custom Disk Methods 6 Select Add Custom Disk Methods 7 The following fields are available enter as follows For IBM Fibre Channel configurations with PowerPath 3 0 3 and higher Disk Type PdDvLn field from CuDv disk pseudo power Method to identify ghost disks SCSI3 Method to determine if a reserve is held SCSI TUR Method to break a reserve usr lpp EMC Symmetrix bin emcpowerreset Break reserves in parallel true Method to make the disk available MKDEV 8 Configure the same custom disk processing method on each node in the cluster and synchronize the cluster resources The cluster verification process ensures that the method that you configured exists and is executable on all nodes The synchronization process ensures that the ODM entries are the same on all nodes but will not synchronize the methods named in the ODM entries Note To help insure emcpowerreset is installed and configured correctly go to etc objrepos and enter the command odmget HACMPdisktype If installed correctly you should see emcpowerreset called on the breakres line See example below HACMPdisktype PdDvLn disk pseudo power ghostdisks SCSI3 checkres SCSI TUR breakres usr lpp EMC Symmetrix bin emcpowerreset parallel true makedev MKDEV reserved1 reserved2 reserved3 In addition after a failover you can look at the hacmp out file and confirm emcpowerreset appears for the FC Path and or hdisk entry See example below Clar Cascade 1 cl disk available 13 ckres rc 2 Clar Cascade 1 cl disk available 13 2 0 Clar Cascade 1 cl disk available 29 usr lpp EMC CLARiiON bin emcpowerreset fscsi1 hdiskpower38 Clar Cascade 1 cl disk available 1228 echo Clar Cascade 1 Clar Cascade 1 Clar Cascade 1 cl disk available 1228 read vg 注注 从从 HACMP V5 4 开始开始 无需配置使用无需配置使用 emcpowerreset 2 2在在 HACMP PowerPath 环境中设置环境中设置 cfgscsi id 以提高以提高 HACMP 启动和切换速启动和切换速 度度 注 1 在 Symmetrix 环境中不需要设置此脚本 而在 Clariion 环境中需要设置此脚本 安装时 必须 同时安装 emcpowerreset 注 2 cfgscsi id 取代了以前的 set scsi id 某些用户可能已经安装了 set scsi id 这种情况下 不需要重新安装 Procedure to configure into HACMP After going to Powerlink to download cfgscsi id put it into usr sbin on all nodes in the cluster and make it executable Use the procedure below on every node in the cluster to add the cfgscsi id utility into the HACMP environment 1 Check for and remove any previous set scsi id or set scsi id sh cluster events that may have been used Do this by running odmget HACMPcustom and note any events named set scsi id or set scsi id sh If one is found run the command below to remove it and then re run odmget command to confirm all are gone usr es sbin cluster utilities clrmcustom t event n set scsi id or n set scsi id sh 2 Add the custom cluster event to your HACMP configuration This event is the name given to the script that will be added later to select pre defined HACMP events Note that this is one long command with no carriage returns usr es sbin cluster utilities claddcustom t event n cfgscsi id I Set correct scsi id on EMC CLARiiON pseudo devices v usr sbin cfgscsi id 3 Verify your custom cluster event was added correctly by running the command below and comparing the output odmget HACMPcustom HACMPcustom name cfgscsi id type event description Set correct scsi id on EMC CLARiiON pseudo devices value usr sbin cfgscsi id relation status 0 4 Run the two commands below to modify the pre defined HACMP event by giving the event command your custom cluster event as a pre event command usr es sbin cluster utilities clchevent O node up s usr es sbin cluster events node up b cfgscsi id c 0 usr es sbin cluster utilities clchevent O node down s usr es sbin cluster events node down b cfgscsi id c 0 5 Verify the events were properly modified by running the two commands below and comparing the output odmget q name node up HACMPevent HACMPevent name node up desc Script run when a node is attempting to join the cluster setno 101 msgno 7 catalog events cat cmd usr es sbin cluster events node up notify pre cfgscsi id post recv count 0 event duration 0 odmget q name node down HACMPevent HACMPevent name node down desc Script run when a node is attempting to leave the cluster setno 101