hds-存储-hdlm配置安装手册（aix）-v11.doc

分行 IT 基础设施资源整合 技术组件项目文档 中国建设银行信息技术管理部 SFB 项目组 分行 IT 基础设施资源整合项目文档 分行分行 ITIT 基础设施资源整合项目基础设施资源整合项目 HDS HDLM 软件配置安装手册 AIX VER 1 10 中国建设银行信息技术管理部 SFB 项目组 2007 年 7 月 编号CCB SFB 144 密级 分行 IT 基础设施资源整合 技术组件项目文档 中国建设银行信息技术管理部 SFB 项目组 文档信息文档信息 文挡名称初稿作者审核建立日期 文档修订记录文档修订记录 章节编号章节名称修订内容简述修订日期修订前版本号 1 4HDS HDLM 版本说明 修改 5 9 1 为 5 8 1 2008 1 21 0 2 1 主机需求根据 5 8 的需求更新 2008 1 21 0 3 介质准备更改介质文件名称 2008 1 21 0 4 2 HDLM 安装 步骤 重新编制 2008 1 21 0 4 3 HDLM 软件 安装 重新编制 2008 1 21 0 4 4 安装 HDLM 5 8 1 SP2 补丁 新增该章节 2008 1 21 0 分行 IT 基础设施资源整合 技术组件项目文档 HDS HDLM 软件配置安装手册 AIX VER 1 1 目录目录 第第 1 1 章章HDSHDS HDLMHDLM 功能概述功能概述 3 3 1 1HDS HDLM 介绍 3 1 2HDLM 软件特点 3 1 3HDLM 软件工作方式 3 1 4HDS HDLM 版本说明 4 第第 2 2 章章安装需求安装需求 5 5 2 1主机需求 5 2 2HDS 存储需求 7 第第 3 3 章章介质准备介质准备 9 9 第第 4 4 章章HDSHDS HDLMHDLM 安装配置步骤安装配置步骤 1010 4 1ODM 库安装 10 4 2HDLM 安装步骤 12 4 3HDLM 软件安装 12 4 4安装 HDLM 5 8 1 SP02 补丁 14 4 5HDLM 在 HACMP 环境的注册 16 第第 5 5 章章常用命令常用命令 1818 第第 1 1 章章HDSHDS HDLMHDLM 功能概述功能概述 3 3 1 1HDS HDLM 介绍 3 1 2HDLM 软件特点 3 1 3HDLM 软件工作方式 3 1 4HDS HDLM 版本说明 4 第第 2 2 章章安装需求安装需求 5 5 2 1主机需求 5 2 2HDS 存储需求 7 第第 3 3 章章介质准备介质准备 8 8 第第 4 4 章章HDSHDS HDLMHDLM 安装配置步骤安装配置步骤 9 9 分行 IT 基础设施资源整合 技术组件项目文档 4 1ODM 库安装 9 4 2HDLM 安装步骤 11 4 3HDLM 软件安装 11 4 4HDLM 在 HACMP 环境的注册 14 第第 5 5 章章常用命令常用命令 1616 分行 IT 基础设施资源整合 技术组件项目文档 4 第 1 章 HDS HDLM 功能概述 1 1 HDS HDLM 介绍 HDLM Hitachi Dynamic Link Manager 是 HDS 公司提供的安装在主机端的存储工具软件 HDLM 提 供主机到存储系统的 I O 通道负载平衡和故障切换功能 增强了主机系统的数据可得性 虽然存储系统 通过 RAID 技术对数据进行了保护 但是单纯的存储系统是不能够提供整个 I O 系统的端到端的保护的 主机端到存储系统的整个 I O 路径中发生了故障如 HBA 失效 FC 交换设备故障 连接电缆断开等会中 断主机端对数据的访问 HDS 公司提供的 HDLM 软件 通过对主机到存储的冗余 I O 路径的管理实现负载 均和故障切换 保证了 24 7 业务不间断的运行 1 2HDLM 软件特点 高可靠 通过服务器的多条通道实现 I O 通道自动的故障切换和恢复回切提高了服务器端 数据访问的安全性和性能 高性能 通过多条 I O 通道的负载均衡提高了应用系统数据访问的性能 进而有效改善了 应用系统的性能 易安装 HDLM 能够自动查寻主机端到存储端的路径 这种查寻无论是直连的 DAS 结构还是 复杂的 SAN 结构都可以自动完成 因此 HDLM 安装完成后不需要复杂的配置就可以使用了 1 3HDLM 软件工作方式 HDLM 对 I O 通道进行实时控制 检测每个通道的状态 当有任何一个通道发生故障时自动将 I O 切 换到其它健康的通道上 同时 HDLM 会自动记录整个操作过程 HDLM 能够支持所有的 HDS 存储系统 并 且在功能上基本相同 对于 HDS USP 系列和 AMS 系列 在实现负载均衡的时候会有所不同 由于 AMS 系 列中的 LUNs 是由两个控制器分别控制的 因此服务器通过不同的通道同时连接两个控制器时会存在两种 类型的通道 Owner 或 Non ower 的通道如下图 在 Owner Path 之间可以实现负载均衡 分行 IT 基础设施资源整合 技术组件项目文档 5 1 4HDS HDLM 版本说明 操作系统版本 操作系统版本 适用于 XX 现有 AIX 环境 包括 AIX 5 2 AIX5 3 HDLMHDLM 版本 版本 仅适用 HDLM for AIX V 5 98 1 02 分行 IT 基础设施资源整合 技术组件项目文档 6 第 2 章 安装需求 2 1主机需求 相关程序要求 VisualAge C Runtime 5 0 0 0 or later or IBM XL C C V7 Runtime 7 0 0 0 to IBM XL C C V8 Runtime 8 0 0 0 8 0 0 6 8 0 0 7 8 0 0 1 to 8 0 0 5 are not supported HTC ODM 5 0 52 1 or later 主机内存和磁盘需求 内存需求 OSOS RequiredRequired MemoryMemory AIX 3MB 360 bytes maximum simultaneous I O requests 1 4KB Number of paths 60MB50000 KB 0 256 KB x number of LUs 1 28 KB x number of paths 1 The default is16384 磁盘需求 DirectoryDirectory DiskDisk SpaceSpace RequirementRequirement etc3KB150 KB opt 2KB2 MB usr45MB220MB var 40 MB p MB 1 2 MB 2 q MB 3 1 MBp MB 1 4MB 2 MB q MB 2 19 MB 1 It depends on the settings for the log files The maximum size is 30 GB where p s m 1024 round up MB s The error log file size the default value is 9900 m The number of error log files the default value is 2 2 It depends on the settings for the Inquiry log file size The maximum size is 20 MB 3 It depends on the settings for the trace files The maximum size is 1000 MB where q t n 1024 round up MB t The trace file size the default value is 1000 n The number of trace files the default value is 4 1 This value depends on the error log file settings The maximum is 30 000 MB p s x m 1024 in MB where s is the size of the error log file units KB default is 9 900 and m is the number of error log files default is 2 The resulting fraction will be rounded up 2 This value depends on the trace file settings The maximum is 1000 MB 分行 IT 基础设施资源整合 技术组件项目文档 7 q t x n 1024 in MB where t is the size of the trace file units KB default is 1 000 and n is the number of trace files default is 4 The resulting fraction will be rounded up HBA 卡的支持 I FI F ApplicableApplicable HBAHBA AIXAIX 5 25 2 AIXAIX 5 35 3 IBM FC6227 IBM FC6227 5 2 0 0 driver or later 5 2 0 30 driver or later 5 3 0 0 driver or later 5 3 0 0 driver or later IBM FC6228 IBM FC6228 5 2 0 0 driver or later 5 2 0 75 driver or later 5 3 0 0 driver or later 5 3 0 30 driver or later IBM FC6239 IBM FC6239 5 2 0 16 driver or later IY49823 5 2 0 75 driver or later 5 3 0 0 driver or later 5 3 0 30 driver or later IBM FC1905 IBM FC5716 FC1977 5 2 0 0 driver or later 1 5 2 0 95 driver or later 5 3 0 0 driver or later 2 5 3 0 50 driver or later IBM FC1910 IBM FC5758 FC1905 5 2 0 0 driver or later 1 5 2 0 95 driver or later 5 3 0 0 driver or later 2 5 3 0 50 driver or later IBM FC1957 IBM FC5759 FC1910 5 2 0 70 driver or later 5 2 0 95 driver or later 5 3 0 30 driver or later 5 3 0 50 driver or later IBM FC1977 5 2 0 70 driver or later 5 3 0 30 driver or later IBM FC5716 5 2 0 40 driver or later 5 3 0 0 driver or later IBM FC5758 5 2 0 0 driver or later 1 5 3 0 0 driver or later 2 IBM FC5759 5 2 0 0 driver or later 1 5 3 0 0 driver or later 2 IBM FC5760 5 2 0 0 driver or later 1 5 3 0 0 driver or later 2 IBM FC0611 5 2 0 0 driver or later 5 3 0 0 driver or later IBM FC0625 5 2 0 16 driver or later IY49823 5 3 0 0 driver or later IBM FC0629 5 2 0 0 driver or later 1 5 3 0 0 driver or later 2 IBM FC0646 5 2 0 70 driver or later 5 3 0 30 driver or later IBM FC2766 5 2 0 0 driver or later 5 3 0 0 driver or later Fibre Channel IBM FC2787 5 2 0 16 driver or later 4982 5 3 0 0 driver or later 1 Technology Level 08 or later 2 Technology Level 04 or later 分行 IT 基础设施资源整合 技术组件项目文档 8 操作系统的支持 AIX operating system OSOS KernelKernel AIX 5 1 1 AIX 5 2 Maintenance Level 02 to 09 IY32862 IY37437 IY43734 IY48725 IY50048 IY50502 Technology Level 09 AIX 5 2 1 AIX 5 3 Maintenance Level None to 07 or Technology Level 08 to 09 IY37183 IY39860 IY44133 IY45368 IY50049 IY50233 Technology Level 04 and 05 AIX 5 3 1 AIX 5 3 Virtual I O Server Maintenance Level None to 03 or Technology Level 04 to 06 IY70159 ioslevel 1 3 0 0 AIX 5 3 Virtual I O ioslevel 1 2 0 0 to 1 3 0 0 3 1 The ODM configuration package for Lightning Thunder is required However it is not required when the following conditions exist The storage Subsystem of XP48 XP128 XP256 XP512 XP1024 XP10000 XP12000 or SVS is used 2 Supports only an IBM and HBA IBM disk driver configuration 3 When ioslevel is earlier than 1 1 2 62 it is necessary to apply it before you perform a new installation or an update installation of HDLM5 8 0 00 or later Refer to 2 in section 4 5 Notes on creating an HDLM environment for procedure to apply HA 软件的支持 OSOS RelatedRelated ProgramsPrograms HACMP 5 2 HACMP 5 3 IY56554 IY72649 IY75002 HACMP 5 4 IY84921 Oracle RAC 10g 10 2 0 2 0 HACMP 5 2 Oracle RAC 10g 10 1 0 5 0 ASM VERITAS Cluster Server 4 0 1 VERITAS Cluster Server 4 0 3 1 AIX 5 2 GPFS 2 3 RVSD IY47306 GPFS3 1 GPFS3 1 RVSD HACMP 5 2 IY58496 HACMP 5 3 IY75002 IY78404 HACMP 5 4 IY84920 AIX 5 3 Oracle RAC 10g 10 1 0 5 0 10 2 0 2 0 HACMP 5 2 2 Oracle RAC 10g 10 1 0 5 0 ASM 2 Oracle RAC 10g 10 2 0 2 0 without ASM 2 分行 IT 基础设施资源整合 技术组件项目文档 9 Oracle RAC 10g 10 2 0 2 0 ASM 2 VERITAS Cluster Server 4 0 2 1 VERITAS Cluster Server 4 0 3 1 GPFS 2 3 IY63969 GPFS 2 3 RVSD PTF U801290 GPFS3 1 GPFS3 1 RVSD AIX 5 3 Virtual I O Server HACMP 5 2 Client APAR IY68371 IY68387 Client rsct rsct basic hacmp 2 4 2 1 rsct basic rte 2 4 2 2 HACMP 5 3 Client APAR IY78404 HACMP 5 4 Client APAR IY84920 1Does not support VxVM 2When using Technology Level 05 apply IY92037 OSOS RelatedRelated ProgramsPrograms AIX 5 2 Oracle RAC 10g 10 1 0 4 0 ASM 2 Oracle RAC 10g 10 1 0 5 0 ASM 2 Oracle RAC 10g 10 1 0 5 0 HACMP 5 2 Oracle RAC 10g 10 2 0 2 0 HACMP 5 2 Oracle RAC 10g 10 2 0 2 0 ASM 2 VERITAS Cluster Server 4 0 3 1 HACMP 5 4 IY84921 GPFS 3 1 Maintenance Level 04 or later AIX 5 3 Oracle RAC 10g 10 1 0 4 0 ASM 2 without ASM 2 Oracle RAC 10g 10 1 0 5 0 ASM 2 Oracle RAC 10g 10 1 0 5 0 HACMP 5 2 Oracle RAC 10g 10 2 0 1 0 HACMP 5 2 Oracle RAC 10g 10 2 0 2 0 HACMP 5 2 Oracle RAC 10g 10 2 0 2 0 ASM 2 VERITAS Cluster Server 4 0 3 1 HACMP 5 4 IY84920 GPFS 3 1 Maintenance Level 01 or later AIX 5 3 Virtual I O Server HACMP 5 3 Client Maintenance Level 03 or later Client APAR IY78404 HACMP 5 4 Client Maintenance Level 03 or later Client APAR IY84920 1 Does not support VxVM 2 The ODM configuration package for Thunder Lightning series devices 5 0 52 1 or later is required 分行 IT 基础设施资源整合 技术组件项目文档 10 2 2HDS 存储需求 Hitachi TagmaStore USP Hitachi TagmaStore NSC 55 Hitachi Lightning 9900V Series 9980V 9970V Hitachi TagmaStore AMS Hitachi TagmaStore WMS Hitachi Thunder 9500V Series 9570V 9580V 9585V 分行 IT 基础设施资源整合 技术组件项目文档 11 第 3 章 介质准备 HDLM光盘根目录下DLManager bffDLManager mpio bff文件为HDLM软件的安装文件 安装后 会在系 统中查看到DLManager bffDLManager mpio rte文件集 HDLM 光盘根目录 aix odm 目录下相应的 ODM 安装文件 分行 IT 基础设施资源整合 技术组件项目文档 12 第 4 章 HDS HDLM 安装配置步骤 4 1ODM 库安装 软件安装需要 root 用户 需要 ODM 包至版本 5 0 5 21 中文说明 InstallInstall 5 0 0 15 0 0 1 1 Copy fileset to an AIX directory usr sys inst images 中文说明 cdcd cdrom aix odm V5 0 0 1 cdrom aix odm V5 0 0 1 cpcp HDS FC ODM2 bffHDS FC ODM2 bff usr sys inst images usr sys inst images 2 Create a new toc file cdcd usr sys inst images usr sys inst images inutocinutoc 3 Use installp to install the AIX support fileset smittysmitty installinstall choose choose 5 0 0 15 0 0 1 AIXAIX SupportSupport forfor HitachiHitachi DiskDisk ArraysArrays a Select option Install and Update Software b Select option Install Software c When prompted for Input Device directory for software type usr sys inst images d Use the F4 key to list packages to install e Select a package by using the F7 key and press enter 5 0 0 1 AIX Support for Hitachi Disk Arrays 5 0 0 15 0 0 1 HACMPHACMP SupportSupport forfor HitachiHitachi Disk Disk 如果没有如果没有 HACMPHACMP 可以不安装此包 可以不安装此包 InstallInstall ODMODM 5 0 0 4U5 0 0 4U 1 Copy fileset to an AIX directory usr sys inst images cdcd cdrom aix odm V5 0 0 4u cdrom aix odm V5 0 0 4u cpcp HDS FC ODMUPD 5004UHDS FC ODMUPD 5004U usr sys inst images usr sys inst images 2 Create a new toc file cd cd usr sys inst images usr sys inst images inutoc inutoc 3 Use installp to install the AIX support fileset smitty smitty installinstall choose choose 5 0 0 45 0 0 4 AIXAIX SupportSupport forfor HitachiHitachi DiskDisk ArraysArrays a Select option Install and Update Software b Select option Install and Update from LATEST Available Software 分行 IT 基础设施资源整合 技术组件项目文档 13 c When prompted for Input Device enter the directory the fileset was copied to d Use the F4 key to list packages to install e Select a package by using the F7 key and press enter 5 0 0 4 AIX Support for Hitachi Disk Arrays Pressing the Enter key will start the install process InstallInstall ODMODM 5 0 1 4U5 0 1 4U UpdateUpdate 1 Copy fileset to an AIX directory usr sys inst images cpcp 10321 ODM 5014 Update10321 ODM 5014 Update usr sys inst images usr sys inst images 2 Create a new toc file cd cd usr sys inst images usr sys inst images inutoc inutoc 3 Use installp to install the AIX support fileset smitty smitty installinstall choose choose 5 0 1 45 0 1 4 AIXAIX SupportSupport forfor HitachiHitachi DiskDisk ArraysArrays a Select option Install and Update Software b Select option Install and Update from LATEST Available Software c When prompted for Input Device enter the directory the fileset was copied to d Use the F4 key to list packages to install e Select a package by using the F7 key and press enter 5 0 1 4 AIX Support for Hitachi Disk Arrays 4 Pressing the Enter key will start the install process InstallInstall ODMODM 5 0 52 1U5 0 52 1U UpdateUpdate 1 Copy fileset to an AIX directory usr sys inst images cpcp HTC FC ODM 50521UHTC FC ODM 50521U usr sys inst images usr sys inst images 2 Create a new toc file cd cd usr sys inst images usr sys inst images inutoc inutoc 3 Use installp to install the AIX support fileset smitty smitty installinstall choose choose 5 0 52 15 0 52 1 AIXAIX SupportSupport forfor HitachiHitachi DiskDisk ArraysArrays a Select option Install and Update Software b Select option Install and Update from LATEST Available Software c When prompted for Input Device enter the directory the fileset was copied to d Use the F4 key to list packages to install e Select a package by using the F7 key and press enter 5 0 52 1 AIX Support for Hitachi Disk Arrays Update 分行 IT 基础设施资源整合 技术组件项目文档 14 4 Pressing the Enter key will start the install process CheckCheck thethe DevicesDevices 1 If necessary remove HDS devices already defined as Other FC SCSI rmdev rmdev dldl hdisk n hdisk n toto removeremove oneone devicedevice oror rmdev rmdev dldl fscsi n fscsi n R R toto removeremove allall devicesdevices onon a a pathpath 2 Reboot AIX 3 Confirm parameters The parameters must have the following values lsattr lsattr E E l l hdisk n hdisk n pvid queue depthqueue depth 2 2 q type simple q err yes clr q no rw timeoutrw timeout 6060 start timeout 60 reassign timeout 120 4 2HDLM 安装步骤 安装操作系统及必须的 AIX Patches 磁盘阵列安装 确认操作系统能识别磁盘阵列分配的 LUN 安装 HA 软件 安装必须的 ODM 包 安装 HDLM 软件 包括补丁 SP02 如果有如果有 HACMPHACMP 注册 注册 HDLMHDLM 脚本脚本 4 3HDLM 软件安装 Log on as a user with root permission In the drive insert the medium on which you want to install HDLM Create a license key file If the license key is 123456789ABCDEF mkdir var DLM echo 123456789ABCDEF var DLM dlm lic key Or prepare the license key file Store the license key file using the name hdlm license directly under var tmp var tmp hdlm license Execute the install command installp aXgd dev cd0 all Verify that the package was installed 分行 IT 基础设施资源整合 技术组件项目文档 15 lslpp L DLManager rte Make sure that the fileset item in the output listing contains DLManager rte and that the status shows C commit Add a path PATH PATH usr DynamicLinkManager bin Set up the configuration file Define the physical volumes boot disk you want to exclude from the HDLM management target in the usr DynamicLinkManager drv dlmfdrv unconf file Execute the following command to start the HDLM configuration manager usr DynamicLinkManager bin dlmcfgmgr Execute the following command to make sure that the HDLM drivers dlmfdrvn and HDLM alert driver dlmadrv are loaded into the running kernel and are available lsdev C grep dlm dlmadrv AvailableHDLM Alert Driver dlmfdrv AvailableHDLM Driver dlmfdrv0 AvailableHDLM Driver lspv grep dlm Log on as a user with root permission In the drive insert the medium on which you want to install HDLM mountmount r r v v cdrfscdrfs dev cd0 dev cd0 cdrom cdrom Execute the following command to check that the devices to be managed by HDLM have been recognized by the system lsdevlsdev Cc Cc diskdisk hdisk0 Available 1S 08 00 8 0 16 Bit LVD SCSI Disk Drive hdisk1 Available 1S 08 00 9 0 16 Bit LVD SCSI Disk Drive hdisk2 Available 1S 08 00 10 0 16 Bit LVD SCSI Disk Drive hdisk3hdisk3 AvailableAvailable 1H 08 021H 08 02 HitachiHitachi DiskDisk ArrayArray Fibre Fibre hdisk4hdisk4 AvailableAvailable 1H 08 021H 08 02 HitachiHitachi DiskDisk ArrayArray Fibre Fibre Remove the HDLM management target device cdrom hdlmtool dlmrmdev cdrom hdlmtool dlmrmdev f f Execute the following command to make sure that the hdisk recognized as the device to be managed by HDLM has been deleted lsdevlsdev Cc Cc diskdisk Create a license key file If the license key is 123456789ABCDEF mkdirmkdir var DLM var DLM echoecho 123456789ABCDEF 123456789ABCDEF var DLM dlm lic key var DLM dlm lic key Or prepare the license key file Store the license key file using the name hdlm license directly under var tmp var tmp hdlm license Execute the install command 分行 IT 基础设施资源整合 技术组件项目文档 16 installpinstallp aXgd aXgd dev cd0 dev cd0 allall Verify that the package was installed lslpplslpp la la DLManager mpio rteDLManager mpio rte MakeMake suresure thatthat thethe filesetfileset itemitem inin thethe outputoutput listinglisting containscontains DLManager mpio rte DLManager mpio rte andand allall thethe displayeddisplayed statusesstatuses areare COMMITTED COMMITTED As required execute the dlmodmset utility for setting the HDLM execution environment ODM Execute the following command to configure the hdisk cfgmgrcfgmgr Finish defining the parent device fscsin rmdevrmdev l l fscsinfscsin R R Change the fc err recov setting of the parent device fscsin to fast fail chdevchdev l l fscsinfscsin a a fc err recov fast failfc err recov fast fail Verify that the fc err recov setting has been changed to fast fail lsattrlsattr El El fscsinfscsin fc err recovfc err recovfast failfast failFCFC FabricFabric EventEvent ErrorError RECOVERYRECOVERY PolicyPolicyTRUETRUE Repeat these steps for each host bus adapter HBA being used Enable the defined parent device fscsin cfgmgrcfgmgr Execute the chdev command as required to change the attributes of the hdisk chdevchdev l l hdisknhdiskn a a queue depth 8queue depth 8 a a rw timeout 60rw timeout 60 Add a path PATH PATH usr DynamicLinkManager bin PATH PATH usr DynamicLinkManager bin Make sure that hdisks are available lsdevlsdev Cc Cc diskdisk hdisk0 Available 1S 08 00 8 0 16 Bit LVD SCSI Disk Drive hdisk1 Available 1S 08 00 9 0 16 Bit LVD SCSI Disk Drive hdisk2 Available 1S 08 00 10 0 16 Bit LVD SCSI Disk Drive hdisk3 Available 1H 08 02 Hitachi Disk Array Fibre hdisk4 Available 1H 08 02 Hitachi Disk Array Fibre Execute the dlnkmgr command s view operation to check the status of each program usr DynamicLinkManager bin dlnkmgr usr DynamicLinkManager bin dlnkmgr viewview sys sys HDLM Version xx xx 分行 IT 基础设施资源整合 技术组件项目文档 17 Service Pack Version Load Balance on rr Support Cluster Elog Level 3 Elog File Size KB 9900 Number Of Elog Files 2 Trace Level 0 Trace File Size KB 1000 Number Of Trace Files 4 Path Health Checking on 30 Auto Failback off Intermittent Error Monitor off HDLM Manager Ver WakeupTime Alive xx xx yyyy mm dd hh mm ss HDLM Alert Driver Ver WakeupTime ElogMem Size Alive xx xx yyyy mm dd hh mm ss 4000 HDLM Driver Ver WakeupTime Alive xx xx yyyy mm dd hh mm ss License Type Expiration Permanent KAPL01001 I The HDLM command completed normally Operation name view completion time yyyy mm dd hh mm ss Check for the HDLM device for the SCSI device usr DynamicLinkMan