IBM Power AIX 6.1+Ha 7.1配置方法.docx

目录1.说明21.1.文档说明21.2.注意事项22.安装环境32.1.硬件,带HMC32.2.软件33.规划33.1.拓扑结构规划33.2.应用服务器规划33.3.资源组规划44.安装步骤44.1.配置2台小机的IP地址。44.2.安装Power Ha双机软件，并且升级双机软件。44.3.编辑/etc/hosts与/etc/cluster/rhosts文件。44.4.在主机的终端上输入：smitty hacmp54.4.1.初始化一个群集54.4.2.配置存储库磁盘94.4.3.群集和存储库磁盘创建完成后，可以先同步下双机。104.4.4.在存储上分别映射2块数据盘过来，然后在HA主备机里面执行cfgmgr v命令。114.4.5.建立Persistent Node IP Addresses114.4.6.创建资源组134.4.7.配置服务IP144.4.8.配置应用程序启停脚本144.4.9.使双机可以发现存储映射过去的磁盘144.4.10.存储映射过去的盘添加到双机资源组中154.4.11.同步双机配置175.双机的基本操作215.1.双机的启动215.2.双机的停止215.3.双机状态的查看225.4.保存snapshot226.双机的切换测试226.1.手工停服务器测试226.2.切换资源组236.2.1.Smitty cspoc236.2.2.切换应用236.3.模拟网卡故障测试236.4.模拟服务器异常宕机测试247.双机的其他操作247.1.lscluster d命令247.2.lscluster m命令247.3.usr/es/sbin/cluster/utilities/clmgr query cluster命令257.4.usr/es/sbin/cluster/utilities/cltopinfo命令267.5.usr/es/sbin/cluster/utilities/clmgr view report topology命令277.6.更换心跳磁盘【心跳盘、repository disk】的命令281. 说明1.1. 文档说明本文的环境是在AIX6.1操作系统下安装配置hacmp的步骤，其它版本的系统安装配置基本类似，不同之处，请参考IBM的官方文档。1.2. 注意事项配置hacmp的一些注意事项：1.2.1. 安装的版本要符合数据中心的版本策略要求1.2.2. 安装前要做好规划，了解应用要实现什么样的高可靠性需求1.2.3. HA可以实现排除单点故障，但不是冗余，因此关键部件还要有冗余配置，如电源模块、双HBA卡、rootvg镜像等1.2.4. 配置为HA的主、备节点不能是同一台物理服务器上的两个逻辑分区1.2.5. 存储厂商在HA环境下有定制的磁盘解锁脚本，EMC、HDS存储，在HA 的add custom disk methods中增加厂商自定义脚本。1.2.6. 编写的应用启停脚本要事先手工执行测试，并且确保停止脚本在系统异常时可以停止应用，以释放资源。1.2.7. HA配置完成后，不要将HA的服务设置为自启动模式，即HA服务的启动，要手工启动1.2.8. HA配置完成后，要模拟各种故障场景，充分测试接管功能是否正常。2. 安装环境2.1. 硬件,带HMCServer1: IBM Power 730(8231 E2C)Server2: IBM Power 730(8231 E2C)2.2. 软件2.2.1. OS环境：6100-08-02-13162.2.2. HA环境：3. 规划3.1. 拓扑结构规划net_ether_01规划群集名称节点名称网络名称Boot LabelPersistent LabelService Labelhisserver_clusterhisserver1net_ether_01hisserver1_boot2hisserver1_perhisserver1_serviceHisserver2hisserver2_boot2hisserver2_perhisserver2_service3.2. 应用服务器规划应用服务器名称应用服务器启动脚本路径应用服务器停止脚本路径app1/usr/es/script/start.sh/usr/es/script/stop.sh3.3. 资源组规划资源组名称参入节点应用服务器Service IP Label卷组rg1hisserver1app1hisserver1_servicedatavghisserver2backupvg4. 安装步骤4.1. 配置2台小机的IP地址。名称En0En2Hisserver/24/24Hisserver/24/244.2. 安装Power Ha双机软件，并且升级双机软件。4.3. 编辑/etc/hosts与/etc/cluster/rhosts文件。/etc/hosts loopback localhost hisserver hisserver hisserver1_boot hisserver2_boot2 hisserver1_per hisserver2_per hisserver1_service hisserver2_service/etc/cluster/rhostshisserver1hisserver2hisserver1_boot2hisserver2_boot2hisserver1_perhisserver2_per4.4. 在主机的终端上输入：smitty hacmp4.4.1. 初始化一个群集.Move cursor to desired item and press Enter.Cluster Nodes and NetworksCluster Applications and ResourcesSystem Management (C-SPOC)Problem Determination ToolsCustom Cluster ConfigurationCant find what you are looking for ?Not sure where to start ?.Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration.Move cursor to desired item and press Enter. Setup a Cluster, Nodes and Networks Define Repository Disk and Cluster IP Address What are the repository disk and cluster IP address ? .Type or select values in entry fields.Press Enter AFTER making all desired changes. Entry Fields Cluster Name hisserver_cluster Currently Configured Node(s) hisserver1 hisserver2当初始化完成群集之后，群集的网络、网络接口都已经自动配置好了。-info- start -Warning: to complete this configuration, a repository disk must be defined.Cluster Name: hisserver_clusterCluster Connection Authentication Mode: StandardCluster Message Authentication Mode: NoneCluster Message Encryption: NoneUse Persistent Labels for Communication: NoRepository Disk: NoneCluster IP Address: There are 2 node(s) and 1 network(s) definedNODE hisserver1:Network net_ether_01hisserverhisserver1_bootNODE hisserver2:Network net_ether_01hisserver2_boothisserverNo resource groups definedInitializing.Gathering cluster information, which may take a few minutes.Processing.Storing the following information in file/usr/es/sbin/cluster/etc/config/clvg_confighisserver1:Hdisk:hdisk0PVID:00f874e355ef7a89VGname:rootvgVGmajor:10Conc-capable:NoVGactive:YesQuorum-required:Nohisserver2:Hdisk:hdisk0PVID:00f874e45588e2d4VGname:rootvgVGmajor:10Conc-capable:NoVGactive:YesQuorum-required:Nohisserver1:Hdisk:hdisk1PVID:00f874e3338b7141VGname:rootvgVGmajor:10Conc-capable:NoVGactive:YesQuorum-required:Nohisserver2:Hdisk:hdisk1PVID:00f874e43378f191VGname:rootvgVGmajor:10Conc-capable:NoVGactive:YesQuorum-required:Nohisserver1:Hdisk:hdisk2PVID:00f874e33239aab1VGname:NoneVGmajor:0Conc-capable:NoVGactive:NoQuorum-required:Nohisserver2:Hdisk:hdisk2PVID:00f874e33239aab1VGname:NoneVGmajor:0Conc-capable:NoVGactive:NoQuorum-required:NoFREEMAJORS:51.FREEMAJORS:51.Warning: There is no cluster found.cllsclstr: No cluster defined.cllsclstr: Error reading configuration.Communication path hisserver1 discovered a new node. Hostname is hisserver1. Adding it to the configuration with Nodename hisserver1.Communication path hisserver2 discovered a new node. Hostname is hisserver2. Adding it to the configuration with Nodename hisserver2.Discovering IP Network ConnectivityRetrieving data from available cluster nodes. This could take a few minutes.Start data collection on node hisserver1Start data collection on node hisserver2Collector on node hisserver1 completedCollector on node hisserver2 completedData collection completeCompleted 10 percent of the verification checksCompleted 20 percent of the verification checksCompleted 30 percent of the verification checksCompleted 40 percent of the verification checksCompleted 50 percent of the verification checksCompleted 60 percent of the verification checksCompleted 70 percent of the verification checksDiscovered 6 interfacesCompleted 80 percent of the verification checksCompleted 90 percent of the verification checksCompleted 100 percent of the verification checksIP Network Discovery completed normallyCurrent cluster configuration:Discovering Volume Group Configuration- end -4.4.2. 配置存储库磁盘.Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not sure where to start ?.Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration.Move cursor to desired item and press Enter. Setup a Cluster, Nodes and Networks Define Repository Disk and Cluster IP Address What are the repository disk and cluster IP address ?.Type or select values in entry fields.Press Enter AFTER making all desired changes. Entry FieldsClusterName hisserver_clusterRepository Disk hdisk2 Cluster IP Address 4.4.3. 群集和存储库磁盘创建完成后，可以先同步下双机。.Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not sure where to start ?.Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration同步完成后磁盘情况如下：# lspvhdisk0 00f874e355ef7a89 rootvg activehdisk1 00f874e3338b7141 rootvg activehdisk2 00f874e33239aab1 caavg_private active4.4.4. 在存储上分别映射2块数据盘过来，然后在HA主备机里面执行cfgmgr v命令。# lspvhdisk0 00f874e355ef7a89 rootvg activehdisk1 00f874e3338b7141 rootvg activehdisk2 00f874e33239aab1 caavg_private activehdisk3hdisk4主机上分别执行如下命令：Chdev l hdisk3 a pv=yesChdev l hdisk4 a pv=yes/usr/sbin/mkvg -y datavg -s 128 -f -n -V53 -C hdisk3/usr/sbin/mkvg -y backupvg -s 128 -f -n -V54 -C hdisk4varyonvg datavgvaryonvg backupvg然后通过smitty jfs2建立文件系统。备机上执行如下命令：/usr/sbin/importvg -y datavg hdisk3/usr/sbin/importvg -y backupvg hdisk44.4.5. 建立Persistent Node IP Addresses.Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not sure where to start ?.Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration.Move cursor to desired item and press Enter. Show Topology Information by Node Add a Node Change/Show a Node Remove a Node Configure Persistent Node IP Label/Addresses Verify and Synchronize Cluster Configuration.Move cursor to desired item and press Enter. Add a Persistent Node IP Label/Address Change / Show a Persistent Node IP Label/Address Remove a Persistent Node IP Label/Address配置完Persistent IP之后就可以利用Persistent IP登陆了。4.4.6. 创建资源组.Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not sure where to start ?.Move cursor to desired item and press Enter. Make Applications Highly Available (Use Smart Assists) Resources Resource Groups Verify and Synchronize Cluster Configuration.Move cursor to desired item and press Enter. Add a Resource Group Change/Show Nodes and Policies for a Resource Group Change/Show Resources and Attributes for a Resource Group Remove a Resource Group Configure Resource Group Run-Time Policies Show All Resources by Node or Resource Group Verify and Synchronize Cluster Configuration Learn more about Resource Groups.Type or select values in entry fields.Press Enter AFTER making all desired changes. Entry Fields* Resource Group Name rg1* Participating Nodes (Default Node Priority) hisserver1 hisserver2 + Startup Policy Online On First Available Node + Fallover Policy Fallover To Next Priority Node In The List + Fallback Policy Never Fallback 4.4.7. 配置服务IP 执行如下命令：/usr/es/sbin/cluster/utilities/clmgr add service_ip hisserver1_service NETMASK= NETWORK=net_ether_014.4.8. 配置应用程序启停脚本执行如下 命令：/usr/es/sbin/cluster/utilities/claddserv -sapp1 -b/usr/es/script/start.sh -e/usr/es/script/stop.sh4.4.9. 使双机可以发现存储映射过去的磁盘. Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not sure where to start ?.Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration4.4.10. 存储映射过去的盘添加到双机资源组中. 通过smitty hacmp实现Cluster Nodes and NetworksCluster Applications and ResourcesSystem Management (C-SPOC)Problem Determination Tools Custom Cluster ConfigurationMake Applications Highly Available (Use Smart Assists)Resources Resource Groups Resource Group Name rg1 Participating Nodes (Default Node Priority) hisserver1 hisserver2 Startup Policy Online On First Available Node Fallover Policy Fallover To Next Priority Node In The List Fallback Policy Never Fallback Service IP Labels/Addresses hisserver1_service + Application Controllers app1 + Volume Groups datavg backupvg + Use forced varyon of volume groups, if necessary false + Automatically Import Volume Groups false + Filesystems (empty is ALL for VGs specified) + Filesystems Consistency Check fsck + Filesystems Recovery Method sequential + Filesystems mounted before IP configured false + Filesystems/Directories to Export (NFSv2/3) + Filesystems/Directories to Export (NFSv4) + Stable Storage Path (NFSv4) + Filesystems/Directories to NFS Mount Network For NFS Mount + Tape Resources + Raw Disk PVIDs + Primary Workload Manager Class + Secondary Workload Manager Class + Miscellaneous Data WPAR Name + User Defined Resources +. 通过执行命令实现执行如下命令：/usr/es/sbin/cluster/utilities/claddres -g rg1 SERVICE_LABEL=hisserver1_service APPLICATIONS=app1 VOLUME_GROUP=datavg backupvg FORCED_VARYON=false VG_AUTO_IMPORT=false FILESYSTEM= FSCHECK_TOOL=fsck RECOVERY_METHOD=sequential FS_BEFORE_IPADDR=false EXPORT_FILESYSTEM= EXPORT_FILESYSTEM_V4= STABLE_STORAGE_PATH= MOUNT_FILESYSTEM= NFS_NETWORK= SHARED_TAPE_RESOURCES= DISK= MISC_DATA= WPAR_NAME= USERDEFINED_RESOURCES=4.4.11. 同步双机配置. Smitty hacmpMove cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not sure where to start ?. 同步双机配置Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration-info- start -Verification to be performed on the following:Cluster TopologyCluster ResourcesVerification will interactively correct verification errors.Retrieving data from available cluster nodes. This could take a few minutes.Start data collection on node hisserver1Start data collection on