HA常用心跳网络特点和配置

1、POWERHA常用心跳网络特点和配置最近系统的复习了一下PowerHA，做了一些相关的试验，今天时间充裕，在博 客里把有关于心跳方面的知识总结一下。谈到PowerHA,不得不谈心跳。记得拜 读IBM官方网站上浅谈HACMP心跳一文中，作者王荣说了一句颇幽默 的话：“我们可以看出使用HACMP集群，可谓玩的就是心跳。”的确如此， 在个人的学习和实施的过程中，发现心跳的确是要玩的，而且要玩好。一、心跳作用及分类PowerHA通过以下三种手段，来监控节点是否运行正常：1、RSCT监控网络接口和设备。.2、AIXLVM 监控硬盘、逻辑卷、卷组状态。3、PowerHA应用监控应用状态。PowerHA使用

2、心跳keepalive(KA)包来监控网络接口、通信设备、和ip地址 标签有效性。在PowerHA中用基于IP网络和non-IP网络来交换心跳包。其中 基于 IP 网络包括：Ethernet(ether)、Token-ring(token)、FiberDistributed Data Interface - FDDI (fddi)、Asynchronous Transfer Mode- ATM and ATMLANEmulation)(atm)、EtherChannel(ether)、IPVersion6(IPV6)、 InfiniBand，其中enther网络心跳比较常用。基于设备的主要包括

3、：目标模式 SCSI (tmscsi)、目标模式 SSA (tmssa)、磁盘心跳信号(diskhb)、串行 RS232。磁盘心跳信号(diskhb)和串行RS232在实际环境中用到比较多(个 人根据实施经验判断，不一定准确)。二、常用心跳网络配置1、RS232串口心跳配置硬件配置建议配置专门用作心跳网络的异步卡。异步卡及串口线的选择配置可以 参考：PowerHA中异步卡和串口线的选择。配置方法：添加tty设备：smittydevice中找到tty.测试tty通信是否正常：在连接串口线后，在一台设备上输入：cat /etc/hosts/dev/ttyO 另外一台输入：catv/dev/ttyO

4、。在PowerHA中添加：a、添加网络 smitty hacmp - Extended Configuration ExtendedTopology Configuration Extended Topology Configuration Extended Topology Configuration # Pre-defined Serial DeviceTypes 中 rs232b、 添加设备 smittyhacmp -ExtendedConfigurationExtendedTopology Configuration Extended Topology Configuration Co

5、nfigure HACMP Communication Interfaces/Devices Add CommunicationInterfaces/DevicesAddPre-definedCommunication Interfacesand Devices Communication Devices 选择添加的网 络选择相应的端口2、磁盘心跳配置方法磁盘心跳简单说就是用共享磁盘来跑心跳。磁盘心跳从HACMP5.1中开始支 持。优点：不占用插槽，磁盘总线上的心跳网络能够在TCP/IP网络资源有限的情 况下提供额外的HACMP节点间的通信手段，并且能够防止HACMP节点之 间由于TCP/IP

6、软件出现问题而无法相互通信。缺点：需要操作系统和存储支持，如使用增强型卷组，此外对于I/O读写负荷 高的应用，也需要慎用。使用磁盘心跳需要安装操作系统bos.clvm.enh包以支持增强性并发卷组。配置方法：摘自：文中描述的是HACMP5.4中操作，经验证和PowerHA配置方法完全一样。Step1:配置并行卷组dbsvr1#smittyhacmpInitializationandStandardConfigurationExtendedConfigurationSystemManagement(C-SPOC)ProblemDeterminationToolsManageHACMPServic

7、esHACMPCommunicationlnterfaceManagementHACMPResourceGroupandApplicationManagementHACMPLogViewingandManagementHACMPFileCollectionManagementHACMPSecurityandUsersManagementHACMPLogicalVolumeManagementHACMPConcurrentLogicalVolumeManagementHACMPPhysicalVolumeManagementConfigureGPFSConcurrentVolumeGroupsC

8、oncurrentLogicalVolumesSynchronizeConcurrentLVMMirrorsListAllConcurrentVolumeGroupsCreateaConcurrentVolumeGroupCreateaConcurrentVolumeGroupwithDataPathDevicesSetCharacteristicsofaConcurrentVolumeGroupImportaConcurrentVolumeGroupMirroraConcurrentVolumeGroupNodeNamesMovecursortodesireditemandpressEsc+

9、7.ONEORMOREitemscanbeselected.PressEnterAFTERmakingallselections.dbsvr1dbsvr2CreateaConcurrentVolumeGroupTypeorselectvaluesinentryfields.PressEnterAFTERmakingalldesiredchanges.TOPNodeNamesTOPNodeNamesPVIDVOLUMEGROUPnamePhysicalpartitionSIZEin megabytes4VolumegroupMAJORNUMBEREnhancedConcurrentMode En

10、ableCross-SiteLVMMirroring VerificationfalseEntryFieldsdbsvr1,dbsvr20003714b1331a3edheartvg+56+#true+Warning:Changingthevolumegroupmajornumbermayresult inthecommandbeingunabletoexecute successfullyonanodethatdoesnothavethe majornumbercurrentlyavailable.PleasecheckMORE.3F1二HelpF2二RefreshF3二CancelF4二L

11、istEsc+5二ResetEsc+6二CommandEsc+7二EditEsc+8=Imagedbsvr1#lspvhdisk00003714ba5048a99rootvgactivehdisk10003714bd3cf768arootvgactivehdisk20003714b7d935335datavgactivehdisk30003714b27d6164fdatavg_1activehdisk4noneNonehdisk50003714b1331a3edheartvgdbsvr2#lspvhdisk1000531c9c977a892rootvgactivehdisk20003714b7

12、d935335datavghdisk3noneNonehdisk4noneNonehdiskO000531c9a501da2arootvgactivehdisk50003714b1331a3edheartvgStep2:编辑环境变量dbsvr1#vi/etc/environmentPATH二/usr/bin:/etc:/usr/sbin:/usr/ucb:/usr/bin/X11:/sbin:/us 叨ava14/jre /bin:/usr/java14/bin:/usr/sbin/rsct/binTZ二BEIST-8LANG二en 丄SLOCPATH二/usr/lib/nls/locNLSP

13、ATH二/usr/lib/nls/msg/%L/%N:/usr/lib/nls/msg/%L/%N.catLJFASTMSG二truedbsvr2#vi/etc/environmentPATH=/usr/bin:/etc:/usr/sbin:/usr/ucb:/usr/bin/X11:/sbin:/us r/java14/jre/bin:/usr/java14/bin:/usr/sbin/rsct/binTZ二BEIST-8LANG=en 丄SLOCPATH二/usr/lib/nls/locNLSPATH=/usr/lib/nls/msg/%L/%N:/usr/lib/nls/msg/%L/%

14、N.catLJFASTMSG二trueStep3:测试并行卷组通讯dbsvr1#/usr/sbin/rsct/bin/dhb_read-phdiskx-rDHBCLASSICMODEFirstnodebyteoffset:61440Secondnodebyteoffset:62976Handshakingbyteoffset:65024Testbyteoffset:64512ReceiveMode:Waitingforresponse.Magicnumber=0 x87654321Magicnumber=0 x87654321Magicnumber=0 x87654321Magicnumber

15、=0 x87654321Linkoperatingnormally-t（这两个命令需要同时执dbsvr2#-t（这两个命令需要同时执DHBCLASSICMODEFirstnodebyteoffset:61440Secondnodebyteoffset:62976Handshakingbyteoffset:65024Testbyteoffset:64512TransmitMode:Magicnumber=0 x87654321Detectedremoteutilityinreceivemode.Waitingforresponse.Magicnumber=0 x87654321Magicnumb

16、er=0 x87654321LinkoperatingnormallyStep4:配置磁盘心跳网络dbsvr1#smittyhacmpInitializationandStandardConfigurationExtendedConfigurationSystemManagement(C-SPOC)ProblemDeterminationToolsDiscoverHACMP-relatedlnformationfromConfiguredNodesExtendedTopologyConfigurationExtendedResourceConfigurationExtendedClusterS

17、erviceSettingsExtendedEventConfigurationExtendedPerformanceTuningParametersConfigurationSecurityandUsersConfigurationSnapshotconfigurationExportDefinitionFileforOnlinePlanningWorksheetsConfigureanHACMPCIusterConfigureHACMPNodesConfigureHACMPSitesConfigureHACMPNetworksConfigureHACMPCommunicationlnter

18、faces/Devices ConfigureHACMPPersistentNodelPLabel/Addresses ConfigureHACMPGlobalNetworksConfigureHACMPNetworkModulesConfigureTopologyServicesandGroupServicesShowHACMPTopologyAddaNetworktotheHACMPClusterChange/ShowaNetworkintheHACMPClusterRemoveaNetworkfromtheHACMPClusterSelectaNetworkTypeMovecursort

19、odesireditemandpressEnter.TOP#Discoverylastperformed:(Apr0315:13)#DiscoveredIP-basedNetworkTypes ether#DiscoveredSerialDeviceTypesrs232#Pre-definedIP-basedNetworkTypesXD_dataXD_ipatmetherfddihpsibtoken#Pre-definedSerialDeviceTypesXD_rs232diskhbdiskhbAddaSerialNetworktotheHACMPCIusterTypeorselectvalu

20、esinentryfields.PressEnterAFTERmakingalldesiredchanges.EntryFields*NetworkName*NetworkTypenet_diskhb_01*NetworkName*NetworkTypediskhbConfigureanHACMPClusterConfigureHACMPNodesConfigureHACMPSitesConfigureHACMPNetworksConfigureHACMPCommunicationlnterfaces/Devices ConfigureHACMPPersistentNodelPLabel/Ad

21、dresses ConfigureHACMPGlobalNetworks ConfigureHACMPNetworkModulesConfigureTopologyServicesandGroupServicesConfigureHACMPNetworksSelectacategoryMovecursortodesireditemandpressEnter.AddDiscoveredCommunicationlnterfaceandDevicesAddPre-definedCommunicationlnterfaceandDevicesCommunicationinterfacesCommun

22、icationdevicesSelectaDeviceNetworkMovecursortodesireditemandpressE_diskhb_01*DeviceNameheartdbsvr1(hostname )*NetworkTypediskhb*NetworkNamenet diskhb 01*DevicePath/dev/hdisk5（路径手动填写）*DevicePathdbsvr1dbsvr1*DeviceName*NetworkType *NetworkName *DevicePath *Nodename*DeviceName*NetworkType *NetworkName

23、*DevicePath *Nodenameheartdbsvr2diskhbnet_diskhb_/dev/hdisk501dbsvr2Step5:检查集群网络结构ShowClusterTopologyShowClusterDefinitionShowTopologylnformationbyNodeShowTopologyInformationbyNetworkShowTopologylnformationbyCommunicationlnterfaceClusterName:gyjtClusterConnectionAuthenticationMode:StandardClusterMes

24、sageAuthenticationMode:NoneClusterMessageEncryption:NoneUsePersistentLabelsforCommunication:NoNODEdbsvr1:heartdbsvr1 /dev/hdisk5dbsvr1_svc 158.1.1.126dbsvr1_boot 158.1.1.127dbsvr1_stb 192.168.1.1Networkdbsvr1_stbNetworkdbsvr1_stbheartdbsvr1 /dev/hdisk5 net_ether_01192.168.1.1Networknet_rs232_01dbsvr

25、1_tty0 /dev/ttyONODEdbsvr2:Step6:同步集群配置ExtendedConfigurationMovecursortodesireditemandpressEnter.DiscoverHACMP-relatedlnformationfromConfiguredNodesExtendedTopologyConfigurationExtendedResourceConfigurationExtendedClusterServiceSettingsExtendedEventConfigurationExtendedPerformanceTuningParametersCon

26、figurationSecurityandUsersConfigurationSnapshotConfigurationExportDefinitionFileforOnlinePlanningWorksheetsExtendedVerificationandSynchronizationHACMPClusterTestTool3、IP网络心跳IP网络心跳可以使用IP别名心跳即在boot网卡上添加别名IP，来跑心跳。也 可以用专门的网卡用作心跳通信。a、IP别名心跳配置注意：心跳地址没有子网限制，但是要注意和bootip在不同的子网中。配置方法：在 hacmp 酉己置完成后 smitty ha

27、cmp Extended Configuration Extended Topology Configuration Configure HACMP Networks changeaNetworktotheHACMPCIuster下的 IPAddressOffsetforHeartbeatingoverlPAIiase 填入需要用作心跳传输的别名IP地址。当你输入 任意IP地址后再同步完HA，只需要添加一个IP地址，启动HA后会自动在四 个boot，下面有例子。ip上生成四个private的ip地址，故心跳用。生成的规则如下：引用cookbook 原文： WhenPowerHAstarts,itbuiIds upanaIiasheartbeatnetworkstartingfromthisaddress,bycaIcuIating anIPaddressforeachnodebasedonthenodenumber.举例说明：当你输入 10.0.0.1,机器会在启动 HACMP 时，在 a 主机上 boot1 生成 10.0.0.1,boot2 上生成