HACMP5.2与Oracle9iRAC配置文档.doc

HACMP5.2与Oracle9iRAC配置文档.doc HACMP5.2与Oracle9iRAC配置文档 Copyright, 2005,Sinosoft Co. Ltd.Tel: (010)62570116-813 Fax: (010)62570026Visit us at /中科软科技股份有限公司2005年11月HACMP5.2与Oracle9iRAC配置文档目录1写在前面的话32需求分析33环境说明34设计规划44.1IP及拓扑设计44.2资源组命名64.3应用服务器建立64.4配置资源组64.5hosts文件设计65实施步骤75.1环境准备75.2IP地址几网络划分75.3HACMP配置85.3.1让HACMP主动认双机配置85.3.2修改HACMP的拓扑配置105.4同步HACMP配置并启动HACMP165.5创建concurrent vg，并创建资源组175.5.1创建VG175.5.2配置资源组信息185.6同步HACMP配置并启动HACMP216附录226.1相关文件226.1.1/etc/hosts226.1.2/.rhosts236.1.3/usr/es/sbin/cluster/etc/rhosts236.1.4/usr/sbin/cluster/netmon.cf236.1.5创建lv的pp数目列表236.2问题集锦246.2.1AIX 5.3不支持hacmp 4.5版本246.2.2创建数据库时没有权限访问裸设备256.2.3HACMP同步失败256.2.4启动hacmp自动发生IP切换266.2.5不能两个节点同时mount问题需要考虑的问题261 写在前面的话编写本文档要特别感谢北京现代集团的张维民及suwalau两位朋友，在他们的帮助下，才得以解决关键的问题。2 需求分析在本次HACMP实施中采用双机并行的运行模式，即：两台P550主机上安装Oracle 9i RAC产品，HACMP版本为5.23 环境说明主机名信息备注主机1testdb01System Model: IBM,9113-550Machine Serial Number: Processor Type: PowerPC_POWER5Number Of Processors: 2Processor Clock Speed: 1504 MHzCPU Type: 64-bitKernel Type: 64-bitLPAR Info: 1 10-FAFEFMemory Size: 7808 MBDisk:70G*2AIX 5300-03Hacmp：5.2主机2testdb02System Model: IBM,9113-550Machine Serial Number: Processor Type: PowerPC_POWER5Number Of Processors: 2Processor Clock Speed: 1504 MHzCPU Type: 64-bitKernel Type: 64-bitLPAR Info: 1 10-FB0FFMemory Size: 7808 MBDisk:70G*2AIX 5300-03Hacmp：5.2中科软科技股份有限公司 第 34 页 共 34 页4 设计规划4.1 IP及拓扑设计cluster nametestclusternode nametestdb01ip labeldb1_bootdb1_stdbydb1_svrtestdb_tty1db1_prvnetwork typeethernetethernetethernetrs232ethernetnetwork attributepublicpublicpublicserialprivateip aliasdisabledisabledisabledisablenetwork namenet_ether_02net_ether_02net_ether_02net_rs232_01net_ether_01ip address20/dev/tty0adapter functionbootstandbyserviceserialprivateadapter nameen2en3en1cluster nametestclusternode nametestdb02ip labeldb2_bootdb2_stdbydb2_svrtestdb_tty2db2_prvnetwork typeethernetethernetethernetrs232ethernetnetwork attributepublicpublicpublicserialprivateip aliasdisabledisabledisabledisablenetwork namenet_ether_02net_ether_02net_ether_02net_rs232_01net_ether_01ip address31/dev/tty0adapter functionbootstandbyserviceserialprivateadapter nameen2en3en14.2 资源组命名Res.Grp.NameNode Rel.Part.Node Nametestdb_resconcurrenttestdb01 testdb02testdb_res1cascadingtestdb01 testdb02testdb_res2cascadingtestdb02 testdb014.3 应用服务器建立App NameStart ScriptStop Scripttestapp/ha/start/ha/stop4.4 配置资源组Res. Grp.NameService IPVolume GroupApplication Serverstestdb_resoradatavgtestapptestdb_res1db1_svctestdb_res2db2_svc4.5 hosts文件设计loopback localhost# loopback (lo0) name/address2 db1_boottestdb00 db1_svr db1_stdbydb1_prv1 db2_svr3 db2_boottestdb02 db2_stdbydb2_prv01db1_console03db2_console15 实施步骤5.1 环境准备序号内容项内容备注1.安装HACMP软件注意不要安装带PSSP的文件集（会导致启动数据库时不认裸设备）2.打HACMP补丁IY58496 IY77379 IY73937 IY683703.重起主机4.检查补丁检查补丁是否已经打上5.修改/sbin/rc.boot#Modified By Sinosoft For Hacmp Software Start#nohup /usr/sbin/syncd 60 /dev/null 2&1 &nohup /usr/sbin/syncd 10 /dev/null 2&1 &#Modified By Sinosoft For Hacmp Software End6.修改water marksmit system -Change / Show Characteristics of Operating SystemHIGH water mark for pending write I/Os per file 32 LOW water mark for pending write I/Os per file 24 5.2 IP地址几网络划分步骤节点步骤备注1.testdb01在en2上建立boot网卡：testdb01/ 2/2.在en3上建立standby网卡：testdb01/ /3.在en1上建立private网卡：testdb01/ /4.testdb02在en2上建立boot网卡：testdb01/ 3/5.在en3上建立standby网卡：testdb01/ /6.在en1上建立private网卡：testdb01/ /7.testdb01修改/etc/hosts文件建立/.rhosts文件chmod 600 /.rhosts8.testdb02修改/etc/hosts文件建立/.rhosts文件chmod 600 /.rhosts9.测试网络是否畅通(rlogin,ping等命令)10.testdb01创建串口信息：tty/rs232/terminal asynchrone/sa3/2/9600/none/8/1/vt10011.testdb02创建串口信息：tty/rs232/terminal asynchrone/sa3/2/9600/none/8/1/vt10012.测试心跳线是否正常在testdb02上：cat /dev/tty0如果在testdb02上显示出相关内容，则配置正常5.3 HACMP配置5.3.1 让HACMP主动认双机配置 HACMP for AIXMove cursor to desired item and press Enter. Initialization and Standard Configuration Extended Configuration System Management (C-SPOC) Problem Determination Tools nitialization and Standard ConfigurationMove cursor to desired item and press Enter. Two-Node Cluster Configuration Assistant Add Nodes to an HACMP Cluster Configure Resources to Make Highly Available Configure HACMP Resource Groups Verify and Synchronize HACMP Configuration HACMP Cluster Test Tool Display HACMP Configuration Configure Nodes to an HACMP Cluster (standard)Type or select values in entry fields.Press Enter AFTER making all desired changes. Entry Fields* Cluster Name testcluster New Nodes (via selected communication paths) testdb01 Entry Fields* Cluster Name testcluster New Nodes (via selected communication paths) testdb02 Currently Configured Node(s) testdb01在这一过程中，HACMP会认出在/etc/hosts文件中配置的所有信息，并进行分类，配置如下：Node:testdb01NetWork: net_ether_01Adapter:db1_console1,db1_prvNetWork: net_ether_02Adapter:db1_boot,db1_stdby=Node:testdb02NetWork: net_ether_01Adapter:db2_console1,db2_prvNetWork: net_ether_02Adapter:db2_boot,db2_stdby5.3.2 修改HACMP的拓扑配置 删除db1_console1和db2_console1信息由于db1_console1和db2_console1是作为日常管理用的，不需要配置在HA环境中，并且，如何不删除该信息，在修改NetWork属性时会报警告信息。 HACMP for AIXMove cursor to desired item and press Enter. Initialization and Standard ConfigurationExtended Configuration System Management (C-SPOC) Problem Determination Tools Extended ConfigurationMove cursor to desired item and press Enter. Discover HACMP-related Information from Configured Nodes Extended Topology Configuration Extended Resource Configuration Extended Event Configuration Extended Performance Tuning Parameters Configuration Security and Users Configuration Snapshot Configuration Export Definition File for Online Planning Worksheets Extended Verification and Synchronization HACMP Cluster Test Tool Extended Topology ConfigurationMove cursor to desired item and press Enter. Configure an HACMP Cluster Configure HACMP Nodes Configure HACMP Sites Configure HACMP Networks Configure HACMP Communication Interfaces/Devices Configure HACMP Persistent Node IP Label/Addresses Configure HACMP Global Networks Configure HACMP Network Modules Configure Topology Services and Group Services Show HACMP TopologyConfigure HACMP Communication Interfaces/DevicesMove cursor to desired item and press Enter. Add Communication Interfaces/Devices Change/Show Communication Interfaces/Devices Remove Communication Interfaces/Devices Update HACMP Communication Interface with Operating System Settings在列出的设备中，删除db1_console1和db2_console 修改NetWork属性 Extended Topology ConfigurationMove cursor to desired item and press Enter. Configure an HACMP Cluster Configure HACMP Nodes Configure HACMP Sites Configure HACMP Networks Configure HACMP Communication Interfaces/Devices Configure HACMP Persistent Node IP Label/Addresses Configure HACMP Global Networks Configure HACMP Network Modules Configure Topology Services and Group Services Show HACMP TopologyMove cursor to desired item and press Enter. Add a Network to the HACMP Cluster Change/Show a Network in the HACMP Cluster Remove a Network from the HACMP Cluster Select a Network to Change/Show Move cursor to desired item and press Enter. net_ether_01 (/24) net_ether_02 (/24 /24) Change/Show an IP-Based Network in the HACMP ClusterType or select values in entry fields.Press Enter AFTER making all desired changes. Entry Fields* Network Name net_ether_01 New Network Name * Network Type ether * Netmask * Enable IP Address Takeover via IP Aliases No IP Address Offset for Heartbeating over IP Aliases * Network attribute private Change/Show an IP-Based Network in the HACMP ClusterType or select values in entry fields.Press Enter AFTER making all desired changes. Entry Fields* Network Name net_ether_02 New Network Name * Network Type ether * Netmask * Enable IP Address Takeover via IP Aliases No IP Address Offset for Heartbeating over IP Aliases * Network attribute public(不变) 增加串口NetWork Extended Topology ConfigurationMove cursor to desired item and press Enter. Configure an HACMP Cluster Configure HACMP Nodes Configure HACMP Sites Configure HACMP Networks Configure HACMP Communication Interfaces/Devices Configure HACMP Persistent Node IP Label/Addresses Configure HACMP Global Networks Configure HACMP Network Modules Configure Topology Services and Group Services Show HACMP Topology# Pre-defined Serial Device TypesXD_rs232diskhbrs232 Add a Serial Network to the HACMP ClusterType or select values in entry fields.Press Enter AFTER making all desired changes. Entry Fields* Network Name net_rs232_01* Network Type rs232 COMMAND STATUSCommand: OK stdout: yes stderr: noBefore command completion, additional instructions may appear below.Network net_ether_01 is privateNetwork net_ether_01 is private 增加串口的设备 Extended Topology ConfigurationMove cursor to desired item and press Enter. Configure an HACMP Cluster Configure HACMP Nodes Configure HACMP Sites Configure HACMP Networks Configure HACMP Communication Interfaces/Devices Configure HACMP Persistent Node IP Label/Addresses Configure HACMP Global Networks Configure HACMP Network Modules Configure Topology Services and Group Services Show HACMP Topology Configure HACMP Communication Interfaces/DevicesMove cursor to desired item and press Enter. Add Communication Interfaces/Devices Change/Show Communication Interfaces/Devices Remove Communication Interfaces/Devices Update HACMP Communication Interface with Operating System SettingsAdd Discovered Communication Interface and DevicesAdd Pre-defined Communication Interfaces and DevicesCommunication InterfacesCommunication Devices Select a Device NetworkMove cursor to desired item and press E_rs232_01 Add a Communication DeviceType or select values in entry fields.Press Enter AFTER making all desired changes. Entry Fields* Device Name test_tty1* Network Type rs232* Network Name net_rs232_01* Device Path /dev/tty0* Node Name testdb01Add a Communication DeviceType or select values in entry fields.Press Enter AFTER making all desired changes. Entry Fields* Device Name test_tty2* Network Type rs232* Network Name net_rs232_01* Device Path /dev/tty0* Node Name testdb0 增加service label Extended ConfigurationMove cursor to desired item and press Enter. Discover HACMP-related Information from Configured Nodes Extended Topology Configuration Extended Resource Configuration Extended Event Configuration Extended Performance Tuning Parameters Configuration Security and Users Configuration Snapshot Configuration Export Definition File for Online Planning Worksheets Extended Verification and Synchronization HACMP Cluster Test Tool Extended Resource ConfigurationMove cursor to desired item and press Enter. HACMP Extended Resources Configuration Configure Resource Group Run-Time Policies HACMP Extended Resource Group Configuration HACMP Extended Resources ConfigurationMove cursor to desired item and press Enter. Configure HACMP Applications Configure HACMP Service IP Labels/Addresses Configure HACMP Tape Resources Configure HACMP Communication Adapters and Links Configure Custom Disk Methods Customize Resource Recovery Configure Resource Distribution Preferences Configure HACMP Service IP Labels/AddressesMove cursor to desired item and press Enter. Add a Service IP Label/Address Change/Show a Service IP Label/Address Remove Service IP Label(s)/Address(es) Select a Service IP Label/Address typeMove cursor to desired item and press Enter. Configurable on Multiple NodesBound to a Single Node Network NameMove cursor to desired item and press Enter. net_ether_01 (/24) net_ether_02 (/24 /24) Add a Service IP Label/Address configurable on Multiple Nodes (extended)Type or select values in entry fields.Press Enter AFTER making all desired changes. Entry Fields* IP Label/Address db_srv1 * Network Name net_ether_02 Alternate HW Address to accompany IP Label/Address Add a Service IP Label/Address configurable on Multiple Nodes (extended)Type or select values in entry fields.Press Enter AFTER making all desired changes. Entry Fields* IP Label/Address db_srv2 * Network Name net_ether_02 Alternate HW Address to accompany IP Label/Address 5.4 同步HACMP配置并启动HACMP由于创建concurrent vg需要采用新的命令smitty cl_convg来创建，因此，在配置资源组之前，需要将HACMP启动，才能完成创建VG的步骤。 Extended ConfigurationMove cursor to desired item and press Enter. Discover HACMP-related Information from Configured Nodes Extended Topology Configuration Extended Resource Configuration Extended Event Configuration Extended Performance Tuning Parameters Configuration Security and Users Configuration Snapshot Configuration Export Definition File for Online Planning Worksheets Extended Verification and Synchronization HACMP Cluster Test Tool HACMP Verification and SynchronizationType or select values in entry fields.Press Enter AFTER making all desired changes. Entry Fields* Verify, Synchronize or Both Both * Automatically correct errors found during No verification?* Force synchronization if verification fails? No * Verify changes only? No * Logging Standard启动HACMP，smitty clst