IBM_HACMP及Oracle_RAC安装过程.doc

HACMP的安装于补丁使用smitty 的安装功能，参考2.3.1 安装HACMP的如下软件包： cluster.adt.es.* cluster.doc.* cluster.es.* cluster.license cluster.man.en_US.es.data cluster.msg.en_US.* （说明：安装操作系统时必须把rsct.*所有文件集安装上去） 使用系统补丁安装的方法，参考以下文档,安装HACMP最新补丁。第一章 HACMP的安装配置P570 HACMP配置说明：因和oracle数据库rac的兼容性问题，以下版本重新安装为5.2版本，步骤相同。时间：2007-09-07号，HACMP配置信息（1）安装软件分别将HACMP 5.3软件光盘放入2台55A主机光驱，安装HACMP软件，除了cluster.hativoli, cluster.haview的包以外都安装。HA5.3附加安装AIX Expansion Pack光盘上的rsct.exp.cimrm 完成HACMP 5.3安装（2）配置文件系统#smitty chfs分别选择不同文件系统修改大小： file systemlvsize/hd42G/usrhd24G/varhd9var3G/tmphd33G/homehd12G（3）在2台主机上配置DS4800的卷组6、HA准备工作（1）配置2台主机的网卡#smitty tcpip设置ent2和ent5的ip地址操作如上，配置如下1号机hostname: db1Ent2 （db1_boot1）/40Ent5 （db1_boot2）/402号机hostname: db2Ent2 （db2_boot1）/40Ent5 （db2_boot2）/40（2）在2台主机上编辑/etc/hosts文件和添加/.rhosts文件#vi /etc/hosts loopback localhost db1 db1_boot1 db1_boot2 db2_boot1 db2_boot2 db1_vip db1 db2_vip db2 loopback localhost db2 db1_boot1 db1_boot2 db2_boot1 db2_boot2 db1_vip db1 db2_vip db2#vi /.rhosts/.rhosts文件内容为db1_boot1db1_boot2 db2_boot1db2_boot2db1_vipdb2_vip#chmod 644 /.rhosts修改文件权限为644（4）在2台主机的用户指定目录下添加启动、停止脚本文件/app/oracle_start.sh /app/oracle_stop.sh 在启动文件中加入路由网关脚本route add 0 #pwd确认目录在/app后#chmod 755 *.sh修改文件权限为755（5）分别在2台主机上增加TTY，且测试tty是否连通#smitty tty用：#lsdev Cc tty 查看心跳线设置情况用：先在A机# cat /dev/tty07、在1号机上配置HA（1）添加一个HA#smitty hacmp* Cluster Name db_cluster（2）添加2个node网络* Node Names db1_node * Node Names db2_node（3）添加一个ip网络 *NetworkName ipnet*NetworkType ether *Netmask 40*Enable IP Address akeover via IP Aliases no（4）添加一个tty网络* Network Name ttynet * Network Type rs232 (5)分别配置两台机的boot1，boot2，IP地址及tty路径（需要配置4个boot IP和2个tty设备的内容)添加2个节点的4个boot地址*IP Label/Address db1_boot1+ *Network Type ether*Network Name ipnet*Node Name db1_node+Network Interface 同上操作，添加：db1_boot2，db2_boot1，db2_boot2添加2个tty设备 (db1_tty和db2_tty)*Device Name db1_tty*Network Type rs232*Network Name ttynet* Device Path /dev/tty0*Node Name db1_node (6)设置2个主机service名称和地址 (db1_vip,db2_vip)*IP Label/Address db1_vip +*Network Name ipnet + (7) 添加1个应用服务 oracle_srv，配置启动停止脚本的完整路径* Server Name oracle_srv* Start Script /app/oracle_start.sh* Stop Script /app/oracle_stop.sh（8）添加和配置1个资源组 (db1_gr)*Resource Group Name db1_gr*Participating Node Names (Default Node Priority) db1_node db2_node*Resource Group Name db2_gr*Participating Node Names (Default Node Priority) db2_node db1_node配置资源组Resource Group Name db2_rgParticipating Node Names (Default Node Priority) db2_node was_nodeConcurrent Volume Groups datavg Use forced varyon of volume groups, if necessary false Application Servers oracle_srv （9）把A机的HACMP配置同步到B机启动HACMP在主机db1和db2db1/#lsvg -odatavgrootvgP55A hacmp配置1.1 AIX 5300-061.2 HAMCP 5.32. 硬件环境P55A两台DS4300存储一台串口线一根 3. 系统环境3.1 /etc/hosts loopback localhost app2 # loopback (lo0) name/address8 app1_boot app1 app1_stdby 0 app2_boot app2 app2_stdby 9 app_srv 4. 配置HACMP 以下操作只需在一个节点上操作即可4.1 配置网络拓朴4.1.1 配置Cluster Name # smitty hacmp Extended Configuration Extended Topology Configuration Configure an HACMP Cluster Add/Change/Show an HACMP Cluster * Cluster Name app_cluster 4.1.2 配置Cluster节点 # smitty hacmp Extended Configuration Extended Topology Configuration Configure HACMP Nodes Add a Node to the HACMP Cluste *NodeName app1 Communication Path to Node app1_boot +以同样方法将App2添加到Cluster中 *NodeName app2 Communication Path to Node app2_boot +4.1.3 配置HACMP网络 创建IP网络 # smitty hacmp Extended Configuration Extended Topology Configuration Configure HACMP Networks Add a Network to the HACMP Cluster * NetworkName net_ether_01 * NetworkType ether * Netmask +* Enable IP Address Takeover via IP Aliases NO + IP Address Offset for Heartbeating over IP Aliases 创建串口心跳网络 # smitty hacmp Extended Configuration Extended Topology Configuration Configure HACMP Networks Add a Network to the HACMP Cluster * NetworkName net_rs232_01* Network Type rs232 创建IP通信接口 # smitty hacmp Extended Configuration Extended Topology Configuration Configure HACMP Networks Configure HACMP Communication Interfaces/Devices Add Communication Interfaces/Device Add Pre-defined Communication Interfaces and Devices Communication Interfaces * IP Label/Address app1_boot + * Network Type ether * Network Name net_ether_01 * Node Name App1 + Network Interface 同样方法添加另一个通信接口到”net_ether_01” * IP Label/Address app2_boot + * Network Type ether * Network Name net_ether_01 * Node Name App2 + Network Interface 同样方法创建另一个通信接口 * IP Label/Address app1_ stb + * Network Type ether * Network Name net_ether_02 * Node Name App1 + Network Interface * IP Label/Address app2_ stb + * Network Type ether * Network Name net_ether_02 * Node Name App2 + Network Interface 创建串口通信设备 # smitty hacmp Extended Configuration Extended Topology Configuration Configure HACMP Networks Configure HACMP Communication Interfaces/Devices Add Communication Interfaces/Device Add Pre-defined Communication Interfaces and Devices Communication Devices * Device Name rs232_node_a * Network Type rs232 * Network Name net_rs232_01 * Device Path /dev/tty0 * Node Name app1 + 以同样方法创建另一个串口通信设备 * Device Name rs232_node_b * Network Type rs232 * Network Name net_rs232_01 * Device Path /dev/tty0 * Node Name app2 + 4.2 配置HACMP资源4.2.1 配置资源 创建Applications Servers # smitty hacmp Extended Configuration Extended Resource Configuration HACMP Extended Resources Configuration Configure HACMP Applications Servers Add an Application Server * Server Name appserver * Start Script /hascript/clstart.sh* Stop Script /hascript/clstop.sh需要手动在两个节点上建立“/hascript/clstart.sh”、“/hascript/clstop.sh”并保证其有执行权限。如果是双机互备的话需要建立两个App Server。方法相同。 创建Service IP # smitty hacmp Extended Configuration Extended Resource Configuration HACMP Extended Resources Configuration Configure HACMP Service IP Labels/Addresses Add a Service IP Label/AddressConfigurable on Multiple Nodes * IP Label/Address app1_svc +* Network Name net_ether_01 同样方法配置第二个Service IP * IP Label/Address app2_svc +* Network Name net_ether_02 Network Name：“net_ether_01”、“ net_ether_02” 决定了与之对应的Service IP默认在哪个网卡上启动。 4.2.2 配置资源组 创建资源组 # smitty hacmp Extended Configuration Extended Resource Configuration Add a Resource Group* Resource Group Name rg_node_a Participating Nodes (Default Node Priority) App1 App2 + Startup Policy Online On Home Node O + Fallover Policy Fallover To Next Prio + Fallback Policy Fallback To Higher Pr +如果是双机互备的话以同样方法建立另一个资源组 * Resource Group Name app_rg Participating Nodes (Default Node Priority) App1 App2 + Startup Policy：Online On Home Node Only： 只在主节点启动。在 “Participating Nodes” Fallover Policy：Fallover To Next Priority Node In The List：节点失败时资源组迁移到 Fallback Policy：Fallback To Higher Priority Node In The List：节点恢复时资源组返回 配置资源组属性 # smitty hacmp Extended Configuration Extended Resource Configuration Change/Show Resources and Attributes for a Resource Group Resource Group Name rg_node_a Participating Nodes (Default Node Priority) App1 App2 Startup Policy Online On Home Node O Fallover Policy Fallover To Next Prio Fallback Policy Fallback To Higher Pr Fallback Timer Policy (empty is immediate) + Service IP Labels/Addresses app1_svc +Application Servers appserver + Volume Groups app_vg+Use forced varyon of volume groups, if necessary false+Automatically Import Volume Groups ture+Filesystems (empty is ALL for VGs specified) +Filesystems Consistency Check fsck+Filesystems Recovery Method sequential+Filesystems mounted before IP configured false+Filesystems/Directories to Export +Filesystems/Directories to NFS Mount Network For NFS Mount +Tape Resources +Raw Disk PVIDs +Fast Connect Services +Communication Links +Primary Workload Manager Class +Secondary Workload Manager Class +如果是双机互备以同样方法修改另一个资源组属性5. 校验并同步HACMP配置 # smitty hacmp Extended Configuration Extended Verification and Synchronization * Verify, Synchronize or Both Both +* Automatically correct errors found during Interactively + verification? * Force synchronization if verification fails? No +* Verify changes only? No +* Logging Standard +6. 启动/停止HACMP6.1 启动HACMP（快速路径：#smitty clstart） # smitty hacmp System Management (C-SPOC) Manage HACMP Services Start Cluster Services * Start now, on system restart or both now Start Cluster Services on these nodes App1 App2 * Manage Resource Groups Automatically BROADCAST message at startup? true Startup Cluster Information Daemon? false Ignore verification errors? falsbe Automatically correct errors found during Interactively cluster start? 6.2 停止HACMP（快速路径：#smitty clstop） # smitty hacmp System Management (C-SPOC) Manage HACMP Services Stop Cluster Services * Stop now, on system restart or both now+ Stop Cluster Services on these nodes App1 App2 + BROADCAST cluster shutdown? true+*Select an Action on Resource Groups Move Resource Groups+ 第二章 Oracle Database的安装配置操作系统检查ORACLE 10G R2兼容操作系统为AIX (oslevel -r)，HACMP版本为5.4.1。需要安装如下软件包（lslpp -l ； smit install_all,smit installp）：bos.adt.base bos.perf.perfstatbos.adt.lib bos.perf.libperfstatbos.adt.libm tocolsrsct.basic.rte xlC.aix50.rte:以上版本xlC.rte:以上版本检查安装补丁两台服务器安装（instfix -i -k , smit update_all，smit updatep）：IY58143 IY59386 IY60930 IY66513 IY61034IY61770 IY62191 IY60759IY86296配置系统配置参数修改用户SHELL LIMITS参数（SMITTY CHUSER）创Soft FILE size -1Soft CPU time -1Soft DATA segment -1Soft STACK size -1或在/etc/security/limits文件中增加如下内容：oracle:fsize = -1core = -1cpu = -1data = -1rss = -1stack = -1nofiles = -1修改系统参数(SMITTY CHSYS)Maximum Number of PROCESSES allowed for each user 2048修改网络参数（/USR/SBIN/NO）执行下列语句，并重启系统。/usr/sbin/no -p -o udp_sendspace=65536/usr/sbin/no -p -o udp_recvspace=655360/usr/sbin/no -p -o tcp_sendspace=65536/usr/sbin/no -p -o tcp_recvspace=65536/usr/sbin/no -p -o rfc1323=1/usr/sbin/no -p -o sb_max=1310720/usr/sbin/no -r -o ipqmaxlen=512修改异步I/O（须重启）#smitty chgaio Entry Fields MINIMUM number of servers 30 # MAXIMUM number of servers 60 # maximum number of REQUESTS 4096 # server PRIORITY 39 # STATE to be configured at system restart available + State of fast path enable +# mkdev l aio0 使异步I/O可用RLOGIN配置在每个节点oracle主目录中，创建.rhost文件，文件中仅包含一个+字符。使用rlogin命令测试，登录不需密码则为成功。建oinstall、dba、hagsuser组 在两台主机分别创建用户组，两台主机组ID必须一致#/bin/mkgroupoinstall #/bin/mkgroupdba #/bin/mkgrouphagsuser创建oracle用户在两台主机分别创建Oracle用户组，两台主机用户ID必须一致Smitty user 根据规划配置.profile中的环境变量umask 022ORACLE_BASE=/oracle/appexport ORACLE_BASEORA_CRS_HOME=$ORACLE_BASE/product/10.2.0/crsORACLE_HOME=$ORACLE_BASE/product/10.2.0/db01ORACLE_SID=cgtest1 # 另一节点ORACLE_SID=cgtest2export ORA_CRS_HOME ORACLE_HOME ORACLE_SIDPATH=$ORACLE_HOME/bin:$ORACLE_CRS_HOME/bin:$PATHexport PATHexport AIXTHREAD_SCOPE=S裸设备的创建mklv -t raw -y data01 -U oracle -G dba oravg 20mklv -t raw -y temp01 -U oracle -G dba oravg 20 mklv -t raw -y index01 -U oracle -G dba oravg 20mklv -t raw -y system -U oracle -G dba oravg 10mklv -t raw -y sysaux -U oracle -G dba oravg 10mklv -t raw -y undotbs1 -U oracle -G dba oravg 20mklv -t raw -y undotbs2 -U oracle -G dba oravg 20mklv -t raw -y example -U oracle -G dba oravg 3mklv -t raw -y users01 -U oracle -G dba oravg 20mklv -t raw -y redo1_1 -U oracle -G dba oravg 2mklv -t raw -y redo1_2 -U oracle -G dba oravg 2mklv -t raw -y redo2_1 -U oracle -G dba oravg 2mklv -t raw -y redo2_2 -U oracle -G dba oravg 2mklv -