aixrac实施报告.doc

一 前期规划1.主机配置及系统规划服务器：b80（8cpu,1GB mem）p630（8cpu,2GB mem）操作系统版本：5300-08-07-0920HA版本：53_sp5openssh：for aix 5L数据库版本：数据库实例名：rac1/rac2共享存储：fastT600共享VG：datavg2.IP规划#vi /etc/hosts3 p630_boot 0 b80_boot 3 p630_stdby 0 b80_stdby1 p630_server p6302 b80_server b803 p630_priv0 b80_priv01 p630-vip02 b80-vip3.NTP服务（未配置）4.创建oracle用户和group1）在两个节点都创建oinstall和dba，需要groupID相同gid=216(oinstall) groups=217(dba) groups=218(hagsuser)2）在两个节点都创建oracle用户，需要userID相同#smitty user* User NAME oracle User ID 440 Primary GROUP oinstall Group SET dba,hagsuser HOME directory /home/oracle Initial PROGRAM /usr/bin/ksh Soft FILE size -1 Soft CPU time -1 Soft DATA segment -1 Soft STACK size -1 3）创建密码#passwd oracle5.enhance concurrent VG1）在b80端创建concurrent vg#smitty mkvg Entry FieldsVOLUME GROUP name datavgPhysical partition SIZE in megabytes 128 * PHYSICAL VOLUME names hdisk2 hdisk3 hdisk4 Force the creation of a volume group? no Activate volume group AUTOMATICALLY at system restart? yes Volume Group MAJOR NUMBER Create VG Concurrent Capable? enhanced concurrent 2）修改vg属性#varyonvg datavg#chvg -a n -Q n datavg 3）在b80端创建lv，lv上pp跨pv平均分配,并设置属主关系#vi mklv.sh /编辑脚本后台执行mklv -y lv_rac_01 -t raw -e x datavg 8mklv -y lv_rac_02 -t raw -e x datavg 8mklv -y lv_rac_03 -t raw -e x datavg 8mklv -y lv_rac_04 -t raw -e x datavg 8mklv -y lv_rac_05 -t raw -e x datavg 8mklv -y lv_rac_06 -t raw -e x datavg 8mklv -y lv_rac_07 -t raw -e x datavg 8mklv -y lv_rac_08 -t raw -e x datavg 8mklv -y lv_rac_09 -t raw -e x datavg 8mklv -y lv_rac_10 -t raw -e x datavg 8mklv -y lv_rac_11 -t raw -e x datavg 8mklv -y lv_rac_12 -t raw -e x datavg 8mklv -y lv_rac_13 -t raw -e x datavg 8mklv -y lv_rac_14 -t raw -e x datavg 8mklv -y lv_rac_15 -t raw -e x datavg 8mklv -y lv_rac_crs -t raw -e x datavg 2mklv -y lv_rac_vote -t raw -e x datavg 2mklv -y lv_rac_vote1 -t raw -e x datavg 2mklv -y lv_rac_vote2 -t raw -e x datavg 2mklv -y lv_rac_redo1 -t raw -e x datavg 4mklv -y lv_rac_redo2 -t raw -e x datavg 4mklv -y lv_rac_redo3 -t raw -e x datavg 4mklv -y lv_rac_redo4 -t raw -e x datavg 4mklv -y lv_rac_ctl1 -t raw -e x datavg 2mklv -y lv_rac_ctl2 -t raw -e x datavg 2mklv -y lv_rac_ctl3 -t raw -e x datavg 2mklv -y lv_rac_pwd -t raw -e x datavg 1mklv -y lv_rac_spfile -t raw -e x datavg 1#nohup sh mklv.sh &#cd /dev#chown oracle:dba rlv* 4）在p630端导入vg,并修改属性#importvg -y datavg hdisk2#varyonvg datavg#chvg -a n -Q n datavg #cd /dev#chown oracle:dba rlv*#varyoffvg datavg6.配置ssh在两个节点分别执行以下操作su - oraclemkdir /.sshchmod 700 /.sshssh-keygen -t rsa /按回车即可ssh-keygen -t dsa /按回车即可touch /.ssh/authorized_keysssh b80 cat /.ssh/id_rsa.pub /.ssh/authorized_keys ssh b80 cat /.ssh/id_dsa.pub /.ssh/authorized_keys ssh p630 cat /.ssh/id_rsa.pub /.ssh/authorized_keys ssh p630 cat /.ssh/id_dsa.pub /.ssh/authorized_keys chmod 664 /.ssh/authorized_keys8.配置.profile#su - oracle$vi .profileORACLE_BASE=/oracleexport ORACLE_BASEORACLE_HOME=$ORACLE_BASE/product//db_1export ORACLE_HOMEORACLE_CRS_HOME=$ORACLE_BASE/product//crsORACLE_SID=rac1/rac2 /两个节点实例名不同 export ORACLE_SIDORACLE_TERM=xtermexport ORACLE_TERMNLS_LANG=AMERICAN_AMERICA.ZHS16GBKexport NLS_LANGLD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib:/usr/local/libexport LD_LIBRARY_PATHLD_ASSUME_KERNEL=2.4.19export LD_ASSUME_KERNELPATH=$PATH:$ORACLE_HOME/bin:/usr/bin:/usr/sbinexport PATHunset USERNAME二 HACMP 环境配置1.确认启动cluster服务#lssrc -s clcomdESSubsystem Group PID Status clcomdES clcomdES inoperative#startsrc -s clcomdES0513-059 The clcomdES Subsystem has been started. Subsystem PID is 278666.#lssrc -s clcomdES Subsystem Group PID Status clcomdES clcomdES 278666 activ2.配置.rhosts文件，用于节点间的通信认证和加密（可有可无）# vi /usr/es/sbin/cluster/etc/rhostsb80_serverp630_serverb80_privp630_privb80_vipp630_vip2.配置cluster1）创建cluster name# smitty cm_add_change_show_an_hacmp_cluster.dialog2）创建cluster node#smitty cm_add_a_node_to_the_hacmp_cluster_dialog3）创建network（net_ether_01和net_ether_02）#smitty cm_add_a_network_to_the_hacmp_cluster_select其中net_ether_01作为HA ip_aliase的网络；net_ether_02做为oracle的私有网络4）创建资源组（b80net、p630net和datares）#smitty config_resource_group.dialog.custom其中b80net作为b80服务地址启动的资源组；p630net作为p630net服务地址启动的资源组；datares作为concurrent vg启动的资源组5）配置server ip#smitty hacmp Initialization and Standard Configuration Configure Resources to Make Highly Available Configure Service IP Labels/Addresses Add a Service IP Label/Address6）配置network#smitty cm_add_communication_interfaces_devices.select7）配置资源组# smitty cm_change_show_resources_std_resource_group_menu_dmn.select 8）创建nmdhb# smitty cl_add_mndhb_lv9）配置nmdhb# smitty cl_set_mndhb_response10）同步 # smitty cm_initialization_and_standard_config_menu_dmn3.cluster信息1）拓扑信息rootp630/#/usr/es/sbin/cluster/utilities/cltopinfoCluster Name: testCluster Connection Authentication Mode: StandardCluster Message Authentication Mode: NoneCluster Message Encryption: NoneUse Persistent Labels for Communication: NoThere are 2 node(s) and 5 network(s) definedNODE b80: Network net_diskhbmulti_01 b80_1 /dev/heart1 Network net_diskhbmulti_02 b80_2 /dev/heart2 Network net_diskhbmulti_03 b80_3 /dev/heart3 Network net_ether_01 b80_server 2 b80_boot 0 b80_stdby 0 Network net_ether_02 b80_priv 0NODE p630: Network net_diskhbmulti_01 p630_2 /dev/heart1 Network net_diskhbmulti_02 p630_3 /dev/heart2 Network net_diskhbmulti_03 p630_4 /dev/heart3 Network net_ether_01 p630_server 1 p630_boot 3 p630_stdby 3 Network net_ether_02 p630_priv 3Resource Group dateres Startup Policy Online On All Available Nodes Fallover Policy Bring Offline (On Error Node Only) Fallback Policy Never Fallback Participating Nodes b80 p630 Resource Group b80net Startup Policy Online On Home Node Only Fallover Policy Fallover To Next Priority Node In The List Fallback Policy Fallback To Higher Priority Node In The List Participating Nodes b80 p630 Service IP Label b80_serverResource Group p630net Startup Policy Online On Home Node Only Fallover Policy Fallover To Next Priority Node In The List Fallback Policy Fallback To Higher Priority Node In The List Participating Nodes p630 b80 Service IP Label p630_server2）nmdhb信息rootp630/#/usr/es/sbin/cluster/sbin/cl_show_mndhb_vgThe following network is configured for Multi-Node Disk Heartbeat:Network net_diskhbmulti_01 Network net_diskhbmulti_01 uses Logical Volume /dev/heart1 in Volume Group datavg for heartbeat. Volume Group datavg is managed by Resource Group dateres The following nodes participate in this network: b80 p630 On loss of access, HACMP will: Halt the nodeThe following network is configured for Multi-Node Disk Heartbeat:Network net_diskhbmulti_02 Network net_diskhbmulti_02 uses Logical Volume /dev/heart2 in Volume Group datavg for heartbeat. Volume Group datavg is managed by Resource Group dateres The following nodes participate in this network: b80 p630 On loss of access, HACMP will: Halt the nodeThe following network is configured for Multi-Node Disk Heartbeat:Network net_diskhbmulti_03 Network net_diskhbmulti_03 uses Logical Volume /dev/heart3 in Volume Group datavg for heartbeat. Volume Group datavg is managed by Resource Group dateres The following nodes participate in this network: b80 p630 On loss of access, HACMP will: Halt the node三 安装 CRS1.上传并解压安装文件#gunzip 10gr2_aix5l64_cluster.cpio.gz#cpio -idmvc 10gr2_aix5l64_cluster.cpio2.在root用户下执行rootpre.sh。需要重启HA#./rootpre.sh3.检测安装环境$ ./runcluvfy.sh comp nodereach -n all -verbose Verifying node reachability Checking node reachability.Check: Node reachability from node p630 Destination Node Reachable? - - b80 yes p630 yes Result: Node reachability check passed from node p630.Verification of node reachability was successful.$ ./runcluvfy.sh stage -pre crsinst -n allPerforming pre-checks for cluster services setup Checking node reachability.Node reachability check passed from node p630.Checking user equivalence.User equivalence check passed for user oracle.Checking administrative privileges.User existence check passed for oracle.Group existence check passed for oinstall.Membership check for user oracle in group oinstall as Primary passed.Administrative privileges check passed.Checking node connectivity.Node connectivity check passed for subnet with node(s) b80,p630.Node connectivity check passed for subnet with node(s) b80,p630.Suitable interfaces for the private interconnect on subnet :b80 en0:0p630 en0:3Suitable interfaces for the private interconnect on subnet :b80 en1:0p630 en1:3ERROR: Could not find a suitable set of interfaces for VIPs.Node connectivity check failed.Checking system requirements for crs.Kernel version check passed.System architecture check passed.Total memory check passed.Swap space check passed.Free disk space check passed.Free disk space check passed.Package existence check failed for vacpp.cmp.core:.Check failed on nodes: b80,p630Operating system patch check failed for IY65361 .Check failed on nodes: b80,p630Package existence check failed for vac.C:.Check failed on nodes: b80,p630Package existence check passed for xlC.aix50.rte:.Package existence check passed for xlC.rte:.Package existence check failed for gpfs.base:.Check failed on nodes: b80,p630Operating system patch check failed for IY63969. /for gpfsCheck failed on nodes: b80,p630Operating system patch check failed for IY69911. /for gpfsCheck failed on nodes: b80,p630Operating system patch check failed for IY70276. /for gpfsCheck failed on nodes: b80,p630Package existence check passed for cluster.license:.Operating system patch check failed for IY60759. /for Application fails reading the hacmp cluster configuration.for 9i Check failed on nodes: b80,p630Operating system patch check passed for IY61034.Operating system patch check failed for IY61770. /for MISC SERVICE UPDATESCheck failed on nodes: b80,p630Operating system patch check passed for IY62191.Package existence check failed for ElectricFence-2.2.2-1:2.2.2.Check failed on nodes: b80,p630Package existence check failed for xlfrte:9.1.Check failed on nodes: b80,p630Package existence check passed for gdb-6.0-1:6.0.Package existence check passed for make-3.80-1:3.80.Package existence check failed for freeware.gnu.tar.rte:.Check failed on nodes: b80,p630Package existence check failed for Java14_64.sdk:.Check failed on nodes: b80,p630Package existence check failed for Java131.rte.bin:6.Check failed on nodes: b80,p630Package existence check passed for Java14.sdk:.Operating system patch check passed for IY65305.Operating system patch check failed for IY58350. /for sdk Check failed on nodes: b80,p630Operating system patch check failed for IY63533. /for sdkCheck failed on nodes: b80,p630Package existence check failed for mqm.server.rte:5.3.Check failed on nodes: b80,p630Package existence check failed for mqm.client.rte:5.3.Check failed on nodes: b80,p630Package existence check failed for sna.rte:.Check failed on nodes: b80,p630Package existence check passed for .tcp.server.Operating system patch check failed for IY44599. Check failed on nodes: b80,p630Operating system patch check passed for IY60930.Operating system patch check passed for IY58143.Operating system patch check passed for IY66513.Operating system patch check passed for IY70159.Operating system patch check passed for IY59386.Package existence check passed for bos.adt.base.Package existence check passed for bos.adt.lib.Package existence check passed for bos.adt.libm.Package existence check passed for bos.perf.libperfstat.Package existence check passed for bos.perf.perfstat.Package existence check passed for ctools.Package existence check passed for rsct.basic.rte.Package existence check passed for perl.rte:5.0005.Package existence check passed for perl.rte:5.6.Package existence check passed for perl.rte:5.8.Package existence check failed for python-2.2-4:2.2.Check failed on nodes: b80,p630Package existence check failed for freeware.zip.rte:2.3.Check failed on nodes: b80,p630Package existence check failed for freeware.gcc.rte:.Check failed on nodes: b80,p630Group existence check passed for dba.User existence check passed for nobody.System requirement failed for crsPre-check for cluster services setup was unsuccessful on all the nodes. 检测发现，缺少一些包，这些包对安装crs没有影响可以忽略，另外报错“Could not find a suitable set of interfaces for VIPs”，不影响后续安装，可忽略。4.安装crs#xhost +#su - oracle$export DISPLAY=39:0.0$./runInstaller根据提示操作，建议手工执行root.sh命令后，在两个节点都执行vipca来配置虚拟地址（root）#export DISPLAY=39:0.0#./vipca5.查看crs状态$cd $ORACLE_CRS_HOME/bin$ ./crs_stat -tName Type Target State Host -ora.b80.gsd application ONLINE ONLINE b80 ora.b80.ons application ONLINE ONLINE b80 ora.b80.vip application ONLINE ONLINE b80 ora.p630.gsd application ONLINE ONLINE p630 ora.p630.ons application ONLINE ONLINE p630 ora.p630.vip application ONLINE ONLINE p630 四 安装database1.上传并解压安装文件#gunzip 10gr2_aix5l64_databaser.cpio.gz#cpio -idmvc 10gr2_aix5l64_database.cpio2.在root用户下执行rootpre.sh。#./rootpre.sh3.安装oracle软件#xhost +#su - oracle$export DISPLAY=172.30.