最近在AIX 6.1上安装了一套RAC

1、最近在AIX 6.1上安装了一套RAC，实施得不多，遇到不少问题，记录一下：OS版本：HOST_NAM_1:/#oslevel -s6100-04-02-1007HA版本：HOST_NAM_1:/#lslpp -l cluster.* Fileset Level State Description -Path: /usr/lib/objrepos cluster.adt.es.client.include 5.5.0.0 COMMITTED ES Client Include Files cluster.adt.es.client.samples.clinfo 5.5.0.0 COMMITTE

2、D ES Client CLINFO Samples cluster.adt.es.client.samples.clstat 5.5.0.1 COMMITTED ES Client Clstat Samples# RSH 报错#rsh HOST_NAM_2 datershd: 0826-813 Permission is denied.相关文件配置：#cat .rhostsHOST_NAM_1 rootHOST_NAM_2 rootHOST_NAM_1 oracleHOST_NAM_2 oracle#cat /etc/hosts.equivHOST_NAM_1 rootHOST_NAM_2

3、rootHOST_NAM_1 oracleHOST_NAM_2 oracle其中HOST_NAM_1、HOST_NAM_2是HOSTNAME。这里主要是/etc/hosts文件中，HOSTNAME不能当作别名，或者，”.rhosts”、”hosts.equiv”里不要配别名，应该是跟解析有关。原HOSTS配置：175.16.1.11 HOST_NAM_1_boot1 HOST_NAM_1175.16.1.12 HOST_NAM_2_boot1 HOST_NAM_2192.168.10.17 HOST_NAM_1_boot2192.168.10.18 HOST_NAM_2_boot2192.16

4、8.10.16 HOST_NAM_2_vip192.168.10.15 HOST_NAM_1_vip改为：175.16.1.11 HOST_NAM_1_boot1 175.16.1.12 HOST_NAM_2_boot1 192.168.10.17 HOST_NAM_1 HOST_NAM_1_boot2192.168.10.18 HOST_NAM_2 HOST_NAM_2_boot2192.168.10.16 HOST_NAM_2_vip192.168.10.15 HOST_NAM_1_vip# rootpre.sh报错这个安装前在文档中有到看到，作为注意事项记录一下：The Oracle 1

5、0gR2 OUI and configuration assistant programs do not recognize AIX 6 V6.1 as a supported release.执行rootpre.sh时会报：Configuring Asynchronous I/O.Asynchronous I/O is not installed on this system.You will need to install it, and either configure it yourself usingsmit aio or rerun the Oracle root installa

6、tion procedure.Configuring POSIX Asynchronous I/O.Posix Asynchronous I/O is not installed on this system.You will need to install it, and either configure it yourself usingsmit aio or rerun the Oracle root installation procedure.解决方法：下载6718715补丁，执行里面的rootpre.sh参考文档：282036.1# VIPCA 报错VIPCA时，VIP起不来，日志

7、报错信息：Interface en4 checked failed (host=HOST_NAM_1)Invalid parameters, or failed to bring up VIP (host=HOST_NAM_1)原因：VIP绑定的是小机集成的网卡Logical Host Ethernet Port (lp-hea)The entstat output for LHEA is different from a regular adapter解决方法：修改racgvip脚本，找到$ENTSTAT -d $_IF这行，修改为：$ENTSTAT -d $_IF | $GREP -iEq

8、 .*lan.*state.*:.*operational.*|.*link.*status.*:.*up.*|.*port.*operational.*state.*:.*up.*|.*driver.*flags.*:.*up.*参考文档：959746.1# ONS 起不来日志报错信息：Failed to get IP for localhost (0)Failed to get IP for localhost (0)Failed to get IP for localhost (0)onsctl: ons failed to start解决方法：原hosts文件中找不到localhost

9、：127.0.0.1 loopback改为：127.0.0.1 loopback localhost# CRS 升级10.2.0.4报错升级完成后执行root102.sh，报：# ./root102.shError : Please change the CRS_ORACLE_USER id oracle to have the following OS capabilities : 解决方法：#chuser capabilities=CAP_BYPASS_RAC_VMM,CAP_PROPAGATE,CAP_NUMA_ATTACH oracle#lsuser -f oracle | grep

10、capabilities capabilities=CAP_BYPASS_RAC_VMM,CAP_PROPAGATE,CAP_NUMA_ATTACH这个报错之前遇到过，升级的文档中，也有提到。# CRS 升级10.2.0.4后，VIP起不来这次的有点难搞，日志中没有太多的信息，只有一行：Invalid parameters, or failed to bring up VIP (host=HOST_NAM_1)后来使用crsctl对VIP进行debug，收集更多的信息：#crsctl debug log res ora.host_nam_2.vip:5 Set Resource Debug M

11、odule: ora.host_nam_2.vip Level: 5#srvctl start nodeapps -n host_nam_2CRS-0233: Resource or relatives are currently involved with another operation.host_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:25 GMT+08:00 2010 360824 Checking interface existancehost_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:25 GM

12、T+08:00 2010 360824 Calling getifbyiphost_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:25 GMT+08:00 2010 360824 getifbyip: started for 192.168.10.16host_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:26 GMT+08:00 2010 360824 getifbyip: checking if failover is happening ()host_nam_2:ora.host_nam_2.vip:Thu Ma

13、r 25 13:57:26 GMT+08:00 2010 360824 getifbyip: failover is not happening ()host_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:26 GMT+08:00 2010 360824 Completed getifbyiphost_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:26 GMT+08:00 2010 360824 ping_vip 192.168.10.16 startedhost_nam_2:ora.host_nam_2.vip:Th

14、u Mar 25 13:57:26 GMT+08:00 2010 360824 About to execute : /usr/sbin/ping -c 1 -w 1 192.168.10.16host_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:27 GMT+08:00 2010 360824 ping_vip: 192.168.10.16 is not pingable, _count = 1host_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:27 GMT+08:00 2010 360824 Complete

15、d with initial interface testhost_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:27 GMT+08:00 2010 360824 Broadcast = 192.168.10.255host_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:27 GMT+08:00 2010 360824 Interface testshost_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:27 GMT+08:00 2010 360824 checkIf: start

16、 for if=en4host_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:27 GMT+08:00 2010 360824 IsIfAlive: start for if=en4host_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:27 GMT+08:00 2010 360824 defaultgw: startedhost_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:27 GMT+08:00 2010 360824 defaultgw: completed with 19

17、2.168.10.254host_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:27 GMT+08:00 2010 360824 About to execute command: /usr/sbin/ping -S 192.168.10.18 -c 1 -w 1 192.168.10.254host_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:28 GMT+08:00 2010 360824 About to execute command: /usr/sbin/ping -S 192.168.10.18 -c 1

18、 -w 1 192.168.10.254host_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:29 GMT+08:00 2010 360824 IsIfAlive: RX packets checked if=en4 failedhost_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:29 GMT+08:00 2010 360824 Interface en4 checked failed (host=HOST_NAM_2)host_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:

19、29 GMT+08:00 2010 360824 IsIfAlive: end for if=en4host_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:29 GMT+08:00 2010 360824 checkIf: end for if=en4host_nam_2:ora.host_nam_2.vip:Invalid parameters, or failed to bring up VIP (host=HOST_NAM_2)host_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:30 GMT+08:00 20

20、10 307376 Checking interface existancehost_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:30 GMT+08:00 2010 307376 Calling getifbyiphost_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:30 GMT+08:00 2010 307376 getifbyip: started for 192.168.10.16host_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:30 GMT+08:00 2010

21、307376 getifbyip: checking if failover is happening ()host_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:30 GMT+08:00 2010 307376 getifbyip: failover is not happening ()host_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:30 GMT+08:00 2010 307376 Completed getifbyiphost_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:

22、57:30 GMT+08:00 2010 307376 ping_vip 192.168.10.16 startedhost_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:30 GMT+08:00 2010 307376 About to execute : /usr/sbin/ping -c 1 -w 1 192.168.10.16host_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:31 GMT+08:00 2010 307376 ping_vip: 192.168.10.16 is not pingable,

23、_count = 1host_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:31 GMT+08:00 2010 307376 Completed with initial interface testhost_nam_2:ora.host_nam_2.vip:Thu Mar 25 13:57:31 GMT+08:00 2010 307376 Broadcast = 192.168.10.255CRS-1006: No more members to considerCRS-0215: Could not start resource ora.host_na

24、m_2.vip.CRS-0210: Could not find resource ora.host_nam_2.LISTENER_HOST_NAM_2.lsnr.这才搜索到了相关信息：Bug 8413088: VIP CANNOT START ON AIX 6.1 BECAUSE NETSTAT HAS A NEW COLUMN.Bug 9157855: DURING RESTART OR WHEN ONE OF THE TWO NODE CLUSTER IS DOWN, VIP RESOURCE FAILS这个问题，在打完CRS PSU后，也同样有可能存在，可以通过修改racvip脚本来解

25、决：10.2.0.4：_O1=$NETSTAT -n -I $_IF | $AWK if (/$_IF/) print $5; exit_O2=$NETSTAT -n -I $_IF | $AWK if (/$_IF/) print $5; exit打完PSU后：_O1=$NETSTAT -n -I $_IF -p tcp | $GREP -iE .*packets received$ | $AWK print $1; exit_O2=$NETSTAT -n -I $_IF -p tcp | $GREP -iE .*packets received$ | $AWK print $1; exit

26、最终改为：_O1=$NETSTAT -n -I $_IF -p ip | $GREP -iE .*packets received$ | $AWK print $1; exit_O2=$NETSTAT -n -I $_IF -p ip | $GREP -iE .*packets received$ | $AWK print $1; exit这个问题很杯具，花了很多时间，安装前，阅读相关文档时，我就注意到了这个BUG，两次VIP起不来，我都拿去对比，看看是不是这个BUG。结果还是没发现，一直到debug出来。# RDBMS升10204时，报java进程没停Oracle Universal Ins

27、taller has detected thatthere are processes running in thecurrently selected Oracle Home. Thefollowing processes need to be shutdownbefore continuing:java刚开始时，还有CRS的进程，停掉CRS后，还有一个java始终过不去，用fuser查使用$ORACLE_HOME目录进程，全kill，把ps -ef | grep java 出来的进程，除了安装的进程外都杀了，还是不行。最后在Metalink上找到了解决方法，升级前：cd /usr/sbin

28、/mv fuser fuser.origtouch /usr/sbin/fuserchmod +x /usr/sbin/fuser升级完成后，再改回来：cd /usr/sbin/cp fuser.orig fuser这招很阴啊。参考文档：975597.1# 数据库打完PSU补丁后，启CRS报错在CRS、database都升级、打补丁完成后，启CRS、VIP等资源时，报错：HOST_NAM_1:/#crsctl start crsexec(): 0509-036 Cannot load program /app/oracle/product/10204/db_1/bin/crsctl.bin because of the following errors: 0509-150 Dependent module libhasgen10.a(shr_hasgen10.o) could not be loaded. 0509-022 Cannot load module libhasgen10.a(shr_hasgen10.o). 0509-026 System error: A fi