终极版Oracle_10g_RAC_For_Linux86_64安装手册.doc

第一章 安装前的准备工作IP规划如下：本地IP： 192.168.112.10 255.255.255.0 192.168.112.254Linux1：eth0-192.168.112.101 255.255.255.0 192.168.112.254 eth1-10.10.112.101 255.255.255.0 Linux2：eth0-192.168.112.102 255.255.255.0 192.168.112.254 eth1-10.10.112.102 255.255.255.0 注：public地址（这里为eth0网卡所配置的IP地址）必须配置网关，否则，在后面执行vipca 时会出错1.1 关闭服务（soh1，soh2）(1) service iptables stop /关闭防火墙 chkconfig -level 12345 iptables off (2) chkconfig -level 12345 sendmail off /开机启动时关闭电子邮件服务(3) vi /etc/selinux/config SELINUX=disabled以下操作无特殊说明都在2个节点上配置1.2 配置/etc/hosts（soh1，soh2）cat /etc/hosts /etc/sysctl.conf /etc/security/limits.conf /etc/pam.d/login /etc/profile /etc/rc.d/rc.local /.ssh/authorized_keysssh rac1 cat /.ssh/id_dsa.pub /.ssh/authorized_keysssh rac2 cat /.ssh/id_rsa.pub /.ssh/authorized_keysssh rac2 cat /.ssh/id_dsa.pub /.ssh/authorized_keysscp /.ssh/authorized_keys rac2:/.ssh/chmod 644 /.ssh/authorized_keyssoh2上：chmod 644 /.ssh/authorized_keys11.3 所有集群主机上测试oraclesoh1 $ ssh soh1 date;ssh soh2 dateoraclesoh2 $ ssh soh1 date;ssh soh2 date不需要密码说明ssh配置成功（其中在第二个节点上会有两次输入：yes，然后再试就不用输入了）。1.12 绑定裸设备12.1共享磁盘设置在物理主机上使用starwind软件（iscsi服务器端）,创建名字为disk1.Img(4G)、disk2.img(4G)disk3.img(4G)的镜像文件。首先安装starwind软件，然后点击打开该软件：连接本地：用户名和密码均是：test连接完成之后出现如下图所示的界面：添加设备：按照以上的创建步骤继续创建两个共享磁盘：disk2和disk3：在虚拟主机soh1和soh2上安装iscsi客户端。使用如下命令连接iscsi服务器端,并设置开机启动服务。service iscsi startiscsiadm -m discovery -t sendtargets -p 192.168.112.10iscsiadm -m node -T disk1 -p 192.168.112.10 -liscsiadm -m node -T disk2 -p 192.168.112.10 -liscsiadm -m node -T disk3 -p 192.168.112.10 -lcat /etc/rc.local /etc/udev/rules.d/60-raw.rules EOFACTION=add, KERNEL=sdb1, RUN+=/bin/raw /dev/raw/raw1 %NACTION=add, KERNEL=sdc1, RUN+=/bin/raw /dev/raw/raw2 %NACTION=add, KERNEL=sdb2, RUN+=/bin/raw /dev/raw/raw3 %NACTION=add, KERNEL=sdc2, RUN+=/bin/raw /dev/raw/raw4 %NACTION=add, KERNEL=sdb3, RUN+=/bin/raw /dev/raw/raw5 %NACTION=add, KERNEL=sdc3, RUN+=/bin/raw /dev/raw/raw6 %NACTION=add, KERNEL=sdb5, RUN+=/bin/raw /dev/raw/raw7 %NACTION=add, KERNEL=sdc5, RUN+=/bin/raw /dev/raw/raw8 %NACTION=add, KERNEL=sdb6, RUN+=/bin/raw /dev/raw/raw9 %NACTION=add, KERNEL=sdc6, RUN+=/bin/raw /dev/raw/raw10 %NACTION=add, KERNEL=sdb7, RUN+=/bin/raw /dev/raw/raw11 %NACTION=add, KERNEL=sdc7, RUN+=/bin/raw /dev/raw/raw12 %NACTION=add, KERNEL=sdb8, RUN+=/bin/raw /dev/raw/raw13 %NACTION=add, KERNEL=sdc8, RUN+=/bin/raw /dev/raw/raw14 %NACTION=add, KERNEL=sdb9, RUN+=/bin/raw /dev/raw/raw15 %NACTION=add, KERNEL=sdc9, RUN+=/bin/raw /dev/raw/raw16 %NACTION=add, KERNEL=sdb10, RUN+=/bin/raw /dev/raw/raw17 %NACTION=add, KERNEL=sdd1, RUN+=/bin/raw /dev/raw/raw18 %NACTION=add, KERNEL=sdd2, RUN+=/bin/raw /dev/raw/raw19 %NACTION=add, KERNEL=sdd3, RUN+=/bin/raw /dev/raw/raw20 %NACTION=add, KERNEL=sdd5, RUN+=/bin/raw /dev/raw/raw21 %NACTION=add, KERNEL=sdc10, RUN+=/bin/raw /dev/raw/raw22 %NACTION=add, KERNEL=sdb11, RUN+=/bin/raw /dev/raw/raw23 %NACTION=add, KERNEL=sdc11, RUN+=/bin/raw /dev/raw/raw24 %NACTION=add, KERNEL=sdb12, RUN+=/bin/raw /dev/raw/raw25 %NACTION=add, KERNEL=sdc12, RUN+=/bin/raw /dev/raw/raw26 %NKERNEL=raw1-9, OWNER=oracle, GROUP=oinstall, MODE=640KERNEL=raw10-9, OWNER=oracle, GROUP=oinstall, MODE=640KERNEL=raw20-6, OWNER=oracle, GROUP=oinstall, MODE=640EOFroot执行start_udev识别裸设备。1.14 修改oracle用户的环境变量（soh1，soh2） oracle用户的环境变量文件.bash_profile文件加入如下内容export ORACLE_BASE=/home/oracleexport ORACLE_HOME=$ORACLE_BASE/product/10.2.0/dbexport ORA_CRS_HOME=$ORACLE_BASE/product/10.2.0/crsexport ORACLE_SID=sohdb1 #1机器的节点名称# export ORACLE_SID=sohdb2 #2机器的节点名称export PATH=$ORA_CRS_HOME/bin:$ORACLE_HOME/bin:$PATHexport LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$ORACLE_HOME/libexport LC_CTYPE=en_US.UTF-8 export NLS_LANG=AMERICAN_AMERICA.ZHS16GBKexport TMPDIR=/tmpexport TMP=/tmpsource .bash_profile 使环境变量生效1.15 修改root用户环境变量（soh1，soh2）root用户的环境变量文件.bash_profile文件，加入如下内容：export ORACLE_BASE=/home/oracleexport ORACLE_HOME=$ORACLE_BASE/product/10.2.0/dbexport ORA_CRS_HOME=$ORACLE_BASE/product/10.2.0/crsexport PATH=$ORA_CRS_HOME/bin:$ORACLE_HOME/bin:$PATHsource .bash_profile1.16 创建目录（soh1，soh2） cd /home/oracle mkdir -p product/10.2.0/db mkdir -p product/10.2.0/crs chown -R oracle:oinstall product chmod -R 775 product1.17 建立软链接（soh1，soh2）创建软连接目录mkdir -p /oradatachown -R oracle:oinstall /oradatachmod -R 775 /oradata使用oracle用户创建软连接ln -s /dev/raw/raw18 /oradata/data1G_1ln -s /dev/raw/raw19 /oradata/data1G_2ln -s /dev/raw/raw20 /oradata/data1G_3ln -s /dev/raw/raw21 /oradata/data1G_41.18 配置NTP（在实际环境中不需要）在soh1上：rootsoh1 # vi /etc/ntp.conf增加：restrict 192.168.112.0 mask 255.255.255.0 nomodify notrap清除/etc/ntp/ntpservers内容在/etc/ntp/step-tickers增加127.127.0.1执行service ntpd restart在soh2上在vi /etc/ntp.conf中增加server 192.168.112.101restrict 192.168.112.101 mask 255.255.255.255 nomodify notrap noquery清除/etc/ntp/ntpservers内容在/etc/ntp/step-tickers增加192.168.112.101执行crontab e 加入*/1 * * * * /usr/sbin/ntpdate -u 192.168.112.101service crond restart第二章 安装OracleCRS软件2.1 安装的准备工作若系统为32位则使用unzip命令解包unzip 10201_clusterware_linux_x86_64.zip若为64位系统则以二进制方式上传安装文件到/home/oracle/目录解压缩cpio文件oraclesoh1$ unzip 10201_clusterware_linux_x86_64.zipclusterware/stage/prereq/crs/crsprereq.jarclusterware/stage/prereq/crs/refhost.xmlclusterware/stage/prereq/crs/crs_prereq.xmlclusterware/stage/prereq/crsclusterware/docclusterware/welcome.htmlclusterware641117 blocks2.2 图形下安装2.2.1 CRS安装环境检查rootsoh1 # cd /home/oracle/clusterware/cluvfy$ ./runcluvfy.sh stage -pre crsinst -n soh1,soh2 verbose$./runcluvfy.sh stage -post hwos -n db01,db02 -s -verbose会出现四个包未打，可以忽略确认两台主机时间同步(切换到oracle用户)oraclesoh1# ssh soh1 date;ssh soh2 date检查裸设备情况及权限是否分配正确# cd /dev/raw# ls -al在第一个节点（在虚拟机内执行）上图形界面上执行安装：# xhost +# export DISPLAY=:0.0# su - oracle$ cd clusterware$ ./runInstaller单击Next按钮，出现如下界面：单击Next按钮选择路径、语言，并单击Next按钮单击Next按钮,先编辑第一个节点，再单击Add按钮，填入节点2的名称单击Next按钮，按照/etc/hosts文件内的配置对两个网段进行编辑，并点击Next:填入ocr文件的裸设备文件名，单击Next按钮填入vote文件的裸设备文件名，单击Next按钮单击Install按钮开始安装：出现如下的界面时，一定不要立即点击“OK”按钮,在两个节点分别执行oraInstRoot.sh和root.sh，注意：这里先不要点OK按钮：第一台orainstRoot.shrootsoh1 # /home/oracle/oraInventory/orainstRoot.sh Changing permissions of /home/oracle/oraInventory to 770.Changing groupname of /home/oracle/oraInventory to dba.The execution of the script is complete第二台orainstRoot.shrootsoh2 # /home/oracle/oraInventory/orainstRoot.shChanging permissions of /home/oracle/oraInventory to 770.Changing groupname of /home/oracle/oraInventory to dba.The execution of the script is complete第一台root.shrootsoh1 # /home/oracle/product/10.2.0/crs/root.sh WARNING: directory /home/oracle/product/10.2.0 is not owned by rootWARNING: directory /home/oracle/product is not owned by rootWARNING: directory /home/oracle is not owned by rootChecking to see if Oracle CRS stack is already configured/etc/oracle does not exist. Creating it now.Setting the permissions on OCR backup directorySetting up NS directoriesOracle Cluster Registry configuration upgraded successfullyWARNING: directory /home/oracle/product/10.2.0 is not owned by rootWARNING: directory /home/oracle/product is not owned by rootWARNING: directory /home/oracle is not owned by rootSuccessfully accumulated necessary OCR keys.Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.node : node 1: soh1 soh1-priv soh1node 2: soh2 soh2-priv soh2Creating OCR keys for user root, privgrp root.Operation successful.Now formatting voting device: /dev/raw/raw24Now formatting voting device: /dev/raw/raw25Now formatting voting device: /dev/raw/raw26Format of 3 voting devices complete.Startup will be queued to init within 90 seconds.Adding daemons to inittabExpecting the CRS daemons to be up within 600 seconds.CSS is active on these nodes. soh1CSS is inactive on these nodes. soh2Local node checking complete.Run root.sh on remaining nodes to start CRS daemons.第二台root.shrootsoh2 # /home/oracle/product/10.2.0/crs/root.sh WARNING: directory /home/oracle/product/10.2.0 is not owned by rootWARNING: directory /home/oracle/product is not owned by rootWARNING: directory /home/oracle is not owned by rootChecking to see if Oracle CRS stack is already configured/etc/oracle does not exist. Creating it now.Setting the permissions on OCR backup directorySetting up NS directoriesOracle Cluster Registry configuration upgraded successfullyWARNING: directory /home/oracle/product/10.2.0 is not owned by rootWARNING: directory /home/oracle/product is not owned by rootWARNING: directory /home/oracle is not owned by rootclscfg: EXISTING configuration version 3 detected.clscfg: version 3 is 10G Release 2.Successfully accumulated necessary OCR keys.Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.node : node 1: soh1 soh1-priv soh1node 2: soh2 soh2-priv soh2clscfg: Arguments check out successfully.NO KEYS WERE WRITTEN. Supply -force parameter to override.-force is destructive and will destroy any previous clusterconfiguration.Oracle Cluster Registry for cluster has already been initializedStartup will be queued to init within 90 seconds.Adding daemons to inittabExpecting the CRS daemons to be up within 600 seconds.CSS is active on these nodes. soh1 soh2CSS is active on all nodes.Waiting for the Oracle CRSD and EVMD to startOracle CRS stack installed and running under init(1M)Running vipca(silent) for configuring nodeapps/home/oracle/product/10.2.0/crs/jdk/jre/bin/java: error while loading shared libraries: libpthread.so.0: cannot open shared object file: No such file or directory这是由于LD_ASSUME_KERNEL参数设置不正确引起在所有节点机器的/oracle/product/10.2.0/crs/bin/vipca文件中找到如下内容： Remove this workaround when the bug 3937317 is fixed arch=uname -m if $arch = i686 -o $arch = ia64 then LD_ASSUME_KERNEL=2.4.19 export LD_ASSUME_KERNEL fi #End workaround在fi后新添加一行：unset LD_ASSUME_KERNEL以及srvctl文件 （需要在所有节点上操作）# vi /oracle/product/10.2.0/crs/bin/srvctl找到如下内容：LD_ASSUME_KERNEL=2.4.19export LD_ASSUME_KERNEL同样在其后新增加一行：unset LD_ASSUME_KERNEL2.3 root执行vipca在一号机上运行如果马上运行vipca会报告如下错误rootsoh1 $ /oracle/product/10.2.0/crs/bin/vipcaError 0(Native: listNetInterfaces:3) Error 0(Native: listNetInterfaces:3)必须先设置rootsoh1 # oifcfg setif -global eth0/192.168.17.0:publicrootsoh1 # oifcfg setif -global eth1/10.1.1.0:cluster_interconnectrootsoh1 # ./oifcfg getifeth0 192.168.112.0 global publiceth1 10.10.112.0 global cluster_interconnect然后在图形界面下执行# /oracle/product/10.2.0/crs/bin/vipca单击Next按钮，选中public网卡eth0单击Next按钮，填入soh1-vip和soh2-vip其他根据/etc/hosts文件自动完成，注意子网掩码的设置与public ip一致。单击Next按钮单击Finish按钮完成以后单击OK按钮此时再点击OK单击Exit完成oracle CRS安装第三章 安装Oracle数据库软件执行/oracle/soft/database/runInstaller.sh单击下一步 选择安装企业版数据库，单击下一步 确定安装路径，单击下一步 选中集群内所有节点，单击下一步 单击下一步 选择仅安装数据库软件，单击下一步 单击安装 此时安装向导将提示你以root用户的身份在所有节点上执行上述脚本。执 行效果如下： rootsoh1 bin# /home/oracle/product/10.2.0/db/root.shRunning Oracle10 root.sh script.The following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /home/oracle/product/10.2.0/dbEnter the full pathname of the local bin directory: /usr/local/bin: Copying dbhome to /usr/local/bin . Copying oraenv to /usr/local/bin . Copying coraenv to /usr/local/bin .Creating /etc/oratab file.Entries will be added to the /etc/oratab file as needed byDatabase Configuration Assistant when a database is createdFinished running generic part of root.sh script.Now product-specific root actions will be performed.rootsoh2 # /home/oracle/product/10.2.0/db/root.shRunning Oracle10 root.sh script.The following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /home/oracle/product/10.2.0/dbEnter