RHEL 6.6 64位部署ORACLE 11G R2 RAC.doc

RHEL 6.6 64位部署ORACLE 11G R2 RAC2015-07-14 17:37:12分类：Oracle目录1. 系统环境1.1 主机信息1.2 网络信息1.3 oracle安装信息1.4 存储信息2. 安装配置openfiler2.1 创建虚拟机2.2 安装虚拟机2.3 创建逻辑卷3. 安装配置RHEL6.6虚拟机3.1 创建虚拟机3.2 安装虚拟机3.3 配置虚拟机4. 配置局域网YUM4.1 服务端配置4.2 客户端配置5. 配置DNS服务器6. 配置网络6.1 节点1网卡配置6.2 节点2网卡配置7. 创建组、用户及目录8. 配置环境变量8.1 节点1环境变量8.2 节点2环境变量9. 配置ASM9.1 发现存储9.2 节点1配置ASM9.3 节点2配置ASM10. 安装依赖包11. 禁用NTP12. 验证环境12.1 安装cvuqdisk12.2 验证安装环境13. 安装GI13.1 安装13.2 检查14. 创建磁盘组15. 安装数据库16. 创建数据库1.系统环境1.1主机信息序号操作系统版本用途1RHEL6.6-x86_64Rac节点1，DNS服务器，YUM服务器2RHEL6.6-x86_64Rac节点23Openfiler2.99.1-x86_64共享存储服务器1.2网络信息节点HostnameTypeIP AddressInterfaceResolved byrac1rac1Public IP29eth0HOST FILErac1-vipVirtual IP39eth0:1HOST FILErac1-privPrivate IP1eth1HOST FILErac2rac2Public IP30eth0HOST FILErac2-vipVirtual IP40eth0:1HOST FILErac2-privPrivate IP2eth1HOST FILErac-scanSCAN IP50eth0:2HOST FILE，DNSopenfileropenfiler36eth0HOST FILE1.3 oracle安装信息序号软件组件用户主组次要组Base_homeOracle_home1Grid infrastructuregridoinstallasmadminasmdbaasmoper/u01/app/grid/u01/app/11.2.0/grid2Oracle RACoracleoinstallasmdbadbaoper/u01/app/oracle/u01/app/oracle/product/11.2.0/dbhome_1序号节点实例名称数据库名称1rac1stone 1stone2rac2stone 21.4存储信息序号用途文件系统大小名称冗余方式Openfiler卷名1数据盘ASM20G+DATAExternalLv12恢复盘ASM8G+FRAExternalLv23仲裁盘ASM2G+CRSExternalLv32.安装配置openfiler2.1创建虚拟机在openfiler官方网站/community/download下载安装镜像，然后新建虚拟机。分配40G的硬盘。分配内存，尽可能大一些。为光驱指定下载的镜像文件。2.2安装虚拟机开启虚拟机。开始安装。提示分配给openfiler的磁盘将会被初始化，进行确认。选择自定义分区。新建分区。创建/boot分区，一般100M。创建swap分区，2G足够了。创建/（根）分区，用于安装openfiler，4G足够了。创建后还剩余30多G，用于创建逻辑卷。配置网络。手动指定IP地址。设置主机名、网关和DNS。指定时区。设置root密码。开始安装。安装完成后重启。重启完成后，提示管理地址为36:446/。2.3创建逻辑卷使用浏览器访问36:446/,输入Openfiler的默认用户名为openfiler，密码为password。在安装完Openfiler之后，iSCSI服务默认是停止的，需要启动该服务。进入“Services”界面，在“iSCSI Target”后面单击“Enable”，启动该服务并设置在开机时自动启动。设置可以访问openfiler的主机，创建物理卷。先创建一个扩展分区。再在扩展分区下创建物理卷。创建卷组。创建逻辑卷。创建逻辑卷1，分配20G。创建逻辑卷2，分配8G。创建逻辑卷3，分配2G。配置iSCSI Target。将三个逻辑卷映射给iSCSI Target。允许可访问openfiler的主机使用该iSCSI Target。3.安装配置RHEL6.6虚拟机3.1创建虚拟机分别创建2个虚拟机，具体创建过程与创建openfiler虚拟机类似（在选择客户机操作系统的时候选择Red Hat Enterprise Linux 6 64位），也可以先创建一个模版，再进行克隆，可以参考/28536251/viewspace-1455365/。此处不再重复，创建结果如下：建议启用并添加共享文件夹，这样就不需要将oracle安装文件上传到linux系统上面去了。3.2安装虚拟机分别安装2个虚拟机，具体安装过程与安装openfiler虚拟机类似，如果是通过模版进行的克隆，需要修改网络配置，具体可以参考/28536251/viewspace-1444892/。安装完成后，建议安装VMware Tools，以提高与VMware的兼容性。3.3配置虚拟机为简化部署，需要对安装完成的虚拟机进行一些设置。（1）关闭两台虚拟机的防火墙rootbogon # /etc/init.d/iptables stoprootbogon # chkconfig iptables off（2）禁用两台虚拟机的selinux，修改SELINUX=enforcing为SELINUX=disabled。rootbogon # vim /etc/selinux/configrootbogon # cat /etc/selinux/config# This file controls the state of SELinux on the system.# SELINUX= can take one of these three values:#enforcing - SELinux security policy is enforced.#permissive - SELinux prints warnings instead of enforcing.#disabled - No SELinux policy is loaded.SELINUX=disabled# SELINUXTYPE= can take one of these two values:#targeted - Targeted processes are protected,#mls - Multi Level Security protection.SELINUXTYPE=targeted（3）修改主机名修改节点1的主机名：rootbogon # vim /etc/sysconfig/networkrootbogon # cat /etc/sysconfig/networkNETWORKING=yesHOSTNAME=rac1修改节点2的主机名：rootbogon # vim /etc/sysconfig/networkrootbogon # cat /etc/sysconfig/networkNETWORKING=yesHOSTNAME=rac2（4）重启虚拟机后进行检查rootrac1 # /etc/init.d/iptables statusiptables: Firewall is not running.rootrac1 # getenforceDisabledrootrac1 # hostnamerac14.配置局域网YUM4.1服务端配置在节点1安装配置局域网YUM，参考/28536251/viewspace-1454136/。也可以使用以下脚本进行创建，请根据实际情况进行修改。rootrac1 # cat local_yum.sh#!/bin/bashmount /dev/cdrom /media/cd /media/Packages/rpm -ivh vsftpd*chkconfig vsftpd oncd /media/cp -rv * /var/ftp/pub/cd /var/ftp/pub/rm -rf *.htmlrm -rf repodata/TRANS.TBLcd /media/Packages/rpm -ivh deltarpm*rpm -ivh python-deltarpm*rpm -ivh createrepo*createrepo -g /var/ftp/pub/repodata/*-comps-rhel6-Server.xml /var/ftp/pub/etc/init.d/vsftpd restart/etc/init.d/iptables stopcd /etc/yum.repos.d/mkdir bakmv * bak/touch rhel66.repocat rhel66.repo#rhel6name=rhel6baseurl=29/pub/enabled=1gpgcheck=0#EOFyum makecache4.2客户端配置在节点2进行YUM客户端配置，也可以直接运行下面的脚本，请根据实际情况进行修改。rootrac2 # cat client_yum.sh#!/bin/bashmount /dev/cdrom /media/cd /media/Packages/rpm -ivh vsftpd*chkconfig vsftpd on/etc/init.d/vsftpd restart/etc/init.d/iptables stopcd /etc/yum.repos.d/mkdir bakmv * bak/touch rhel66.repocat rhel66.repo#rhel6name=rhel6baseurl=29/pub/enabled=1gpgcheck=0#EOFyum makecache5.配置DNS服务器（1）安装软件包rootrac1 # yum install bind bind-chroot caching-nameserver（2）修改配置文件，将localhost和修改为any。rootrac1 # cp /etc/named.conf /etc/named.conf.bakrootrac1 # vim /etc/named.confrootrac1 # cat /etc/named.conf/ named.conf/ Provided by Red Hat bind package to configure the ISC BIND named(8) DNS/ server as a caching only nameserver (as a localhost DNS resolver only)./ See /usr/share/doc/bind*/sample/ for example named configuration files./options listen-on port 53 any; ;listen-on-v6 port 53 :1; ;directory/var/named;dump-file/var/named/data/cache_dump.db;statistics-file /var/named/data/named_stats.txt;memstatistics-file /var/named/data/named_mem_stats.txt;allow-queryany; ;recursion yes;dnssec-enable yes;dnssec-validation yes;dnssec-lookaside auto;/* Path to ISC DLV key */bindkeys-file /etc/named.iscdlv.key;managed-keys-directory /var/named/dynamic;logging channel default_debug file data/named.run;severity dynamic;zone . IN type hint;file named.ca;include /etc/named.rfc1912.zones;include /etc/named.root.key;（3）配置正反向解析zone文件解析scanip,在named.rfc1912.zones末尾加上zone rac-scan IN type master;file rac-scan.zone;allow-update none; ;zone 230.168.192.. IN type master;file 230.168.192.;allow-update none; ;rootrac1 # cp /etc/named.rfc1912.zones /etc/named.rfc1912.zones.bakrootrac1 # vim /etc/named.rfc1912.zonesrootrac1 # tail -11 /etc/named.rfc1912.zoneszone rac-scan IN type master;file rac-scan.zone;allow-update none; ;zone 230.168.192.. IN type master;file 230.168.192.;allow-update none; ;将其余内容注释掉。（4）配置正,反向解析数据库文件,在反向解析文件中加入150 IN PTR rac-scan.rootrac1 # cd /var/named/rootrac1 named# cp -p named.localhost 230.168.192.rootrac1 named# vim 230.168.192.rootrac1 named# tail -1 230.168.192.150 IN PTR rac-scan.在正向解析文件中加入rac-scan IN A 50rootrac1 # cd /var/named/rootrac1 named# cp -p named.localhost rac-scan.zonerootrac1 named# vim rac-scan.zonerootrac1 named# cat rac-scan.zone$TTL86400IN SOAlocalhost root (42; serial (d. adams)3H; refresh15M; retry1W; expiry1D ); minimumIN NSlocalhostlocalhostIN Arac-scanIN A50将以上的两个文件及named.ca拷贝到/var/named/chroot/var/named/目录下。rootrac1 named# cp -a rac-scan.zone chroot/var/named/rootrac1 named# cp -a 230.168.192. chroot/var/named/rootrac1 named# cp -a named.ca chroot/var/named/rootrac1 named# ll /var/named/chroot/var/named/total 12-rw-r- 1 root named183 Jul 11 17:07 230.168.192.-rw-r- 1 root named 2075 Apr 232014 named.ca-rw-r-r- 1 root named524 Jul 11 17:07 rac-scan.zone（5）检查文件是否配置正确rootrac1 named# named-checkzone rac-scan rac-scan.zonezone rac-scan/IN: loaded serial 42OKrootrac1 named# named-checkzone rac-scan 230.168.192.zone rac-scan/IN: loaded serial 0OK（6）重启DNS服务rootrac1 named# /etc/init.d/named restartStopping named: .OKStarting named:OK6.配置网络6.1节点1网卡配置（1）网卡eth0rootrac1 # vim /etc/sysconfig/network-scripts/ifcfg-eth0rootrac1 # cat /etc/sysconfig/network-scripts/ifcfg-eth0DEVICE=eth0HWADDR=00:0c:29:17:b8:04TYPE=EthernetONBOOT=yesNM_CONTROLLED=yesBOOTPROTO=noneIPADDR=29NETMASK=GATEWAY=ARPCHECK=no（2）网卡eth1rootrac1 # vim /etc/sysconfig/network-scripts/ifcfg-eth1rootrac1 # cat /etc/sysconfig/network-scripts/ifcfg-eth1DEVICE=eth1HWADDR=00:0C:29:17:B8:0ETYPE=EthernetONBOOT=yesNM_CONTROLLED=yesBOOTPROTO=noneIPADDR=1NETMASK=ARPCHECK=no（3）地址映射rootrac1 # vim /etc/hostsrootrac1 # cat /etc/hostslocalhost localhost.localdomain localhost4 localhost4.localdomain4:1localhost localhost.localdomain localhost6 localhost6.localdomain6#Public29rac130rac2#Virtual39rac1-vip40rac2-vip#Private1rac1-priv2rac2-priv#SCAN50rac-scan（4）配置DNSrootrac1 # cat /etc/resolv.conf# Generated by NetworkManagersearch localdomainnameserver 29（5）重启网络rootrac1 # /etc/init.d/network restartShutting down interface eth0:OKShutting down loopback interface:OKBringing up loopback interface:OKBringing up interface eth0:OKBringing up interface eth1:OK6.2节点2网卡配置（1）网卡eth0rootrac2 # vim /etc/sysconfig/network-scripts/ifcfg-eth0rootrac2 # cat /etc/sysconfig/network-scripts/ifcfg-eth0DEVICE=eth0HWADDR=00:0c:29:23:53:1cTYPE=EthernetONBOOT=yesNM_CONTROLLED=yesBOOTPROTO=noneIPADDR=30NETMASK=GATEWAY=ARPCHECK=NO（2）网卡eth1rootrac1 # vim /etc/sysconfig/network-scripts/ifcfg-eth1rootrac1 # cat /etc/sysconfig/network-scripts/ifcfg-eth1DEVICE=eth1HWADDR=00:0C:29:23:53:26TYPE=EthernetONBOOT=yesNM_CONTROLLED=yesBOOTPROTO=noneIPADDR=2NETMASK=ARPCHECK=no（3）地址映射rootrac2 # vim /etc/hostsrootrac2 # cat /etc/hostslocalhost localhost.localdomain localhost4 localhost4.localdomain4:1localhost localhost.localdomain localhost6 localhost6.localdomain6#Public29rac130rac2#Virtual39rac1-vip40rac2-vip#Private1rac1-priv2rac2-priv#SCAN50rac-scan（4）配置DNSrootrac2 # cat /etc/resolv.conf# Generated by NetworkManagersearch localdomainnameserver 29（5）重启网络rootrac2 # /etc/init.d/network restartShutting down interface eth0:OKShutting down loopback interface:OKBringing up loopback interface:OKBringing up interface eth0:OKBringing up interface eth1:OK7.创建组、用户及目录使用以下脚本进行创建，请根据实际情况进行修改，分别在两个节点运行。rootrac1 # vim oracle_ugd.shrootrac1 # cat oracle_ugd.sh#!/bin/bashgroupadd -g 5000 asmadmingroupadd -g 5001 asmdbagroupadd -g 5002 asmopergroupadd -g 6000 oinstallgroupadd -g 6001 dbagroupadd -g 6002 operuseradd -m -u 1100 -g oinstall -G asmadmin,asmdba,asmoper,dba -d /home/grid -s /bin/bash -c Grid Infrastructure Owner griduseradd -m -u 1101 -g oinstall -G dba,oper,asmdba -d /home/oracle -s /bin/bash -c Oracle Software Owner oraclemkdir -p /u01/app/gridmkdir -p /u01/app/11.2.0/gridchown -R grid:oinstall /u01mkdir -p /u01/app/oraclechown oracle:oinstall /u01/app/oraclechmod -R 775 /u01echo 123456 | passwd -stdin gridecho 123456 | passwd -stdin oracle8.配置环境变量8.1节点1环境变量（1）grid用户环境变量切换到grid用户，在.bash_profile文件中增加以下内容。gridrac1 $ vim .bash_profilegridrac1 $ source .bash_profilegridrac1 $ tail -6 .bash_profile#Grid SettingsORACLE_BASE=/u01/app/gridORACLE_HOME=/u01/app/11.2.0/gridORACLE_SID=+ASM1PATH=$ORACLE_HOME/bin:$PATHexport ORACLE_BASE ORACLE_HOME ORACLE_SID PATH（2）oracle用户环境变量设置切换到oracle用户，在.bash_profile文件中增加以下内容。oraclerac1 $ vim .bash_profileoraclerac1 $ source .bash_profileoraclerac1 $ tail -13 .bash_profile# Oracle SettingsTMP=/tmp; export TMPTMPDIR=$TMP; export TMPDIRORACLE_HOSTNAME=rac1; export ORACLE_HOSTNAMEORACLE_UNQNAME=stone; export ORACLE_UNQNAMEORACLE_BASE=/u01/app/oracle; export ORACLE_BASEORACLE_HOME=$ORACLE_BASE/product/11.2.0/dbhome_1; export ORACLE_HOMEORACLE_SID=stone1; export ORACLE_SIDORACLE_TERM=xterm; export ORACLE_TERMBASE_PATH=/usr/sbin:$PATH; export BASE_PATHPATH=$ORACLE_HOME/bin:$BASE_PATH; export PATHLD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib; export LD_LIBRARY_PATHCLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib; export CLASSPATH8.2节点2环境变量（1）grid用户环境变量切换到grid用户，在.bash_profile文件中增加以下内容。gridrac2 $ vim .bash_profilegrid rac2 $ source .bash_profilegridrac2 $ tail -6 .bash_profile#Grid SettingsORACLE_BASE=/u01/app/gridORACLE_HOME=/u01/app/11.2.0/gridORACLE_SID=+ASM2PATH=$ORACLE_HOME/bin:$PATHexport ORACLE_BASE ORACLE_HOME ORACLE_SID PATH（2）oracle用户环境变量设置切换到oracle用户，在.bash_profile文件中增加以下内容。oraclerac2 $ vim .bash_profileoraclerac2 $ source .bash_profileoraclerac2 $ tail -13 .bash_profile# Oracle SettingsTMP=/tmp; export TMPTMPDIR=$TMP; export TMPDIRORACLE_HOSTNAME=rac2; export ORACLE_HOSTNAMEORACLE_UNQNAME=stone; export ORACLE_UNQNAMEORACLE_BASE=/u01/app/oracle; export ORACLE_BASEORACLE_HOME=$ORACLE_BASE/product/11.2.0/dbhome_1; export ORACLE_HOMEORACLE_SID=stone2; export ORACLE_SIDORACLE_TERM=xterm; export ORACLE_TERMBASE_PATH=/usr/sbin:$PATH; export BASE_PATHPATH=$ORACLE_HOME/bin:$BASE_PATH; export PATHLD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib; export LD_LIBRARY_PATHCLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib; export CLASSPATH9.配置ASM9.1发现存储分别在2个节点上执行以下命令，发现存储。rootrac1 # yum -y install iscsi-initiator-utilsrootrac1 # chkconfig iscsid onrootrac1 # chkconfig iscsi onrootrac1 # /etc/init.d/iscsid startrootrac1 # /etc/init.d/iscsi startrootrac1 # iscsiadm -m discovery -t sendtargets -p 36Starting iscsid:OKiscsiadm: No portals found提示iscsiadm: No portals found，在openfiler主机上修改/etc/initiators.deny文件，注释掉里面的内容。rootopenfiler # cat /etc/initiators.deny# PLEASE DO NOT MODIFY THIS CONFIGURATION FILE!#This configuration file was autogenerated#by Openfiler. Any manual changes will be overwritten#Generated at: Fri Jul 10 17:24:59 CST 2015#.openfiler:tsn.942e0da88c8b ALL# End of Openfiler configurationrootrac1 # iscsiadm -m discovery -t sendtargets -p 3636:3260,1 .openfiler:tsn.942e0da88c8brootrac1 # iscsiadm -m node -T .openfiler:tsn.942e0da88c8b -p 36 -lLogging in to iface: default, target: .openfiler:tsn.942e0da88c8b, portal: 36,3260 (multiple)Login to iface: default, target: .openfiler:tsn.942e0da88c8b, portal: 36,3260 successful.rootrac1 # iscsiadm -m node -T .openfiler:tsn.942e0da88c8b -p 36 -op update -n node.startup -v automaticrootrac1 # cat /proc/partitionsmajor minor#blocksname8041943040 sda81204800 sda1824096000 sda28337641216 sda381620840448 sdb8328060928 sdc8482195456 sddrootrac2 # cat /proc/partitionsmajor minor#blocksname8041943040 sda81204800 sda1824096000 sda28337641216 sda381620840448 sdb8328060928 sdc8482195456 sdd从上面结果可以看到两个节点都已经发现了存储上面的三个逻辑卷。9.2节点1配置ASMrootrac1 #