WINDOWS虚拟机搭建RAC操作手册-v1.0

1、WINDOWS虚拟机搭建RAC操作手册-v1.01 环境介绍本次试验为搭建2个linux虚拟机环境，进行ORACLE 11.2.0.4版本数据库集群搭建，以完成集群维护工作的一些测试项目。1.1 操作系统环境rootmytest1 # cat /etc/redhat-release Red Hat Enterprise Linux Server release 6.3 (Santiago)rootmytest1 # uname -aLinux mytest1 2.6.32-279.el6.x86_64 #1 SMP Wed Jun 13 18:24:36 EDT 2012 x86_64 x86

2、_64 x86_64 GNU/Linux1.2 数据库环境11.2.0.4 ORALCE版本以及grid版本2 ip地址配置与规划节点1 和节点2环境配置如下：服务器主机名MytestMytest1公共IP地址（eth0）192.168.215.132192.168.215.133虚拟VIP地址（eth0）192.168.215.134192.168.215.135私有IP地址（eth1）10.2.0.7010.2.0.71ORACLE RAC SIDprod1Prod2集群实例名称prodSCAN IP192.168.215.136操作系统Red Hat Enterprise Linux S

3、erver release 6.3 (Santiago)存储ASMOracle11.2.0.4备注：1. 公共公共IP地址、虚拟VIP地址以、SCAN IP需要配置为同一网段2. 私有IP地址（eth1） 可以不再一个网段。3. 以下备注节点1为192.168.215.132（mytest），节点2为192.168.215.133(Mytest1)2.1 配置ip地址配置节点1 ip地址，编辑vi /etc/sysconfig/network-scripts/ifcfg-eth0DEVICE="eth0"BOOTPROTO=staticIPADDR=192.168.215.

4、132HWADDR="00:0C:29:61:54:90"IPV6INIT="yes"NM_CONTROLLED="yes"ONBOOT="yes"TYPE="Ethernet"vi /etc/sysconfig/network-scripts/ifcfg-eth1DEVICE =eth1BOOTPROTO=staticHWADDR=00:0C:29:61:54:9AIPV6INIT=yesNM_CONTROLLED=yesONBOOT=yesIPADDR=10.2.0.70TYPE=Ether

5、net以root用户重启networkservice network restart配置节点2 地址vi /etc/sysconfig/network-scripts/ifcfg-eth0DEVICE="eth0"BOOTPROTO=staticIPADDR=192.168.215.133HWADDR="00:0C:29:61:54:90"IPV6INIT="yes"NM_CONTROLLED="yes"ONBOOT="yes"TYPE="Ethernet"vi /etc/s

6、ysconfig/network-scripts/ifcfg-eth1DEVICE =eth1BOOTPROTO=staticHWADDR=00:0C:29:61:54:9AIPV6INIT=yesNM_CONTROLLED=yesONBOOT=yesIPADDR=10.2.0.71TYPE=Ethernet以root用户重启networkservice network restart2.2 配置host文件节点1和节点2分别调整hosts文件以root用户调整host文件如下：rootmytest1 network-scripts# vi /etc/hosts127.0.0.1 localh

7、ost localhost.localdomain localhost4 localhost4.localdomain4:1 localhost localhost.localdomain localhost6 localhost6.localdomain6192.168.215.132 mytest192.168.215.133 mytest1192.168.215.134 mytest-vip192.168.215.135 mytest1-vip10.2.0.70 mytest-priv10.2.0.71 mytest1-priv192.168.215.136 mytest-scan-实际

8、地址配置以及添加hosts文件可根据实际地址配置进行调整。3 关闭防火墙节点1和节点2 执行以下操作service iptables stopchkconfig iptables offchkconfig -list iptables4 关闭selinux节点1和节点2 执行以下操作vi /etc/selinux/configSELINUX=disabled5 关闭ntp节点1和节点2 执行以下操作/sbin/service ntpd stopchkconfig ntpd offmv /etc/ntp.conf /etc/ntp.conf.originalchkconfig ntpd list

9、(此次配置采用数据库内部的CTSS服务进行时间同步，需要关闭ntp服务)6 判断匿名用户节点1和节点2 执行以下操作确认匿名用户nobody是否存在于系统中，因为在安装完成后nobody用户需要执行一些扩展任务：id nobody7 创建用户和用户组节点1和节点2 执行以下操作,并设置密码，oracle密码一致，grid用户密码一致groupadd -g 1000 oinstallgroupadd -g 1001 dba groupadd -g 1002 opergroupadd -g 1003 asmdbagroupadd -g 1004 asmadmingroupadd -g 1005 a

10、smoperuseradd -u 1006 -g oinstall -G dba,oper,asmdba oracleuseradd -u 1007 -g oinstall -G dba,oper,asmadmin,asmdba,asmoper gridpasswd oraclepasswd grid8 创建安装目录节点1和节点2 root执行以下操作export ORACLE_BASE=/u01/app/gridexport ORACLE_HOME=/u01/app/11.2.0/gridmkdir -p $ORACLE_BASEmkdir -p $ORACLE_HOMEchown -R g

11、rid:oinstall /u01/appchown -R grid:oinstall $ORACLE_BASEchown -R grid:oinstall $ORACLE_HOMEchmod -R 775 /u01/appchmod -R 775 $ORACLE_BASEchmod -R 775 $ORACLE_HOMEexport ORACLE_BASE=/u01/app/oracleexport ORACLE_HOME=$ORACLE_BASE/product/11.2.0/db_1mkdir -p $ORACLE_BASEmkdir -p $ORACLE_HOMEchown -R or

12、acle:oinstall $ORACLE_BASEchown -R oracle:oinstall $ORACLE_HOMEchmod -R 775 $ORACLE_BASE备注：安装目录可根据实际分配进行调整，标记黑色部分为grid安装目录，其他为oracle安装目录。 Oracle官方解释最好将grid用户的ORACLE_HOME不在为ORACLE_BASE子目录在安装过程中root.sh会将grid所在目录修改为root权限，影响其他的oracle软件9 配置环境变量节点1和节点2 分别以grid、oracle用户执行如下操作：#GRID用户vi .bash_profileORACLE

13、_SID=+ASM1;export ORACLE_SIDORACLE_BASE=/u01/app/grid;export ORACLE_BASEGRID_HOME=/u01/app/11.2.0/grid; export GRID_HOMEORACLE_HOME=$GRID_HOME;export ORACLE_HOMENLS_LANG=American_America.AL32UTF8;export NLS_LANGNLS_DATE_FORMAT='YYYY-MM-DDHH24:MI:SS'export NLS_DATE_FORMATPATH=$PATH:$ORACLE_HO

14、ME/bin;export PATHumask 022-验证source .bash_profileecho $ORACLE_HOME# ORACLE 用户vi .bash_profileORACLE_SID=prod1;export ORACLE_SIDORACLE_UNQNAME=prod;export ORACLE_UNQNAMEORACLE_BASE=/u01/app/oracle;export ORACLE_BASEORACLE_HOME=$ORACLE_BASE/product/11.2.0/db_1;export ORACLE_HOMENLS_LANG=American_Amer

15、ica.AL32UTF8;export NLS_LANGNLS_DATE_FORMAT='YYYY-MM-DDHH24:MI:SS'export NLS_DATE_FORMATPATH=$PATH:$ORACLE_HOME/bin;export PATHumask 022-验证source .bash_profileecho $ORACLE_HOME10 配置内核参数节点1和节点2 root执行如下操作：vi /etc/security/limits.conf编辑文件添加如下内容grid soft nproc 2047 grid hard nproc 16384grid sof

16、t nofile 1024grid hard nofile 65536oracle soft nproc 2047oracle hard nproc 16384oracle soft nofile 1024oracle hard nofile 65536vi /etc/pam.d/login编辑文件添加如下内容session required pam_limits.sovi /etc/sysctl.conf编辑文件添加如下内容#ORACLE SETTINGfs.aio-max-nr = 1048576fs.file-max = 6815744kernel.shmall = 2097152 ke

17、rnel.shmmax = 1536870912kernel.shmmni = 4096kernel.sem = 250 32000 100 128net.ipv4.ip_local_port_range = 9000 65500net.core.rmem_default = 262144net.core.rmem_max = 4194304net.core.wmem_default = 262144net.core.wmem_max = 1048586备注：kernel.shmall = 2097152 kernel.shmmax = 1536870912kernel.shmmni = 40

18、96其中kernel.shmmax最大共享内存数，根据实际内存容量调整即可。kernel.shmall * kernel.shmmni>= kernel.shmmax11 配置asm磁盘11.1 虚拟机创建共享盘打开cmd，到虚拟机安装目录，执行如下命令创建虚拟磁盘vmware-vdiskmanager.exe -c -s 1g -a lsilogic -t 2 "D:vmwaresharedisksocrdisk.vmdk"vmware-vdiskmanager.exe -c -s 2G -a lsilogic -t 4 "D:vmwaresharedis

19、ksfradisk.vmdk"vmware-vdiskmanager.exe -c -s 2G -a lsilogic -t 4 "D:vmwaresharedisksdata01.vmdk"vmware-vdiskmanager.exe -c -s 2G -a lsilogic -t 4 "D:vmwaresharedisksdata02.vmdk"挂载虚拟磁盘，节点1操作1 打开虚拟机，设置添加磁盘如下：2 添加磁盘3 为磁盘制定scsi注意与下面加入vmx文件中的对应在节点2的虚拟机vmx文件添加如下内容disk.EnableUUID =

20、 "TRUE"disk.locking = "false" diskLib.dataCacheMaxSize = "0" scsi1.present = "TRUE" scsi1.virtualDev = "lsilogic" scsi1:1.present = "TRUE" scsi1:1.fileName = "D:vmwaresharedisksocrdisk.vmdk" scsi1:2.present = "TRUE" scsi

21、1:2.fileName = "D:vmwaresharedisksfradisk.vmdk"scsi1:3.present = "TRUE" scsi1:3.fileName = "D:vmwaresharedisksdata01.vmdk" scsi1:4.present = "TRUE" scsi1:4.fileName = "D:vmwaresharedisksdata02.vmdk"在节点1 的vmx文件加入disk.EnableUUID = "TRUE"disk.

22、locking = "false" diskLib.dataCacheMaxSize = "0" 11.2 磁盘分区磁盘情况如下：rootmytest1 network-scripts# fdisk -lDisk /dev/sda: 21.5 GB, 21474836480 bytes255 heads, 63 sectors/track, 2610 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesSector size (logical/physical): 512 bytes / 51

23、2 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0x0004f853 Device Boot Start End Blocks Id System/dev/sda1 * 1 39 307200 83 LinuxPartition 1 does not end on cylinder boundary./dev/sda2 39 2342 18500608 83 Linux/dev/sda3 2342 2611 2162688 82 Linux swap / SolarisDisk /dev/sdb:

24、 1073 MB, 1073741824 bytes255 heads, 63 sectors/track, 130 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0x1f3d0250 Device Boot Start End Blocks Id System/dev/sdb1 1 65 5

25、22081 83 Linux/dev/sdb2 66 130 522112+ 83 LinuxDisk /dev/sdc: 2147 MB, 2147483648 bytes255 heads, 63 sectors/track, 261 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0x47

26、541713 Device Boot Start End Blocks Id System/dev/sdc1 1 132 1060258+ 83 Linux/dev/sdc2 133 261 1036192+ 83 LinuxDisk /dev/sdd: 2147 MB, 2147483648 bytes255 heads, 63 sectors/track, 261 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O

27、size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0x4197a359 Device Boot Start End Blocks Id System/dev/sdd1 1 132 1060258+ 83 Linux/dev/sdd2 133 261 1036192+ 83 LinuxDisk /dev/sde: 2147 MB, 2147483648 bytes255 heads, 63 sectors/track, 261 cylindersUnits = cylinders of 16065 * 512 = 8225

28、280 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0x6c443d3d Device Boot Start End Blocks Id System/dev/sde1 1 132 1060258+ 83 Linux/dev/sde2 133 261 1036192+ 83 Linux其中黑色标记部分为绑定asm磁盘设备分区情况，可按照实际情况进行分区调整。11.3 udev绑定节点1和节点2

29、 root执行如下操作：vi /etc/udev/rules.d/60-raw.rules#for ocr_votingACTION="add",KERNEL="sdb1",RUN+="/bin/raw /dev/raw/raw1 %N"ACTION="add",KERNEL="sdb2",RUN+="/bin/raw /dev/raw/raw2 %N"#for Flash_RecoveryACTION="add",KERNEL="sdc1&qu

30、ot;,RUN+="/bin/raw /dev/raw/raw3 %N"ACTION="add",KERNEL="sdc2",RUN+="/bin/raw /dev/raw/raw4 %N"#for dataACTION="add",KERNEL="sdd1",RUN+="/bin/raw /dev/raw/raw5 %N"ACTION="add",KERNEL="sdd2",RUN+="/bin/raw

31、/dev/raw/raw6 %N"ACTION="add",KERNEL="sde1",RUN+="/bin/raw /dev/raw/raw7 %N"ACTION="add",KERNEL="sde2",RUN+="/bin/raw /dev/raw/raw8 %N"KERNEL="raw1-8*", OWNER="grid", GROUP="asmadmin", MODE="660"开启udevstart_udev验证cd /dev/raw/ls lrt12 安装grid节点1执行上传p13390677_112040_GI_Linux-x86-64_3of7.zip到节点1 /home/grid目录中。chown grid:oinstall p1339*chmod 775 p1339*grid用户解压：解压unzip p13390677_112040_GI_Linux-x86-64_3of7.zip使用root用户安装cvuqdisk-1.0.9-1.rpm包export CVUQDISK_GRP=oinstallrpm -ivh /home/grid/cvuqdi