Oracle11GR2RAC及负载均衡搭建手册

1、Oracle 11G R2 RAC安装手册基础知识RAC是什么RAC，全称real application clusters，译为“实时应用集群”，是Oracle新版数据库中采用的一项新技术，是高可用性的一种，也是Oracle数据库支持网格计算环境的核心技术。RAC的优缺点优点Oracle RAC支持Oracle9i、10g、11g版本，可以支持24 x 7 有效的数据库应用系统，在低成本服务器上构建高可用性数据库系统，并且自由部署应用，无需修改代码。在Oracle RAC环境下，Oracle集成提供了集群软件和存储管理软件，为用户降低了应用成本。当应用规模需要扩充时，用户可以按需扩展系统，以

2、保证系统的性能。多节点负载均衡; 提供高可用：故障容错和无缝切换功能，将硬件和软件错误造成的影响最小化; 通过并行执行技术提高事务响应时间通常用于数据分析系统; 通过横向扩展提高每秒交易数和连接数通常对于联机事务系统; 节约硬件成本，可以用多个廉价PC服务器代替昂贵的小型机或大型机，同时节约相应维护成本; 可扩展性好，可以方便添加删除节点，扩展硬件资源。缺点相对单机，管理更复杂，要求更高; 可能会增加软件成本Oracle RAC原理在一个应用环境当中，所有的服务器使用和管理同一个数据库，目的是为了分散每一台服务器的工作量，硬件上至少需要两台以上的服务器，而且还需要一个共享存储设备。同时所有服务

3、器上的OS都应该是同一类OS,根据负载均衡的配置策略，当一个客户端发送请求到某一台服务的listener后，这台服务器根据我们的负载均衡策略，会把请求发送给本机的RAC组件处理也可能会发送给另外一台服务器的RAC组件处理，处理完请求后，RAC会通过集群软件来访问共享存储设备.逻辑结构上看：每一个参加集群的节点有一个独立的instance，这些instance访问同一个数据库。每一个节点的linstance都有自己的SGA。每一个节点的linstance都有自己的background process。每一个节点的linstance都有自己的redo logs。每一个节点的instance都有自己

4、的undo表空间。所有节点都共享一份datafiles和controlfiles。三类Resource：VIP - 虚拟IP地址(Virtual IP) OCR - Oracle Cluster Registry(集群注册文件),记录每个节点的相关信息Voting Disk,仲裁机制用于仲裁多个节点向共享节点同时写的行为，这样 做是为了避免发生冲突。RAC环境设计服务器配置操作系统主机名内存网卡Redhat Enterprise Linux 5.4rac12Geth0（Public）eth1（Prive）Redhat Enterprise Linux 5.4rac22Geth0（Public）

5、eth1（Prive）用户组规划GroupNameGroupID说明HOSToinstall501Oracle清单和软件所有者rac1，rac2asmadmin504Oracle自动存储管理组rac1，rac2asmdba506ASM数据库管理员组rac1，rac2asmopen507ASM操作员组rac1，rac2dba502数据库管理员rac1，rac2用户规划UserIDUserNameGroup说明HOST口令501gridoinstalldbaasmadminasmdbaasmoperOracle Cluster用户rac1rac2grid123502oracleoinstalldb

6、aasmdbaOracle数据库管理员rac1rac2oracle123IP规划主机名公用IP私有IP虚拟IPrac1111111rac2121212ScanIP00存储规划存储组件Block DeviceASMlib NameSizeOCR/dev/sdbOCR_VOL11G/dev/sdcOCR_VOL21G/dev/sddOCR_VOL31G数据文件/dev/sdeDATA_VOL110G文件备份/dev/sdfBACK_VOL15GOracle RAC搭建配置共享存储（ASM依赖）方法一：vmware workstation 9虚拟共享存储在VM安装目录VMware Workstati

7、on下执行命令：#vmware-vdiskmanager.exe -c -s 1GB -a lsilogic -t 2 D:racDiskdb01.vmdk#vmware-vdiskmanager.exe -c -s 1GB -a lsilogic -t 2 D:racDiskdb02.vmdk#vmware-vdiskmanager.exe -c -s 1GB -a lsilogic -t 2 D:racDiskdb03.vmdk#vmware-vdiskmanager.exe -c -s 10GB -a lsilogic -t 2 D:racDiskdb04.vmdk#vmware-vdi

8、skmanager.exe -c -s 5GB -a lsilogic -t 2 D:racDiskdb05.vmdk修改rac1和rac2下的.vmx文件，在最后一行添加如下内容：diskLib.dataCacheMaxSize=0 diskLib.dataCacheMaxReadAheadSize=0diskLib.dataCacheMinReadAheadSize=0diskLib.dataCachePageSize=4096diskLib.maxUnsyncedWrites = 0disk.locking = FALSEscsi1.sharedBus = virtual scsi1.p

9、resent = TRUEscsi1.virtualDev = lsilogicscsi1:0.mode = independent-persistentscsi1:0.deviceType = diskscsi1:0.present = TRUEscsi1:0.fileName = D:racDiskdb01.vmdkscsi1:1.mode = independent-persistentscsi1:1.deviceType = diskscsi1:1.present = TRUEscsi1:1.fileName = D:racDiskdb02.vmdk scsi1:2.mode = in

10、dependent-persistentscsi1:2.deviceType = diskscsi1:2.present = TRUEscsi1:2.fileName = D:racDiskdb03.vmdk scsi1:3.mode = independent-persistentscsi1:3.deviceType = diskscsi1:3.present = TRUEscsi1:3.fileName = D:racDiskdb04.vmdkscsi1:4.mode = independent-persistentscsi1:4.deviceType = diskscsi1:4.pres

11、ent = TRUEscsi1:4.fileName = D:racDiskdb05.vmdk重新打开虚拟机，并启动。磁盘分区，在rac1执行#fdisk /dev/sdbDevice contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel Building a new DOS disklabel. Changes will remain in memory only, until you decide to write them. After that, of course, the previo

12、us content wont be recoverable. Warning: invalid flag 0 x0000 of partition table 4 will be corrected by w(rite)Command (m for help): pDisk /dev/sdb: 1048 MB, 1048576000 bytes 64 heads, 32 sectors/track, 1000 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Device Boot Start End Blocks Id Sy

13、stem Command (m for help): nCommand action e extended p primary partition (1-4)pPartition number (1-4): 1First cylinder (1-1000, default 1):Using default value 1 Last cylinder or +size or +sizeM or +sizeK (1-1000, default 1000): Using default value 1000 Command (m for help): wThe partition table has

14、 been altered! Calling ioctl() to re-read partition table. Syncing disks.#fdisk /dev/sdc 重复上面操作#fdisk /dev/sdd 重复上面操作#fdisk /dev/sde 重复上面操作#fdisk /dev/sdf 重复上面操作方法二：Linux mount挂载（待解决）安装依赖包#yum install -y expect* iscsi* binutils* compat-libstdc+* expat* elfutils-libelf* gcc* glibc* ksh* libgcc*#yum i

15、nstall -y pdksh* libgomp* compat-db* libXp* libaio* cpp* setarch* sysstat* libstdc+* make-3*#yum install -y unixODBC#yum install -y unixODBC-devel查看依赖包安装状况#rpm -q -qf %NAME-%VERSION-%RELEASE(%ARCH)n binutils elfutils-libelf elfutils-libelf expat gcc gcc-c+ glibc glibc-common glibc-devel glibc-header

16、s ksh libaio libaio-devel libgcc libstdc+ libstdc+-devel make pdksh sysstat unixODBC unixODBC-devel执行结果binutils-.6-26.el5(x86_64)elfutils-libelf-0.137-3.el5(x86_64)elfutils-libelf-0.137-3.el5(i386)elfutils-libelf-0.137-3.el5(x86_64)elfutils-libelf-0.137-3.el5(i386)expat-1.95.8-11.el5_8(x86_64)expat-

17、1.95.8-11.el5_8(i386)gcc-4.1.2-54.el5(x86_64)gcc-c+-4.1.2-54.el5(x86_64)glibc-2.5-118.el5_10.2(i686)glibc-2.5-118.el5_10.2(x86_64)glibc-common-2.5-118.el5_10.2(x86_64)glibc-devel-2.5-118.el5_10.2(x86_64)glibc-devel-2.5-118.el5_10.2(i386)glibc-headers-2.5-118.el5_10.2(x86_64)ksh-20100621-18.el5(x86_6

18、4)libaio-0.3.106-5(x86_64)libaio-0.3.106-5(i386)libaio-devel-0.3.106-5(i386)libaio-devel-0.3.106-5(x86_64)libgcc-4.1.2-54.el5(x86_64)libgcc-4.1.2-54.el5(i386)libstdc+-4.1.2-54.el5(x86_64)libstdc+-4.1.2-54.el5(i386)libstdc+-devel-4.1.2-54.el5(x86_64)libstdc+-devel-4.1.2-54.el5(i386)make-3.81-3.el5(x8

19、6_64)pdksh-5.2.14-37.el5_8.1(x86_64)sysstat-7.0.2-12.el5(x86_64)unixODBC-2.2.11-10.el5(i386)unixODBC-2.2.11-10.el5(x86_64)unixODBC-devel-2.2.11-10.el5(x86_64)unixODBC-devel-2.2.11-10.el5(i386)网络配置修改rac1和rac2的network#vi /etc/sysconfig/networkNETWORKING=yesNETWORKING_IPV6=noHOSTNAME=rac1 #此处为主机名GATEWA

20、Y=54#vi /etc/sysconfig/networkNETWORKING=yesNETWORKING_IPV6=noHOSTNAME=rac2GATEWAY=54修改rac1和rac2的hosts#vi /etc/hosts#eth0-Public IP#11 rac112 rac2#eth1PRIVATE IP#11 rac1-priv12 rac2-priv#VIP#11 rac1-vip12 rac2-vip#SCAN#00 rac-cluster-scan重启rac1和rac2网络服务#service network restart配置虚拟IP#ifconfig eth0:0

21、11 netmask up#ifconfig eth0:0 12 netmask up*注：虚拟IP在重启网络服务会被卸载，需要重新设置。配置NTPD服务NTPD服务为Grid的检查项，提供时间同步服务。修改NTPD参数文件（rac1，rac2）#vi /etc/sysconfig/ntpdSYNC_HWCLOCK=yesOPTIONS=-x -u ntp:ntp -p /var/run/ntpd.pid修改rac1的ntpd.conf文件，删除原有内容录入以下内容#cp /etc/ntp.conf /etc/ntp.conf.bak#vi /etc/ntp.confrestrict mask

22、 nomodifyserverfudge stratum 10restrict driftfile /var/lib/ntp/driftbroadcastdelay 0.008authenticate nokeys /etc/ntp/keys清空rac1的ntpservers原有内容#cp /etc/ntp/ntpservers /etc/ntp/ntpservers.bak#vi /etc/ntp/ntpservers编辑rac1的step-tickers，添加一行#cp /etc/ntp/step-tickers /etc/ntp/step-tickers.bak#vi /etc/ntp/

23、step-tickers修改rac2的ntpd.conf文件，删除原有内容录入以下内容#cp /etc/ntp.conf /etc/ntp.conf.bak#vi /etc/ntp.confrestrict mask nomodifyserverserver11fudge stratum 10driftfile /var/lib/ntp/driftbroadcastdelay 0.008authenticate nokeys /etc/ntp/keys清空rac2的ntpservers原有内容#cp /etc/ntp/ntpservers /etc/ntp/ntpservers.bak#vi

24、/etc/ntp/ntpservers编辑rac2的step-tickers，添加一行#cp /etc/ntp/step-tickers /etc/ntp/step-tickers.bak#vi /etc/ntp/step-tickers11#rac1的ip地址rac1节点重启NTPD服务#service ntpd restartrac2节点停止NTPD服务，rac1重启NTPD服务后5、6分钟再执行#service ntpd stop#ntpdate rac1#service ntpd startNTPD启用自动加载（rac1，rac2）#chkconfig ntpd on关闭服务关闭rac

25、1和rac2无用的sendmail和cups服务，加快开机速度。#chkconfig sendmail off#chkconfig cups off用户、用户组创建用户和用户组#groupadd -g 501 oinstall#groupadd -g 502 dba#groupadd -g 504 asmadmin#groupadd -g 506 asmdba#groupadd -g 507 asmoper#useradd -u 501 -g oinstall -G dba,asmadmin,asmdba,asmoper grid#useradd -u 502 -g oinstall -G d

26、ba,asmdba oracle#id oracle#id grid修改用户密码#passwd oracle#passwd grid文件夹及权限#mkdir -p /u01/app/grid/#mkdir -p /u01/app/11.2.0/grid/product/db_1#mkdir -p /u01/app/oraInventory#chown -R grid:oinstall /u01/app#mkdir -p /u01/app/oracle/product/11.2.0/db_1#chown -R oracle:oinstall /u01/app/oracle#chmod -R 77

27、5 /u01修改系统参数修改rac1和rac2的limits.conf#vi /etc/security/limits.conf#ORACLE SETTINGgrid soft nproc 2047grid hard nproc 16384grid soft nofile 1024grid hard nofile 65536oracle soft nproc 2047oracle hard nproc 16384oracle soft nofile 1024oracle hard nofile 65536修改rac1和rac2的/etc/pam.d/login#vi /etc/pam.d/lo

28、gin#ORACLE SETTINGsession required pam_limits.so修改rac1和rac2的/etc/sysctl.conf#vi /etc/sysctl.conf#ORACLE SETTINGfs.aio-max-nr = 1048576fs.file-max = 6815744kernel.shmall = 2097152kernel.shmmax = 536870912kernel.shmmni = 4096kernel.sem = 250 32000 100 128net.ipv4.ip_local_port_range = 9000 65500net.co

29、re.rmem_default = 262144net.core.rmem_max = 4194304net.core.wmem_default = 262144net.core.wmem_max = 1048586执行命令(rac1、rac2)#sysctl -p修改rac1和rac2的profile，在末尾添加#vi /etc/profileif $USER = oracle | $USER = grid ; thenif $SHELL = /bin/ksh ; thenulimit -p 16384ulimit -n 65536elseulimit -u 16384 -n 65536fi

30、umask 022 fi执行命令(rac1、rac2)#source /etc/profile修改rac1和rac2的/etc/csh.login#vi /etc/csh.loginif ( $USER = oracle | $USER = grid ) thenlimit maxproc 16384limit descriptors 65536endifEOFCSH修改grid用户的环境变量#su - grid$cd /home/grid/$vi .bash_profileTMP=/tmp; export TMPTMPDIR=$TMP; export TMPDIRORACLE_SID=+AS

31、M1; export ORACLE_SIDORACLE_BASE=/u01/app/grid; export ORACLE_BASEORACLE_HOME=/u01/app/11.2.0/grid/product/db_1; export ORACLE_HOMENLS_DATE_FORMAT=yyyy-mm-dd HH24:MI:SS; export NLS_DATE_FORMATTHREADS_FLAG=native; export THREADS_FLAGPATH=$ORACLE_HOME/bin:$PATH; export PATHTHREADS_FLAG=native; export

32、THREADS_FLAGPATH=$ORACLE_HOME/bin:$PATH; export PATHif $USER = oracle | $USER = grid ; thenif $SHELL = /bin/ksh ; thenulimit -p 16384ulimit -n 65536elseulimit -u 16384 -n 65536fi umask 022fi#su - grid$cd /home/grid/$vi .bash_profileTMP=/tmp; export TMPTMPDIR=$TMP; export TMPDIRORACLE_SID=+ASM2; expo

33、rt ORACLE_SIDORACLE_BASE=/u01/app/grid; export ORACLE_BASEORACLE_HOME=/u01/app/11.2.0/grid/product/db_1; export ORACLE_HOMENLS_DATE_FORMAT=yyyy-mm-dd HH24:MI:SS; export NLS_DATE_FORMATTHREADS_FLAG=native; export THREADS_FLAGPATH=$ORACLE_HOME/bin:$PATH; export PATHTHREADS_FLAG=native; export THREADS_

34、FLAGPATH=$ORACLE_HOME/bin:$PATH; export PATHif $USER = oracle | $USER = grid ; thenif $SHELL = /bin/ksh ; thenulimit -p 16384ulimit -n 65536elseulimit -u 16384 -n 65536fi umask 022fi执行命令(rac1、rac2)$source .bash_profile修改oracle用户的环境变量#su - oracle$cd /home/oracle/$vi .bash_profile# Oracle Settings ora

35、cleTMP=/tmp; export TMPTMPDIR=$TMP; export TMPDIRORACLE_BASE=/u01/app/oracle; export ORACLE_BASEORACLE_HOME=$ORACLE_BASE/product/11.2.0/db_1; export ORACLE_HOMEORACLE_SID=orcl1; export ORACLE_SIDORACLE_TERM=xterm; export ORACLE_TERMPATH=/usr/sbin:$PATH; export PATHPATH=$ORACLE_HOME/bin:$PATH; export

36、 PATHLD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib; export LD_LIBRARY_PATHCLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib; export CLASSPATHNLS_DATE_FORMAT=yyyy-mm-dd HH24:MI:SS; export NLS_DATE_FORMATNLS_LANG=AMERICAN_AMERICA.ZHS16GBK;export NLS_LANGif $USER = oracle | $USER =

37、grid ; thenif $SHELL = /bin/ksh ; thenulimit -p 16384ulimit -n 65536elseulimit -u 16384 -n 65536fiumask 022fi#su - grid$cd /home/grid/$vi .bash_profile# Oracle Settings oracleTMP=/tmp; export TMPTMPDIR=$TMP; export TMPDIRORACLE_BASE=/u01/app/oracle; export ORACLE_BASEORACLE_HOME=$ORACLE_BASE/product

38、/11.2.0/db_1; export ORACLE_HOMEORACLE_SID=orcl2; export ORACLE_SIDORACLE_TERM=xterm; export ORACLE_TERMPATH=/usr/sbin:$PATH; export PATHPATH=$ORACLE_HOME/bin:$PATH; export PATHLD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib; export LD_LIBRARY_PATHCLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_

39、HOME/rdbms/jlib; export CLASSPATHNLS_DATE_FORMAT=yyyy-mm-dd HH24:MI:SS; export NLS_DATE_FORMATNLS_LANG=AMERICAN_AMERICA.ZHS16GBK;export NLS_LANGif $USER = oracle | $USER = grid ; thenif $SHELL = /bin/ksh ; thenulimit -p 16384ulimit -n 65536elseulimit -u 16384 -n 65536fiumask 022fi执行命令(rac1、rac2)$sou

40、rce .bash_profile配置用户等效性使用Oracle用户，在所有节点执行#su - oracle$ssh-keygen -t rsaGenerating public/private rsa key pair.Enter file in which to save the key (/home/oracle/.ssh/id_rsa): Created directory /home/oracle/.ssh.Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identificat

41、ion has been saved in /home/oracle/.ssh/id_rsa.Your public key has been saved in /home/oracle/.ssh/id_rsa.pub.The key fingerprint is:be:8b:34:fd:c9:34:a7:2f:d2:f7:d9:30:1f:2e:48:d6 oraclerac1$ssh-keygen -t dsaGenerating public/private dsa key pair.Enter file in which to save the key (/home/oracle/.s

42、sh/id_dsa): Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /home/oracle/.ssh/id_dsa.Your public key has been saved in /home/oracle/.ssh/id_dsa.pub.The key fingerprint is:4f:bc:4b:9a:a6:cd:1c:15:e7:67:92:94:a2:cd:50:14 oraclerac1使用Oracle

43、用户，在节点rac1执行$cat /home/oracle/.ssh/*.pub /home/oracle/.ssh/authorized_keys$ssh rac2 cat /home/oracle/.ssh/*.pub /home/oracle/.ssh/authorized_keys $scp /home/oracle/.ssh/authorized_keys rac2:/home/oracle/.ssh/authorized_keys验证Oracle用户等效性，在所有节点执行$ssh rac2 date$ssh rac1 date$ssh rac2-vip date$ssh rac1-

44、vip date$ssh rac2-priv date$ssh rac1-priv dates使用grid用户，在所有节点执行#su - grid$ssh-keygen -t rsaGenerating public/private rsa key pair.Enter file in which to save the key (/home/grid/.ssh/id_rsa): Created directory /home/grid/.ssh.Enter passphrase (empty for no passphrase): Enter same passphrase again: Y

45、our identification has been saved in /home/grid/.ssh/id_rsa.Your public key has been saved in /home/grid/.ssh/id_rsa.pub.The key fingerprint is:39:1c:f5:9b:76:e1:de:20:40:e0:e8:20:77:fa:cd:97 gridrac1$ssh-keygen -t dsaGenerating public/private dsa key pair.Enter file in which to save the key (/home/

46、grid/.ssh/id_dsa): Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /home/grid/.ssh/id_dsa.Your public key has been saved in /home/grid/.ssh/id_dsa.pub.The key fingerprint is:08:a4:1b:87:89:fb:cd:93:3f:5d:f8:7b:f6:67:dd:4c gridrac1使用grid用

47、户，在节点rac1执行$ cat /home/grid/.ssh/*.pub /home/grid/.ssh/authorized_keys$ssh rac2 cat /home/grid/.ssh/*.pub /home/grid/.ssh/authorized_keys$scp /home/grid/.ssh/authorized_keys rac2:/home/grid/.ssh/authorized_keys验证grid用户等效性，在所有节点执行$ssh rac2 date$ssh rac1 date$ssh rac2-vip date$ssh rac1-vip date$ssh ra

48、c2-priv date$ssh rac1-priv dates重启rac1、rac2#reboot安装ASM检查系统及内核版本#uname aLinux rac2 2.6.18-164.el5 #1 SMP Tue Aug 18 15:51:48 EDT 2009 x86_64 x86_64 x86_64 GNU/Linux#lsb_release aLSBVersion: :core-3.1-amd64:core-3.1-ia32:core-3.1-noarch:graphics-3.1-amd64:graphics-3.1-ia32:graphics-3.1-noarchDistribu

49、tor ID: RedHatEnterpriseServerDescription: Red Hat Enterprise Linux Server release 5.4 (Tikanga)Release: 5.4Codename: Tikanga下载与系统及内核版本对应的ASM下载地址：/technetwork/server-storage/linux/downloads/index.html当前版本：oracleasm-2.6.18-164.el5-2.0.5-1.el5.x86_64oracleasm-2.6.18-164.el5debug-2.0.5-1.el5.x86_64orac

50、leasm-2.6.18-164.el5-debuginfo-2.0.5-1.el5.x86_64oracleasm-2.6.18-164.el5xen-2.0.5-1.el5.x86_64oracleasmlib-2.0.4-1.el5.x86_64oracleasm-support-2.1.8-1.el5.x86_64安装asm包，按顺序安装#rpm -ivh -nodeps oracleasmlib-2.0.4-1.el5.x86_64.rpm#rpm -ivh -nodeps oracleasm-support-2.1.8-1.el5.x86_64.rpm#rpm -ivh -node

51、ps oracleasm-2.6.18-164.el5-2.0.5-1.el5.x86_64.rpm#rpm -ivh -nodeps oracleasm-2.6.18-164.el5-debuginfo-2.0.5-1.el5.x86_64.rpm#rpm -ivh -nodeps oracleasm-2.6.18-164.el5debug-2.0.5-1.el5.x86_64.rpm#rpm -ivh -nodeps oracleasm-2.6.18-164.el5xen-2.0.5-1.el5.x86_64.rpm初始化asmlib，在所有节点执行#/usr/sbin/oracleasm

52、 configure -iConfiguring the Oracle ASM library driver. This will configure the on-boot properties of the Oracle ASM library driver. The following questions will determine whether the driver is loaded on boot and what permissions it will have. The current valueswill be shown in brackets (). Hitting

53、without typing an answer will keep that current value. Ctrl-C will abort. Default user to own the driver interface : gridDefault group to own the driver interface : asmadminStart Oracle ASM library driver on boot (y/n) n: yScan for Oracle ASM disks on boot (y/n) y: yWriting Oracle ASM library driver

54、 configuration: doneASMlib加载到内核，在所有节点执行#/usr/sbin/oracleasm init创建 asm 磁盘，在节点rac1执行#/usr/sbin/oracleasm createdisk OCR_VOL1 /dev/sdb1#/usr/sbin/oracleasm createdisk OCR_VOL2 /dev/sdc1#/usr/sbin/oracleasm createdisk OCR_VOL3 /dev/sdd1#/usr/sbin/oracleasm createdisk DATA_VOL1 /dev/sde1#/usr/sbin/oracl

55、easm createdisk BACK_VOL1 /dev/sdf1rac2节点执行#/usr/sbin/oracleasm scandisks#/usr/sbin/oracleasm listdisks安装Oracle Grid安装cvuqdisk(rac1，rac2)#export CVUQDISK_GRP=oinstall#rpm -ivh ./grid/rpm/cvuqdisk-1.0.7-1.rpm使用grid用户，进行oracle grid 安装前检查#su - grid$cd /Grid安装目录$./runcluvfy.sh stage -pre crsinst -n rac1

56、,rac2 -fixup -verbose.检查内容略Pre-check for cluster services setup was successful.更改DISPLAY设置#su - root#xhost +#DISPLAY=:0.0; export DISPLAY#su - grid$xhost +更改SELinxu设置# system-config-securitylevel执行安装Grid#su - grid$./runInstaller安装方式安装类型产品语言集群信息节点信息指定网络接口用法存储选项信息创建ASM磁盘组指定ASM口令，使用统一口令：Nortek123故障隔离支持

57、角色分配指定安装路径创建产品清单安装检测安装概要正在安装以root用户在rac1和rac2运行脚本#chcon -t texrel_shlib_t /u01/app/11.2.0/grid/product/db_1/lib/libclntsh.so.11.1Oracle Cluster Verification Utility失败可以忽略Oracle Grid安装完成确认安装成功$crs_stat -t -v配置ASM磁盘组启动ASM磁盘组创建向导，点击新建；#su -grid$asmca创建DATA磁盘组创建BACK磁盘组创建完成安装Oracle11G启动oracle安装程序#su - or

58、acle$cd /oracle11G安装目录$./runInstaller &仅安装数据库软件选择两个节点添加简体中文选择企业版默认安装目录默认用户分配安装前检查安装概要执行安装用户root在rac1和rac2执行脚本Oracle软件安装成功创建数据库启动数据库创建向导#su - oracle$dbca创建数据库安装一般用途数据库填写数据库名称，选择两个节点使用默认选项使用统一口令（orcl）选择数据文件存储路径选择+DATA输入ASM口令（Nortek123）选择归档模式，添加归档参数添加参数“+BACK/”使用默认设置设置数据库参数SGA（注：SGA不可大于/dev/shm）选择数据库字符

59、集（utf8，根据需求）安装概述点击Finish设置完毕点击OK，开始安装正在安装数据库创建成功创建表空间#su - oracle$sqlplus sys/orclorcl as sysdbaSQL create tablespace imatrix datafile +DATA/orcl/imatrix.dbf size 100M autoextend on next 10M segment space management auto extent management local;创建用户并指定默认表空间SQL create user jwj identified by jwj defau

60、lt tablespace imatrix;用户分权SQLgrant dba,connect,resource,create table,create session to jwj;日常维护RAC的启停关闭crsctl stop cluster 停止本节点集群服务crsctl stop cluster all停止所有节点服务启动crsctl start cluster 停止本节点集群服务crsctl start cluster all停止所有节点服务RAC检查运行状态crsctl check clusterDATABASE检查实例状态srvctl status database -d orcl