ORACLE11GR2在REDHAT63环境中搭建RAC集群及简单维护

1、.：.；系统环境硬件环境效力器：vmware 10，新建个虚拟机主机名分别为rac1和rac2，每个虚拟机分配40G磁盘空间，添加两个网络适配器。其中第二个适配器网络衔接调整为自定义，且两个节点坚持一致。Widonws本机ip：192.168.6.1软件环境数据库：oracle11.2.0.4 database-x86-64GRID：oracle11.2.0.4_grid-x86-64 操作系统：rhel-server-6.3-x86_64采用最小化安装网络环境Ip地址规划分配为IP 称号子网掩码IP 地址Rac1-public255.255.255.0192.168.6.11Rac2-pub

2、lic255.255.255.0192.168.6.12Rac1-private255.255.255.02.2.2.2Rac2-private255.255.255.02.2.2.3Rac1-vip255.255.255.0192.168.6.13Rac2-vip255.255.255.0192.168.6.14SCAN255.255.255.0192.168.6.15共享磁盘分区方案创建四个共享磁盘sdb、sdc、sdd、sde，每个磁盘方案分三个分区前期环境预备 配置静态地址vi /etc/sysconfig/network-scripts/ifcfg-eth0修正ip地址。每个虚拟机e

3、th0网卡为public，DEVICE=eth0BOOTPROTO=staticHWADDR=00:0C:29:D1:4E:A6NM_CONTROLLED=yesONBOOT=yesTYPE=Ethernet*UUID=e59cb6a0-deb0-4164-a2b0-8b4dcc0cb027IPADDR=192.168.6.11NETMASK=255.255.255.0GATEWAY=192.168.6.1vi /etc/sysconfig/network-scripts/ifcfg-eth1修正ip地址。每个虚拟机eth1网卡位privateDEVICE=eth1BOOTPROTO=stat

4、icHWADDR=00:0C:29:D1:4E:A6NM_CONTROLLED=yesONBOOT=yesTYPE=Ethernet*UUID=e59cb6a0-deb0-4164-a2b0-8b4dcc0cb027IPADDR=2.2.2.2NETMASK=255.255.255.0修正完成后执行service network restart 在rac1和rac2上分别封锁防火墙service iptables stop -停顿防火墙chkconfig iptables off -禁用防火墙 在rac1和rac2上分别修正主机名vi /etc/sysconfig/network 重启生效，一

5、个rac1，另一个rac2HOSTNAME=rac1 在rac1和rac2 上分别改hosts vi /etc/hosts 添加对应的ip信息#public192.168.6.180 rac1192.168.6.181 rac2#private2.2.2.1 rac1-priv2.2.2.2 rac2-priv#virtual192.168.6.182 rac1-vip192.168.6.183 rac2-vip#scan192.168.6.184 cluster-scan 在rac1和rac2上分别执行配置内核参数vi /etc/sysctl.conf参与以下内容fs.aio-max-nr

6、= 1048576fs.file-max = 6815744kernel.shmall = 2147483648kernel.shmmax = 68719476736kernel.shmmni = 4096kernel.sem = 250 32000 100 128net.ipv4.ip_local_port_range = 9000 65500net.core.rmem_default = 262144net.core.rmem_max = 4194304net.core.wmem_default = 262144net.core.wmem_max = 1048586使修正参数立刻生效：sy

7、sctl -p 在rac1和rac2上分别执行修正limitsvi /etc/security/limits.conf参与以下信息grid soft nproc 2047grid hard nproc 16384grid soft nofile 1024grid hard nofile 65536oracle soft nproc 2047oracle hard nproc 16384oracle soft nofile 1024oracle hard nofile 65536 在rac1和rac2上分别修正/etc/pam.d/loginvi /etc/pam.d/login参与以下信息se

8、ssion required /lib/security/pam_limits.so session required pam_limits.so 在rac1和rac2上分别执行修正/etc/profilevi /etc/profile参与以下信息if $USER = oracle | $USER = grid ; thenif $SHELL = /bin/ksh ; thenulimit -p 16384ulimit -n 65536elseulimit -u 16384 -n 65536fiumask 022fi 在rac1和rac2 上分别执行禁用 selinuxvi /etc/seli

9、nux/config修正 SELINUX值SELINUX=disabled 在rac1和rac2上分别执行停顿 ntp 效力service ntpd stopchkconfig ntpd offmv /etc/ntp.conf /etc/ntp.conf.bak 在rac1和rac2上分别处置/dev/shm 共享内存缺乏的处置df -h 查看tmpfs分区能否大于1G，假设过小需添加。vi /etc/fstab 默许的：tmpfs /dev/shm tmpfs defaults 0 0改成：tmpfs /dev/shm tmpfs defaults,size=1024m 0 0mount -

10、o remount /dev/shm 在rac1和rac2上分别检查软件能否全部安装 rpm -qa | grep binutils-rpm -qa | grep compat-libstdc+-rpm -qa | grep elfutils-libelf-rpm -qa | grep elfutils-libelf-devel-rpm -qa | grep glibc-rpm -qa | grep glibc-common-rpm -qa | grep glibc-devel-rpm -qa | grep gcc-rpm -qa | grep gcc-c+-rpm -qa | grep li

11、baio-rpm -qa | grep libaio-devel-rpm -qa | grep libgcc-rpm -qa | grep libstdc+-rpm -qa | grep libstdc+-devel-rpm -qa | grep make-rpm -qa | grep sysstat-rpm -qa | grep unixODBC-rpm -qa | grep unixODBC-devel- 在rac1和rac2 2分别将未安装的包经过yum安装mkdir /yummount /dev/cdrom /yumvi /etc/yum.repos.d/chenbin.repo添加以

12、下内容 rhel-chenbinname=Red Hat Enterprise Linux $releasever - $basearch - Debugbaseurl=file/yum/enabled=1gpgcheck=1gpgkey=file/etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-releaseyum list -查看可用包yum -y install binutils* compat-* elfutils-libelf* gcc-* gcc-* kernel-* ksh-* libaio-* libgcc-* libgomp-* libstdc+-* m

13、ake-* numactl-devel-* sysstat-* unixODBC-* pdksh* 在oradb1和rac2上分别封锁不需求的效力chkconfig autofs offchkconfig acpid offchkconfig sendmail offchkconfig cups-config-daemon offchkconfig cpus offchkconfig xfs offchkconfig lm_sensors offchkconfig gpm offchkconfig openibd offchkconfig pcmcia offchkconfig cpuspee

14、d offchkconfig nfslock offchkconfig ip6tables offchkconfig rpcidmapd offchkconfig apmd offchkconfig sendmail offchkconfig arptables_jf offchkconifg microcode_ctl offchkconfig rpcgssd offchkconfig ntpd off添加组和用户 在rac1和rac2上分别添加oracle和grid用户和组groupadd -g 501 oinstallgroupadd -g 502 dbagroupadd -g 503

15、opergroupadd -g 504 asmadmingroupadd -g 505 asmopergroupadd -g 506 asmdbauseradd -g oinstall -G dba,asmdba,oper oracleuseradd -g oinstall -G asmadmin,asmdba,asmoper,oper,dba grid 在rac1和rac2上分别为oracle和grid用户设密码passwd oraclepasswd grid 在rac1和rac2上分别创建目录grid 和 oracle 用户的mkdir -p /u01/app/oraclemkdir -p

16、 /u01/app/gridmkdir -p /u01/app/11.2.0/gridchown -R grid:oinstall /u01/app/gridchown -R grid:oinstall /u01/app/11.2.0chown -R oracle:oinstall /u01/app/oraclechmod -R 775 /u01mkdir -p /u01/app/oraInventorychown -R grid:oinstall /u01/app/oraInventorychmod -R 775 /u01/app/oraInventory 在rac1和rac2上分别修正or

17、acle用户的.bash_profile文件vi /home/oracle/.bash_profileexport ORACLE_SID=rac1export ORACLE_BASE=/u01/app/oracleexport ORACLE_HOME=$ORACLE_BASE/product/11.2.0/dbhome_1export LD_LIBRARY_PATH=$ORACLE_HOME/libexport NLS_DATE_FORMAT=yyyy-mm-dd HH24:MI:SSexport TMP=/tmpexport TMPDIR=$TMPexport PATH=$PATH:$ORA

18、CLE_HOME/bin 在rac1和rac2上分别修正grid用户的.bash_profile文件vi /home/grid/.bash_profileexport ORACLE_SID=+ASM1export ORACLE_BASE=/u01/app/gridexport ORACLE_HOME=/u01/app/11.2.0/gridexport LD_LIBRARY_PATH=$ORACLE_HOME/libexport NLS_DATE_FORMAT=yyyy-mm-dd HH24:MI:SSexport PATH=$ORACLE_HOME/bin:$PATH留意另外一台数据库实例名

19、须做相应修正：Oracle：export ORACLE_SID=rac2grid：export ORACLE_SID=+ASM2 建立 ssh 等效性可不配置Root用户等效性可不用配置，配置了仅管理效力器方便，gird用户和oracle的ssh等效性由安装程序配置，mkdir /.ssh chmod 755 /.ssh ssh-keygen -t rsassh-keygen -t dsacat /.ssh/id_rsa.pub /.ssh/authorized_keyscat /.ssh/id_dsa.pub /.ssh/authorized_keys在rac1上执行ssh rac2 cat

20、 /.ssh/id_rsa.pub /.ssh/authorized_keys ssh rac2 cat /.ssh/id_dsa.pub /.ssh/authorized_keys在rac2上执行ssh rac1 cat /.ssh/id_rsa.pub /.ssh/authorized_keys ssh rac1 cat /.ssh/id_dsa.pub /.ssh/authorized_keys在两台效力器上验证能否可以正常访问对方，执行时不再提示输入密码，那么表示SSH 对等性配置胜利ssh rac1 datessh rac2 datessh rac1-priv datessh rac

21、2-priv date添加共享磁盘VM 在本机上创建共享磁盘消费环境运用共享存储，直接略过在windows的cmd中进入VMware Workstation安装目录，执行命令创建磁盘：留意创建共享磁盘的途径及文件大小，例如我的VM装在c盘，cd c:Program Files (x86)VMwareVMware Workstationvmware-vdiskmanager.exe -c -s 5g -a lsilogic -t 2 F:shdiskvot.vmdkVmware-vdiskmanager.exe -c -s 2g -a lsilogic -t 2 F:shdiskfra.vmdk

22、vmware-vdiskmanager.exe -c -s 5g -a lsilogic -t 2 F:shdiskdata.vmdkvmware-vdiskmanager.exe -c -s 5g -a lsilogic -t 2 F:shdiskdata1.vmdk 将共享磁盘挂到两台虚拟机封锁两台虚拟机并退出VM，分别用记事本翻开虚拟机安装位置中虚拟机名字. vmx，添加以下内容disk.EnableUUID=TRUEdisk.locking = FALSEscsi1.shared = TRUEdiskLib.dataCacheMaxSize = 0diskLib.dataCacheMa

23、xReadAheadSize = 0diskLib.dataCacheMinReadAheadSize = 0diskLib.dataCachePageSize= 4096diskLib.maxUnsyncedWrites = 0 scsi1.present = TRUEscsi1.virtualDev = lsilogicscsil.sharedBus = VIRTUALscsi1:0.present = TRUEscsi1:0.mode = independent-persistentscsi1:0.fileName = F:shdiskvot.vmdkscsi1:0.deviceType

24、 = diskscsi1:0.redo = scsi1:1.present = TRUEscsi1:1.mode = independent-persistentscsi1:1.fileName = F:shdiskfra.vmdkscsi1:1.deviceType = diskscsi1:1.redo = scsi1:2.present = TRUEscsi1:2.mode = independent-persistentscsi1:2.fileName = F:shdiskdata.vmdkscsi1:2.deviceType = diskscsi1:2.redo = scsi1:3.p

25、resent = TRUEscsi1:3.mode = independent-persistentscsi1:3.fileName = F:shdiskdata1.vmdkscsi1:3.deviceType = diskscsi1:3.redo = 两个虚拟机开机，格式化硬盘，确认能否共享胜利。在rac1上执行fdsik -l -确认看以正常看到sdb,sbc,sdd,sde按前期规划创建分区，分区完成后在rac2 中执行fdisk -l 查询能否同步 在rac1和rac2上分别将裸设备文件和分区设备文件进展绑定vi /etc/udev/rules.d/60-raw.rules 根据磁盘情

26、况修正下面信息参与到文件中ACTION=add, KERNEL=sdb1, RUN+=/bin/raw /dev/raw/raw1 %NACTION=add, KERNEL=sdb2, RUN+=/bin/raw /dev/raw/raw2 %NACTION=add, KERNEL=sdb3, RUN+=/bin/raw /dev/raw/raw3 %NACTION=add, KERNEL=sdc1, RUN+=/bin/raw /dev/raw/raw4 %NACTION=add, KERNEL=sdc2, RUN+=/bin/raw /dev/raw/raw5 %NACTION=add,

27、KERNEL=sdc3, RUN+=/bin/raw /dev/raw/raw6 %NACTION=add, KERNEL=sdd1, RUN+=/bin/raw /dev/raw/raw7 %NACTION=add, KERNEL=sdd2, RUN+=/bin/raw /dev/raw/raw8 %NACTION=add, KERNEL=sdd3, RUN+=/bin/raw /dev/raw/raw9 %NKERNEL=raw0-9, OWNER=grid, GROUP=asmadmin, MODE=0660此处、KERNEL=raw0-9 10以必需单独指定，否那么无效、MODE=06

28、66和GROUP=oinstall的设置，在后面的check会报waring应改为:MODE=0660 GROUP=asmadmin执行：start_udev命令，此处建议重启虚拟机执行 raw -qa查看绑定形状:确保两个节点看以看到一样的内容执行ls -l /dev/raw/查看 裸设备归属权限:安装Grid 在rac1和rac2上分别安装cvuqdisk包在两个 Oracle RAC 节点上安装操作系统程序包 cvuqdisk。cvuqdisk RPM 包含在 Oracle Grid Infrastructure 安装介质上的 rpm 目录中。rpm -ivh cvuqdisk-1.0.

29、7-1.rpm 检查 CRS 的安装环境只需求在其中一个节点的gird用户执行.执行需提早设置好grid、oracle用户ssh等效性，本次不检查./runcluvfy.sh stage -pre crsinst -n rac1,rac2 -verbose未检测经过的显示为failed，根据情况修复一下即可：resolv.conf不一致的DNS问题可以忽略 安装Grid Infrastructure软件 开场安装export DISPLAY=192.168.6.18:0.0 ./runInstaller 言语支持中文 配置Scan name与host文件一致此处的SCAN_NAME与/etc/

30、hosts 文件中的scan地址坚持一致 Grid用户等效性配置点击setup出现提示安装胜利。Next 创建OCR磁盘组设置asm密码 选择grid安装位置Package这个只需确保安装了ksh即可。 Task resolve此项是由于没有运用dns解析scan，可忽略 开场安装 执行脚本在每个效力器上以root身份执行图中的2个脚本，两个节点都执行完成后点OK。/u01/app/oraInventory/orainstRoot.sh/u01/app/grid/11.2.0/root.sh出现以下字样表示在该节点安装胜利Configure Oracle Grid Infrastructure

31、 for a Cluster . succeeded 确认Grid安装 CRS形状crs_stat -t -v除GSD外其他全部为onlinecrsctl stat res -t voting disk形状crsctl query css votedisk# STATE File Universal Id File Name Disk group- 1. ONLINE 7b8903f49cc84fa8bf06d199bdf5dfe3 (ORCL:DISK01) CRSDG 检查Oracle集群注册表(OCR)ocrcheckStatus of Oracle Cluster Registry i

32、s as follows :Version : 3Total space (kbytes) : 262120Used space (kbytes) : 2264Available space (kbytes) : 259856ID : 1510360228Device/File Name : +CRSDGDevice/File integrity check succeededDevice/File not configuredDevice/File not configuredDevice/File not configuredDevice/File not configuredCluste

33、r registry integrity check succeededLogical corruption check bypassed due to non-privileged user 检查CRS形状crsctl check crsCRS-4638: Oracle High Availability Services is onlineCRS-4537: Cluster Ready Services is onlineCRS-4529: Cluster Synchronization Services is onlineCRS-4533: Event Manager is online

34、ASM磁盘组配置 检查监听形状gridrac01 $ lsnrctl status(DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=LISTENER)(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=172.18.3.211)(PORT=1521) (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=172.18.3.213)(PORT=1521)Services Summary.Service +ASM has 1 instance(s).Instance +ASM1, status READY

35、, has 1 handler(s) for this service.The command completed successfully 创建DATA磁盘组以grid用户执行asmca命令，创建DATADG和FRADG两个磁盘组。 创建FLA磁盘组：FLASHDG创建胜利，退出ASMCA。验证：crs_stat -t -v或 crsctl stat res -t安装数据库软件 切换到oracle用户export DISPLAY=192.168.6.18:0.0 ./runInstaller 两个节点安装 oracle用户等效性输入oracle用户密码。点击setup 选择途径 执行root

36、脚本在两个节点上，分别以root身份执行上述脚本，然后点击OK。数据库软件安装完成，点击close退出。 测试数据库安装完成oraclerac1$ sqlplus / as sysdba SQL*Plus: Release 11.2.0.4.0 Production on Wed Oct 1 22:42:56 2021 Copyright (c) 1982, 2021, Oracle. All rights reserved. Connected to an idle instance. SQL运用DBCA创建数据库 运用oracle用户登录，执行dbca 启用em 选择asm磁盘组 选择FR

37、A磁盘组：确定能否启用快速恢复区、归档日志设置最大衔接数 留意选适宜的字符集点击exit完成安装集群数据库维护 一切Oracle实例形状srvctl status database -d oradbInstance rac1is running on node node1Instance rac2 is running on node node2 单个Oracle实例形状srvctl status instance -d oradb -i rac1Instance rac1is running on node node1 节点运用程序形状srvctl status nodeappsVIP no

38、de1-vip is enabledVIP node1-vip is running on node: node1VIP node2-vip is enabledVIP node2-vip is running on node: node2Network is enabledNetwork is running on node: node1Network is running on node: node2GSD is disabledGSD is not running on node: node1GSD is not running on node: node2ONS is enabledO

39、NS daemon is running on node: node1ONS daemon is running on node: node2 节点运用程序配置srvctl config nodeappsNetwork exists: 1/192.168.0.0/255.255.0.0/eth0, type staticVIP exists: /node1-vip/192.168.1.151/192.168.0.0/255.255.0.0/eth0, hosting node node1VIP exists: /node2-vip/192.168.1.152/192.168.0.0/255.2

40、55.0.0/eth0, hosting node node2GSD existsONS exists: Local port 6100, remote port 6200, EM port 2021 数据库配置srvctl config database -d oradb -aDatabase unique name: oradbDatabase name: oradbOracle home: /u01/app/oracle/product/11.2.0/dbhome_1Oracle user: oracleSpfile: +DATADG/oradb/spfileoradb.oraDomai

41、n:Start options: openStop options: immediateDatabase role: PRIMARYManagement policy: AUTOMATICServer pools: oradbDatabase instances: rac1,rac2Disk Groups: DATADG,FRADGMount point paths:Services:Type: RACDatabase is enabledDatabase is administrator managed ASM形状srvctl status asmASM is running on node2,node1 ASM配置srvctl config asm -aASM