ORACLE11G-RAC集群安装使用说明文档

环境描述软件环境软件名称版本虚拟机Virtual Box 4.2.12操作系统RedHat-Server-5.5-i386数据库ORACLE11GR2虚拟机设置主机名称虚拟机设置cyknode1本地磁盘120G本地磁盘230G网络连接1桥接网络连接2HOST-ONLY内存1580Mcyknode2本地磁盘120G本地磁盘230G网络连接1桥接网络连接2HOST-ONLY内存1580M共享磁盘20GIP地址分配列表名称IP地址cyknode1192.168.8.214cyknode1-vip192.168.8.216cyknode1-priv10.10.10.11cyknode2192.168.8.215cyknode2-vip192.168.8.217cyknode2-priv10.10.10.12cykrac_scan192.168.8.218共享磁盘分区列表用途分区大小COR+VOTE/dev/sdc11G/dev/sdc21G/dev/sdc31GDATABASE/dev/sdc56G/dev/sdc66GRECOVERY AREA/dev/sdc72G/dev/sdc82G虚拟机硬盘目录结构图目录名称用途rac1主机cyknode1的30G本地磁盘rac2主机cyknode2的30G本地磁盘sharedsk20G共享磁盘硬件环境检测检查项检查方法内存grep -i memtotal /proc/meminfoSwap空间/sbin/swapon -sRAC安装步骤虚拟机设置1. 导入虚拟机cyknode1(里面仅有RedHat操作系统)2导入虚拟机cyknode2(里面仅有RedHat操作系统)2. 主机cyknode1添加一个30G的本地磁盘点击”添加虚拟硬盘”点击”Create new disk”默认选择VDI，点击下一步选择”Dynamically allocated”，点击下一步选择新增的虚拟硬盘的位置，设置大小为30G，点击下一步点击”Create”开始创建新的虚拟硬盘主机cyknode1新的虚拟硬盘创建完毕3. 主机cyknode2添加一个30G的本地磁盘新增虚拟硬盘点击”Create new disk”默认选择VDI，点击下一步选择”Dynamically allocated”,点击下一步选择新增的虚拟硬盘的位置，设置虚拟硬盘大小，点击下一步点击”Create”，创建虚拟硬盘主机cyknode2的虚拟硬盘创建完毕4. 添加一个20G的共享磁盘在主机cyknode1上添加虚拟硬盘点击”Create new disk”默认选择VDI，点击下一步选择”Fixed size”，点击下一步选择虚拟硬盘的位置，设置大小，点击下一步确认摘要信息无误，点击”Create”虚拟硬盘创建完毕打开”虚拟介质管理器”，选择刚才增加的共享盘share_Disk1.vid，点击modify将medium type设置为”Shareable”，点击确定点击close关闭虚拟介质管理器在主机”cyknode2”，添加虚拟硬盘点击”Choose existing disk”，选择在cyknode1中创建的虚拟硬盘share_Disk1.vdi主机cyknode2的虚拟共享磁盘添加完毕5. 更改主机cyknode1的网络连接设置cyknode1公共网卡的网络连接方式设置cyknode1私有网卡的网络连接方式6. 更改主机cyknode2的网络连接设置cyknode2公共网卡的网络连接方式设置cyknode2私有网卡的网络连接方式网络与主机名配置1 更改主机cyknode1的/etc/sysconfig/network -不用设置网关NETWORKING=yesNETWORKING_IPV6=noHOSTNAME=cyknode12 更改主机cyknode1的/etc/sysconfig/network-scripts/ifcfg-eth0-这个文件不需要配置MAC地址DEVICE=eth0BOOTPROTO=staticIPADDR=192.168.8.214NETMASK=255.255.255.0GATEWAY=192.168.8.1ONBOOT=yes3 更改主机cyknode1的/etc/sysconfig/network-scripts/ifcfg-eth1-内部通信的私有IP不用设置网关-这个文件不需要配置MAC地址DEVICE=eth1BOOTPROTO=staticIPADDR=10.10.10.11NETMASK=255.255.255.0ONBOOT=yes4 使用service network restart重启cyknode1的网络服务。也可以重启reahat使新主机名一并生效5 更改主机cyknode2的/etc/sysconfig/network -不用设置网关NETWORKING=yesNETWORKING_IPV6=noHOSTNAME=cyknode26 更改主机cyknode2的/etc/sysconfig/network-scripts/ifcfg-eth0-这个文件不需要配置MAC地址DEVICE=eth0BOOTPROTO=staticIPADDR=192.168.8.215NETMASK=255.255.255.0GATEWAY=192.168.8.1ONBOOT=yes7 更改主机cyknode2的/etc/sysconfig/network-scripts/ifcfg-eth1-内部通信的私有IP不用设置网关-这个文件不需要配置MAC地址DEVICE=eth1BOOTPROTO=staticIPADDR=10.10.10.12NETMASK=255.255.255.0ONBOOT=yes8 使用service network restart重启cyknode2的网络服务。也可以重启reahat使新主机名一并生效对磁盘进行分区1 查看主机cyknode1的磁盘分区rootcyknode1 # fdisk -lDisk /dev/sda: 21.4 GB, 21474836480 bytes255 heads, 63 sectors/track, 2610 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sda1 * 1 13 104391 83 Linux/dev/sda2 14 2610 20860402+ 8e Linux LVMDisk /dev/sdb: 32.2 GB, 32212254720 bytes255 heads, 63 sectors/track, 3916 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesDisk /dev/sdb doesnt contain a valid partition tableDisk /dev/sdc: 21.4 GB, 21474836480 bytes255 heads, 63 sectors/track, 2610 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesDisk /dev/sdc doesnt contain a valid partition table2 对主机cyknode1的磁盘sdb进行分区(只分一个分区)rootcyknode1 # fdisk /dev/sdbDevice contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabelBuilding a new DOS disklabel. Changes will remain in memory only,until you decide to write them. After that, of course, the previouscontent wont be recoverable.The number of cylinders for this disk is set to 3916.There is nothing wrong with that, but this is larger than 1024,and could in certain setups cause problems with:1) software that runs at boot time (e.g., old versions of LILO)2) booting and partitioning software from other OSs (e.g., DOS FDISK, OS/2 FDISK)Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)Command (m for help): mCommand action a toggle a bootable flag b edit bsd disklabel c toggle the dos compatibility flag d delete a partition l list known partition types m print this menu n add a new partition o create a new empty DOS partition table p print the partition table q quit without saving changes s create a new empty Sun disklabel t change a partitions system id u change display/entry units v verify the partition table w write table to disk and exit x extra functionality (experts only)Command (m for help): nCommand action e extended p primary partition (1-4)pPartition number (1-4): 1First cylinder (1-3916, default 1): Using default value 1Last cylinder or +size or +sizeM or +sizeK (1-3916, default 3916): Using default value 3916Command (m for help): pDisk /dev/sdb: 32.2 GB, 32212254720 bytes255 heads, 63 sectors/track, 3916 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sdb1 1 3916 31455238+ 83 LinuxCommand (m for help): wThe partition table has been altered!Calling ioctl() to re-read partition table.Syncing disks.rootcyknode1 # fdisk -lDisk /dev/sda: 21.4 GB, 21474836480 bytes255 heads, 63 sectors/track, 2610 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sda1 * 1 13 104391 83 Linux/dev/sda2 14 2610 20860402+ 8e Linux LVMDisk /dev/sdb: 32.2 GB, 32212254720 bytes255 heads, 63 sectors/track, 3916 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sdb1 1 3916 31455238+ 83 LinuxDisk /dev/sdc: 21.4 GB, 21474836480 bytes255 heads, 63 sectors/track, 2610 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesDisk /dev/sdc doesnt contain a valid partition table3 对主机cyknode1的sdb1分区进行格式化rootcyknode1 # mkfs.ext3 /dev/sdb1mke2fs 1.39 (29-May-2006)Filesystem label=OS type: LinuxBlock size=4096 (log=2)Fragment size=4096 (log=2)3932160 inodes, 7863809 blocks393190 blocks (5.00%) reserved for the super userFirst data block=0Maximum filesystem blocks=0240 block groups32768 blocks per group, 32768 fragments per group16384 inodes per groupSuperblock backups stored on blocks: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, 4096000Writing inode tables: done Creating journal (32768 blocks): doneWriting superblocks and filesystem accounting information: doneThis filesystem will be automatically checked every 35 mounts or180 days, whichever comes first. Use tune2fs -c or -i to override.4 对主机cyknode1的sdb1分区进行挂载rootcyknode1 # ls /u01rootcyknode1 # mount /dev/sdb1 /u01rootcyknode1 # df -hFilesystem Size Used Avail Use% Mounted on/dev/mapper/VolGroup00-LogVol00 18G 6.1G 11G 38% /dev/sda1 99M 12M 82M 13% /boottmpfs 782M 0 782M 0% /dev/shm/dev/sdb1 30G 173M 28G 1% /u01-参数说明:文件系统,挂载点,文件系统类型,权限,开机是否检测,是否做fsck检测rootcyknode1 # vi /etc/fstab/dev/VolGroup00/LogVol00 / ext3 defaults 1 1LABEL=/boot /boot ext3 defaults 1 2tmpfs /dev/shm tmpfs defaults 0 0devpts /dev/pts devpts gid=5,mode=620 0 0sysfs /sys sysfs defaults 0 0proc /proc proc defaults 0 0/dev/VolGroup00/LogVol01 swap swap defaults 0 0/dev/sdb1 /u01 ext3 defaults 0 0rootcyknode1 # umount /u01rootcyknode1 # mount /u01rootcyknode1 # df -hFilesystem Size Used Avail Use% Mounted on/dev/mapper/VolGroup00-LogVol00 18G 6.1G 11G 38% /dev/sda1 99M 12M 82M 13% /boottmpfs 782M 0 782M 0% /dev/shm/dev/sdb1 30G 173M 28G 1% /u015 对主机cyknode2的磁盘sdb进行分区(只分一个分区)rootcyknode2 # fdisk -lDisk /dev/sda: 8589 MB, 8589934592 bytes255 heads, 63 sectors/track, 1044 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sda1 * 1 13 104391 83 Linux/dev/sda2 14 1044 8281507+ 8e Linux LVMDisk /dev/sdb: 32.2 GB, 32212254720 bytes255 heads, 63 sectors/track, 3916 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesDisk /dev/sdb doesnt contain a valid partition tableDisk /dev/sdc: 21.4 GB, 21474836480 bytes255 heads, 63 sectors/track, 2610 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesDisk /dev/sdc doesnt contain a valid partition tablerootcyknode2 # fdisk /dev/sdbDevice contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabelBuilding a new DOS disklabel. Changes will remain in memory only,until you decide to write them. After that, of course, the previouscontent wont be recoverable.The number of cylinders for this disk is set to 3916.There is nothing wrong with that, but this is larger than 1024,and could in certain setups cause problems with:1) software that runs at boot time (e.g., old versions of LILO)2) booting and partitioning software from other OSs (e.g., DOS FDISK, OS/2 FDISK)Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)Command (m for help): mCommand action a toggle a bootable flag b edit bsd disklabel c toggle the dos compatibility flag d delete a partition l list known partition types m print this menu n add a new partition o create a new empty DOS partition table p print the partition table q quit without saving changes s create a new empty Sun disklabel t change a partitions system id u change display/entry units v verify the partition table w write table to disk and exit x extra functionality (experts only)Command (m for help): nCommand action e extended p primary partition (1-4)pPartition number (1-4): 1First cylinder (1-3916, default 1): Using default value 1Last cylinder or +size or +sizeM or +sizeK (1-3916, default 3916): Using default value 3916Command (m for help): wThe partition table has been altered!Calling ioctl() to re-read partition table.Syncing disks.rootcyknode2 # fdisk -lDisk /dev/sda: 8589 MB, 8589934592 bytes255 heads, 63 sectors/track, 1044 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sda1 * 1 13 104391 83 Linux/dev/sda2 14 1044 8281507+ 8e Linux LVMDisk /dev/sdb: 32.2 GB, 32212254720 bytes255 heads, 63 sectors/track, 3916 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sdb1 1 3916 31455238+ 83 LinuxDisk /dev/sdc: 21.4 GB, 21474836480 bytes255 heads, 63 sectors/track, 2610 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesDisk /dev/sdc doesnt contain a valid partition table6 对主机cyknode2的sdb1分区进行格式化rootcyknode2 # mkfs.ext3 /dev/sdb1mke2fs 1.39 (29-May-2006)Filesystem label=OS type: LinuxBlock size=4096 (log=2)Fragment size=4096 (log=2)3932160 inodes, 7863809 blocks393190 blocks (5.00%) reserved for the super userFirst data block=0Maximum filesystem blocks=0240 block groups32768 blocks per group, 32768 fragments per group16384 inodes per groupSuperblock backups stored on blocks: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, 4096000Writing inode tables: done Creating journal (32768 blocks): doneWriting superblocks and filesystem accounting information: doneThis filesystem will be automatically checked every 38 mounts or180 days, whichever comes first. Use tune2fs -c or -i to override.7 对主机cyknode2的sdb1分区进行挂载rootcyknode2 # ls /u01rootcyknode2 # vi /etc/fstab/dev/VolGroup00/LogVol00 / ext3 defaults 1 1LABEL=/boot /boot ext3 defaults 1 2tmpfs /dev/shm tmpfs defaults 0 0devpts /dev/pts devpts gid=5,mode=620 0 0sysfs /sys sysfs defaults 0 0proc /proc proc defaults 0 0/dev/VolGroup00/LogVol01 swap swap defaults 0 0/dev/sdb1 /u01 ext3 defaults 0 0rootcyknode2 # mount /u01创建用户及用户组1 对主机cyknode1与cyknode2创建用户-两个节点的用户与组的ID号必须一致groupadd -g 200 oinstallgroupadd -g 201 dbagroupadd -g 202 opergroupadd -g 203 asmadmingroupadd -g 204 asmopergroupadd -g 205 asmdbauseradd -u 200 -g oinstall -G dba,asmdba,oper oracleuseradd -u 201 -g oinstall -G asmadmin,asmdba,asmoper,oper,dba grid-设置用户密码rootcyknode1 # passwd oracleChanging password for user oracle.New UNIX password: BAD PASSWORD: it is too simplistic/systematicRetype new UNIX password: passwd: all authentication tokens updated successfully.rootcyknode1 # passwd gridChanging password for user grid.New UNIX password: BAD PASSWORD: it is too simplistic/systematicRetype new UNIX password: passwd: all authentication tokens updated successfully.2分别在主机cyknode1与cyknode2的/u01下创建相应目录-创建目录完毕之后，注意检查目录的所属用户及组mkdir -p /u01/app/oraInventorychown -R grid:oinstall /u01/app/oraInventory/chmod -R 775 /u01/app/oraInventory/mkdir -p /u01/11.2.0/gridchown -R grid:oinstall /u01/11.2.0/grid/chmod -R 775 /u01/11.2.0/grid/mkdir -p /u01/app/oraclemkdir -p /u01/app/oracle/cfgtoollogsmkdir -p /u01/app/oracle/product/11.2.0/db_1chown -R oracle:oinstall /u01/app/oraclechmod -R 775 /u01/app/oracle3修改主机cyknode1的oracle用户环境变量-注意设置ORACLE_SIDrootcyknode1 # su - oracleoraclecyknode1 $ vi .bash_profilePATH=$PATH:$HOME/bin# .bash_profile# Get the aliases and functionsif -f /.bashrc ; then . /.bashrcfi# User specific environment and startup programsexport EDITOR=viexport ORACLE_SID=prod1export ORACLE_BASE=/u01/app/oracleexport ORACLE_HOME=$ORACLE_BASE/product/11.2.0/db_1export LD_LIBRARY_PATH=$ORACLE_HOME/libexport PATH=$ORACLE_HOME/bin:/bin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/X11R6/binumask 0224修改主机cyknode2的oracle用户的环境变量-注意设置ORACLE_SIDrootcyknode2 # su - oracleoraclecyknode2 $ vi .bash_profile# .bash_profilePATH=$PATH:$HOME/bin# Get the aliases and functionsif -f /.bashrc ; then . /.bashrcfi# User specific environment and startup programsexport EDITOR=viexport ORACLE_SID=prod2export ORACLE_BASE=/u01/app/oracleexport ORACLE_HOME=$ORACLE_BASE/product/11.2.0/db_1export LD_LIBRARY_PATH=$ORACLE_HOME/libexport PATH=$ORACLE_HOME/bin:/bin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/X11R6/binumask 0225修改主机cyknode1的grid用户环境变量-注意更改ORACLE_SID-grid用户的环境变量中,GRID_HOME与ORACLE_HOME两个环境变量二选一即可,建议选择GRID_HOME,在本文档中,这两个环境变量都设置了同样的值oraclecyknode1 $ su - gridPassword: gridcyknode1 $ vi .bash_profile# .bash_profile# Get the aliases and functionsif -f /.bashrc ; then . /.bashrcfi# User specific environment and startup programsexport EDITOR=viexport ORACLE_SID=+ASM1export ORACLE_BASE=/u01/app/oracleexport ORACLE_HOME=/u01/11.2.0/gridexport GRID_HOME=/u01/11.2.0/gridexport LD_LIBRARY_PATH=$ORACLE_HOME/libexport THREADS_FLAG=nativeexport PATH=$ORACLE_HOME/bin:/bin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/X11R6/binumask 0226修改主机cyknode2的grid用户环境变量-注意更改ORACLE_SIDoraclecyknode2 $ su - gridPassword: gridcyknode2 $ vi .bash_profilePATH=$PATH:$HOME/bin# .bash_profile# Get the aliases and functionsif -f /.bashrc ; then . /.bashrcfi# User specific environment and startup programsexport EDITOR=viexport ORACLE_SID=+ASM2export ORACLE_BASE=/u01/app/oracleexport ORACLE_HOME=/u01/11.2.0/gridexport GRID_HOME=/u01/11.2.0/gridexport LD_LIBRARY_PATH=$ORACLE_HOME/libexport THREADS_FLAG=nativeexport PATH=$ORACLE_HOME/bin:/bin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/X11R6/binumask 022修改hosts文件1配置主机cyknode1的hosts文件-vip的ip地址只有在安装完CRS，启动集群服务之后才能访问rootcyknode1 # su - rootrootcyknode1 # vi /etc/hosts# Do not remove the following line, or various programs# that require network functionality will fail.127.0.0.1 localhost192.168.8.214 cyknode1192.168.8.216 cyknode1-vip10.10.10.11 cyknode1-priv192.168.8.215 cyknode2192.168.8.2