虚拟机安装rac.doc

1配置linux环境编辑/etc/hosts文件rootnode1# vi /etc/hosts# Do not remove the following line, or various programs# that require network functionality will fail.# node1 localhost.localdomain localhost localhost01 rac02 rac11 rac1-vip12 rac2-vip rac1-priv rac2-priv配置内核参数vi /etc/sysctl.confkernel.shmall=2097152kernel.shmmax=536870912kernel.shmmni=4096kernel.sem=250 32000 100 128fs.file-max=65536net.ipv4.ip_local_port_range=1024 65000net.core.rmem_default=1048576net.core.rmem_max=1048576net.core.wmem_default=262144net.core.wmem_max=262144重启生效/sbin/sysctl p提高 Oracle 用户的 shell 限制设置oracle使用的文件数权限vi /etc/security/limits.conf 增加下列内容oracle soft nproc 2047oracle hard nproc 16384oracle soft nofile 1024oracle hard nofile 65536修改安全限制rootnode1 # vi /etc/pam.d/login增加：session required /lib/security/pam_limits.sovi /etc/rc.localmodprobe hangcheck-timer hangcheck-tick=30 hangcheck_margin=180在 root用户下创建oralce用户和设置：groupadd oinstallgroupadd dbauseradd -g oinstall -G dba oraclepasswd oraclemkdir -p /u01/app/oracle/product/10.2.0/crsmkdir -p /u01/app/oracle/product/10.2.0/db_1mkdir -p /u01/oradatachown -R oracle.oinstall /u01touch /etc/hosts.equivchmod 600 /etc/hosts.equivchown root:root /etc/hosts.equivvi /etc/hosts.equiv+rac1 oracle+rac2 oracle+rac1-priv oracle+rac2-priv oracle设置环境变量vi /home/oracle/.bash_profile添加以下内容export TMP=/tmpexport TMPDIR=$TMPexport ORACLE_BASE=/u01/app/oracleexport ORACLE_SID=rac1export ORACLE_HOME=$ORACLE_BASE/product/10.2.0/db_1export ORA_CRS_HOME=$ORACLE_BASE/product/10.2.0/crs_1export LD_LIBRARY_PATH=$ORACLE_HOME/libexport PATH=$ORACLE_HOME/bin:$ORA_CRS_HOME/bin:/bin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/X11R6/binulimit -u 16384 -n 65536umask 022 2，安装oracleasm支持包驱动下载地址：/technology/software/tech/linux/asmlib /rhel5.html创建asm数据库，首先需要ASMLib驱动程序包，可以从相关的网站下载到和操作系统对应的rpm文件，分别为oracleasm-support- 2.0.3-1、oracleasm-2.6.18-8.el5- 2.0.4-1.el5、oracleasmlib-2.0.3-1.el5。 # rpm -Uvh oracleasm*.rpm# rpm -qa|grep oracleasmoracleasm-support-2.0.3-1oracleasm-2.6.18-8.el5-2.0.4-1.el5oracleasmlib-2.0.3-1.el5rootRHEL5 Desktop# rpm -ivh oracleasmlib-2.0.4-1.el5.i386.rpmerror: Failed dependencies:oracleasm = 1.0.4 is needed by oracleasmlib-2.0.4-1.el5.i386rootRHEL5 Desktop#My kernel version is:rootRHEL5 Desktop# uname -rnRHEL5.3 2.6.18-164.el5oracleasm-support- 2.0.3-1、oracleasm-2.6.18-8.el5- 2.0.4-1.el5、oracleasmlib-2.0.3-1.el5。3 创建共享磁盘手动创建G:RACshared点add Hardware路径是rac rac/shared/racshare_1.vmdk5块硬盘添加成功G:node1node1.vmx，打开.vmx文件，添加下列内容：disk.locking = false diskLib.dataCacheMaxSize = 0 diskLib.dataCacheMaxReadAheadSize = 0 diskLib.DataCacheMinReadAheadSize = 0 diskLib.dataCachePageSize = 4096 diskLib.maxUnsyncedWrites = 0scsi1.sharedBus = VIRTUALscsi1:1.deviceType = diskscsi1:2.deviceType = diskscsi1:3.deviceType = diskscsi1:4.deviceType = diskscsi1:5.deviceType = disk提示：如果你创建有磁盘有多个，注意要按照你的实际情况修改。创建Oracle ASM 创建磁盘分区Cd /devLs sd*rootnode1 dev# ls sd*sda sda1 sda2 sdb sdc sdd sde sdffdisk /dev/sdb需要你输入的依次是n/p/1/回车/回车/w。Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabelBuilding a new DOS disklabel. Changes will remain in memory only,until you decide to write them. After that, of course, the previouscontent wont be recoverable.The number of cylinders for this disk is set to 1044.There is nothing wrong with that, but this is larger than 1024,and could in certain setups cause problems with:1) software that runs at boot time (e.g., old versions of LILO)2) booting and partitioning software from other OSs (e.g., DOS FDISK, OS/2 FDISK)Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)Command (m for help): nCommand action e extended p primary partition (1-4)pPartition number (1-4): 1First cylinder (1-1044, default 1): Using default value 1Last cylinder or +size or +sizeM or +sizeK (1-1044, default 1044): Using default value 1044Command (m for help): wThe partition table has been altered!Calling ioctl() to re-read partition table.Syncing disks.rootnode1 dev# ls sd*sda sda1 sda2 sdb sdb1 sdc sdd sde sdf把所有的 sdc，sdd，sde，sdf设置完成！rootnode1 dev# ls sd*sda sda1 sda2 sdb sdb1 sdc sdc1 sdd sdd1 sde sde1 sdf sdf1安装asm所需要的支持包安装 oracleasmlib 程序包。从 OTN 下载 ASM 库，并以 root 用户身份安装 ASM RPM/technology . x/asmlib/rhel5.html查看操作系统内核版本：node1 dev# uname -aLinux node1 2.6.18-8.el5xen #1 SMP Fri Jan 26 14:42:21 EST 2007 i686 i686 i386 GNU/LinuxLibrary and Tools oracleasm-support-2.1.3-1.el5.i386.rpm oracleasmlib-2.0.4-1.el5.i386.rpm Drivers for kernel 2.6.18-8.el5 oracleasm-2.6.18-8.el5xen-2.0.4-1.el5.i686.rpm oracleasm-2.6.18-8.el5PAE-2.0.4-1.el5.i686.rpm oracleasm-2.6.18-8.el5-2.0.4-1.el5.i686.rpm 提示，如果在安装过程中提示你缺少其它包，你可以先到操作系统安装光盘中寻找并安装所需系统包，然后再来安装下载到的包。rootnode1 oracleasm# rpm -ivh *rootnode1 oracleasm# rpm -ivh oracleasm-2.6.18-8.el5PAE-2.0.4-1.el5.i686.rpmerror: Failed dependencies: kernel-PAE = 2.6.18-8.el5 is needed by oracleasm-2.6.18-8.el5PAE-2.0.4-1.el5.i686本人在安装过程中缺少kernel-PAE-2.6.18-8.el5.i686.rpm在第一张盘中找到，装上即可。配置裸设备由于RHEL5中取消了rawdevices，如果不想将映射命令放到rc.local中的话，我们就需要将其配置到/etc/udev/rules.d/文件夹中修改文件/etc/udev/rules.d/60-raw.rulesvi /etc/udev/rules.d/60-raw.rules添加以下内容ACTION=add, KERNEL=/dev/sdb1,RUN+=/bin/raw /dev/raw/raw1 %NACTION=add, ENVMAJOR=8,ENVMINOR=17,RUN+=/bin/raw /dev/raw/raw1 %M %mACTION=add, KERNEL=/dev/sdc1,RUN+=/bin/raw /dev/raw/raw2 %NACTION=add, ENVMAJOR=8,ENVMINOR=33,RUN+=/bin/raw /dev/raw/raw2 %M %mACTION=add, KERNEL=/dev/sdd1,RUN+=/bin/raw /dev/raw/raw3 %NACTION=add, ENVMAJOR=8,ENVMINOR=49,RUN+=/bin/raw /dev/raw/raw3 %M %mACTION=add, KERNEL=/dev/sde1,RUN+=/bin/raw /dev/raw/raw4 %NACTION=add, ENVMAJOR=8,ENVMINOR=65,RUN+=/bin/raw /dev/raw/raw4 %M %mACTION=add, KERNEL=/dev/sdf1,RUN+=/bin/raw /dev/raw/raw5 %NACTION=add, ENVMAJOR=8,ENVMINOR=81,RUN+=/bin/raw /dev/raw/raw5 %M %mKERNEL=raw1-5, OWNER=oracle, GROUP=oinstall, MODE=640重启下服务：rootnode1 dev# start_udevStarting udev: OK 验证以下：rootnode1 raw# ls -lt /dev/rawtotal 0crw-r- 1 oracle oinstall 162, 1 Jul 20 10:32 raw1crw-r- 1 oracle oinstall 162, 3 Jul 20 10:32 raw3crw-r- 1 oracle oinstall 162, 2 Jul 20 10:32 raw2crw-r- 1 oracle oinstall 162, 4 Jul 20 10:32 raw4crw-r- 1 oracle oinstall 162, 5 Jul 20 10:32 raw5以oracle用户执行ln -s /dev/raw/raw1 /u01/oradata/ocrln -s /dev/raw/raw2 /u01/oradata/votingdiskln -s /dev/raw/raw3 /u01/oradata/asm1ln -s /dev/raw/raw4 /u01/oradata/asm2ln -s /dev/raw/raw5 /u01/oradata/asm3查看下oraclenode1 oradata$ ls -lrttotal 0lrwxrwxrwx 1 oracle oinstall 13 Jul 20 11:17 votingdisk - /dev/raw/raw2lrwxrwxrwx 1 oracle oinstall 13 Jul 20 11:17 ocr - /dev/raw/raw1lrwxrwxrwx 1 oracle oinstall 13 Jul 20 11:17 asm2 - /dev/raw/raw4lrwxrwxrwx 1 oracle oinstall 13 Jul 20 11:17 asm1 - /dev/raw/raw3lrwxrwxrwx 1 oracle oinstall 13 Jul 20 11:17 asm3 - /dev/raw/raw5配置第二个节点：拷贝 node1，生成新节点：修改：G:node2node1.vmx G:node2node2.vmx并修改以下内容：displayName = node2在虚拟机中加入节点2，点run选 I copied it，启动系统修改hostname将node1改成node2rootnode1 # hostname node2rootnode1 # vi /etc/sysconfig/network这样重启之后机器名称就会变成node2了。用 system-config-network 命令Eth0 Ip设为02 ,子网掩码：，网关：Eth0 Ip设为 , 子网掩码：，网关：null激活网卡修改 oracle中的.bash_profileORACLE_SID=rac2; export ORACLE_SID 重启节点2配置Clusterware安装环境设置ssh在clusterware (CRS) 和 Rac Database安装过程中，Oracle Universal Installer (OUI) 必须能够以 oracle 的身份自动将软件复制到所有 RAC 节点。这里我们通过配置ssh 让oracle用户拥有不输入密码即可访问各节点的能力。 首先两个节点间以及与网关要ping通，要确保都是通的rootnode2 # ping 01PING 01 (01) 56(84) bytes of data.64 bytes from 01: icmp_seq=1 ttl=64 time=0.046 ms64 bytes from 01: icmp_seq=2 ttl=64 time=0.030 ms- 01 ping statistics -2 packets transmitted, 2 received, 0% packet loss, time 999msrtt min/avg/max/mdev = 0.030/0.038/0.046/0.008 msrootnode2 # ping PING () 56(84) bytes of data.64 bytes from : icmp_seq=1 ttl=64 time=0.101 ms64 bytes from : icmp_seq=2 ttl=64 time=0.038 ms- ping statistics -2 packets transmitted, 2 received, 0% packet loss, time 999msrtt min/avg/max/mdev = 0.038/0.069/0.101/0.032 msrootnode1 # ping PING () 56(84) bytes of data.64 bytes from : icmp_seq=1 ttl=64 time=7.88 ms64 bytes from : icmp_seq=2 ttl=64 time=1.75 ms要建立用户等效性，需要在两个节点上以 oracle 用户身份生成用户的公钥和私钥，首先在node1执行rootnode1 # su - oracleoraclenode1 $ mkdir /.sshoraclenode1 $ chmod 700 /.sshoraclenode1 $ ssh-keygen -t rsaGenerating public/private rsa key pair.Enter file in which to save the key (/home/oracle/.ssh/id_rsa): Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /home/oracle/.ssh/id_rsa.Your public key has been saved in /home/oracle/.ssh/id_rsa.pub.The key fingerprint is:58:43:d8:96:74:a2:91:30:4f:e4:b8:b2:b3:e9:a6:90 oraclenode1oraclenode1 $ ssh-keygen -t dsaGenerating public/private dsa key pair.Enter file in which to save the key (/home/oracle/.ssh/id_dsa): Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /home/oracle/.ssh/id_dsa.Your public key has been saved in /home/oracle/.ssh/id_dsa.pub.The key fingerprint is:4a:55:81:ba:e6:09:aa:41:12:d3:3e:7f:ad:f8:68:43 oraclenode1然后node2执行rootnode2 # su - oracleoraclenode2 $ mkdir /.sshoraclenode2 $ chmod 700 /.sshoraclenode2 $ ssh-keygen -t rsaGenerating public/private rsa key pair.Enter file in which to save the key (/home/oracle/.ssh/id_rsa): Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /home/oracle/.ssh/id_rsa.Your public key has been saved in /home/oracle/.ssh/id_rsa.pub.The key fingerprint is:d7:55:13:69:aa:d2:b0:5b:2e:bd:ca:fd:60:62:bd:2b oraclenode2oraclenode2 $ ssh-keygen -t dsaGenerating public/private dsa key pair.Enter file in which to save the key (/home/oracle/.ssh/id_dsa): Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /home/oracle/.ssh/id_dsa.Your public key has been saved in /home/oracle/.ssh/id_dsa.pub.The key fingerprint is:df:40:a4:54:b1:5a:77:79:e9:98:3d:04:d8:a6:83:83 oraclenode2切换回node1，接着执行：sshoraclenode1 $ cat /.ssh/id_rsa.pub /.ssh/authorized_keysoraclenode1 $ cat /.ssh/id_dsa.pub /.ssh/authorized_keys提示：下列命令会提示你输入node2的oracle密码，按照提示输入即可，如果失败可重新尝试执行命令。oraclenode1 $ ssh rac2 cat /.ssh/id_rsa.pub/.ssh/authorized_keysThe authenticity of host rac2 (02) cant be established.RSA key fingerprint is f1:55:2c:9e:22:f3:62:5c:3c:bb:e2:79:ba:e9:ba:56.Are you sure you want to continue connecting (yes/no)? yesWarning: Permanently added rac2,02 (RSA) to the list of known hosts.oraclerac2s password:oraclenode1 $ ssh rac2 cat /.ssh/id_dsa.pub/.ssh/authorized_keysoraclerac2s password: oraclenode1 $ scp /.ssh/authorized_keys rac2:/.ssh/authorized_keysoraclerac2s password: authorized_keys 100% 1992 2.0KB/s 00:00 查看公钥私钥是否生效节点1rac1执行ssh rac1 datessh rac2 datessh rac1-priv datessh rac2-priv date节点2rac2:执行ssh rac1 datessh rac2 datessh rac1-priv datessh rac2-priv date配置asm注意：必须以root身份进行首先在node1执行：rootnode1 # /etc/init.d/oracleasm configureConfiguring the Oracle ASM library driver.This will configure the on-boot properties of the Oracle ASM librarydriver.The following questions will determine whether the driver isloaded on boot and what permissions it will have.The current valueswill be shown in brackets ().Hitting without typing ananswer will keep that current value.Ctrl-C will abort.Default user to own the driver interface : oracleDefault group to own the driver interface : dbaStart Oracle ASM library driver on boot (y/n) n: yFix permissions of Oracle ASM disks on boot (y/n) y: yWriting Oracle ASM library driver configuration: OKLoading module oracleasm: OKMounting ASMlib driver filesystem: OKScanning system for ASM disks: OK提示：如果本步执行出错(可能出错机率最高的是在Scanning system for ASM)，不妨将转换一下命令行的执行方式，改成:rootnode1 # sh /etc/init.d/oracleasm configure有可能解决你的问题！然后切换至node2执行rootnode2 # /etc/init.d/oracleasm configureConfiguring the Oracle ASM library driver.This will configure the on-boot properties of the Oracle ASM librarydriver.The following questions will determine whether the driver isloaded on boot and what permissions it will have.The current valueswill be shown in brackets ().Hitting without typing ananswer will keep that current value.Ctrl-C will abort.Default user to own the driver interface : oracleDefault group to own the driver interface : dbaStart Oracle ASM library driver on boot (y/n) n: yFix permissions of Oracle ASM disks on boot (y/n) y: yWriting Oracle ASM library driver configuration: OKLoading module oracleasm: OKMounting ASMlib driver filesystem: OKScanning system for ASM disks: OK再切换回node1执行rootnode1 # /etc/init.d/oracleasm createdisk VOL1 /dev/sdb1Marking disk /dev/sdd1 as an ASM disk: OKrootnode1 # /etc/init.d/oracleasm createdisk VOL2 /dev/sdc1Marking disk /dev/sde1 as an ASM disk: OKrootnode1 # /etc/init.d/oracleasm createdisk VOL3 /dev/sdd1Marking disk /dev/sde1 as an ASM disk: OKrootnode1 # /etc/init.d/oracleasm createdisk VOL4 /dev/sde1Marking disk /dev/sde1 as an ASM disk: OKrootnode1 # /etc/init.d/oracleasm createdisk VOL5 /dev/sdf1Marking disk /dev/sde1 as an ASM disk: OKrootnode1 linux-patch# /etc/init.d/oracleasm scandisksScanning system for ASM disks: OK查看一下当前的磁盘组：Scanning system for ASM disks: OKrootnode1 # /etc/init.d/oracleasm listdisksVOL1VOL2VOL3VOL4VOL5Node2上也查看一下当前磁盘组：rootnode2 # /etc/init.d/oracleasm scandisksScanning system for ASM disks: OKrootnode2 # /etc/init.d/oracleasm listdisksVOL1VOL2VOL3VOL4VOL5Ok,配置完成，准备进入到crs的安装阶段另外由于我们使用了RHEL5，并不被oracle10g所支持，因此在执行安装时需要指定-ignoreSysPrereqs跳过安装时的操作系统检查。runInstaller ignoreSysPrereqs出现errorException java.lang.UnsatisfiedLinkError: /tmp/OraInstall2010-07-22_11-04-55AM/jre/1.4.2/lib/i386/libawt.so: libXp.so.6: cannot open shared object file: No such file or directory occurred.java.lang.UnsatisfiedLinkError: /tmp/OraInstall2010-07-22_11-04-55AM/jre/1.4.2/lib/i386/libawt.so: libXp.so.6: cannot open shared object file: No such file or directory在RHEL5中上面的包被libXp所取代了，因此rpm -ivh libXp-1.0.0-8.i386.rpm将包打上后问题即可解决。（两个节点都打上包） 修改vipca文件rootnode2 opt# vi /opt/ora10g/product/10.2.0/crs_1/bin/vi