VMWARE8+RHEL54+Oracle11g+ASM+RAC.doc

VMWARE8+RHEL54+ORACLE11G+ASM+RAC安装文档：文件安装包：地址：/technetwork/products/clusterware/downloads/index.htmlGRID：Oracle Grid Infrastructure 11gRelease 2 (.0)Oracle：Oracle Database 11gRelease 2Standard Edition, Standard Edition One, and Enterprise Edition/technetwork/database/enterprise-edition/downloads/index.html1) 安装REDHAT（本地磁盘空间25G）oraclenode1 oracle$ df -hFilesystem Size Used Avail Use% Mounted on/dev/sda3 8.0G 6.2G 1.5G 82% /dev/sda2 15G 6.7G 6.8G 50% /u01/dev/sda1 99M 14M 80M 15% /boottmpfs 1.5G 638M 863M 43% /dev/shm2) 安装VMTool，关闭sendmail。IP规划：#public ip#public08 node109 node2#private01 node1-priv02 node2-priv#vip10 node1-vip11 node2-vip#scan12 scan-iprootnode1 # cat /etc/sysconfig/networkNETWORKING=yesNETWORKING_IPV6=noHOSTNAME=node1GATEWAY=磁盘规划：+CRS 三个1G的盘；+DATA 4个5G的盘添加共享磁盘，使用workstat添加，vmplayer添加磁盘时没有Independent选项修改虚拟机配置：首先到虚拟机工作目录，打开.vmx文件，添加一下内容：disk.locking = falsediskLib.dataCacheMaxsize = 0diskLib.dataCacheMaxReadAheadSize = 0diskLib.dataCacheMinReadAheadSize = 0diskLib.dataCachePageSize = 4096diskLib.maxUnsyncedWrites = 0scsi0:1.deviceType = diskscsi0:2.deviceType = diskscsi0:3.deviceType = diskscsi0:4.deviceType = diskscsi0:5.deviceType = diskscsi0:6.deviceType = diskscsi0:8.deviceType = diskscsi0:9.deviceType = disk添加用户：rootnode1 # groupadd -g 501 oinstallrootnode1 # groupadd -g 502 dbarootnode1 # groupadd -g 503 operrootnode1 # groupadd -g 504 asmadminrootnode1 # groupadd -g 505 asmoperrootnode1 # groupadd -g 506 asmdbarootnode1 # useradd -g oinstall -G dba,asmdba,oper oraclerootnode1 # useradd -g oinstall -G asmadmin,asmdba,asmoper,oper,dba gridrootnode1 # id oracleuid=500(oracle) gid=501(oinstall) groups=501(oinstall),502(dba),503(oper),506(asmdba)rootnode1 # id griduid=501(grid) gid=501(oinstall) groups=501(oinstall),502(dba),503(oper),504(asmadmin),505(asmoper),506(asmdba)修改用户密码：rootnode1 app# passwd gridChanging password for user grid.New UNIX password: BAD PASSWORD: it is too shortRetype new UNIX password: passwd: all authentication tokens updated successfully.rootnode1 app# passwd oracleChanging password for user oracle.New UNIX password: BAD PASSWORD: it is based on a dictionary wordRetype new UNIX password: passwd: all authentication tokens updated successfully.创建目录：rootnode1 # mkdir -p /u01/app/oraInventory,grid,oraclerootnode1 # chown -R grid:oinstall /u01/app/gridrootnode1 # chown -R oracle:oinstall /u01/app/oraclerootnode1 # chown -R grid:oinstall /u01/app/oraInventory修改系统参数：Vim /etc/security/limits.confgrid soft nproc 2047grid hard nproc 16384grid soft nofile 1024grid soft nofile 65536oracle soft nproc 2047oracle hard nproc 16384oracle soft nofile 1024oracle hard nofile 65536rootnode1 app# vim /etc/sysctl.confrootnode1 app# sysctl pnet.ipv4.ip_forward = 0net.ipv4.conf.default.rp_filter = 1net.ipv4.conf.default.accept_source_route = 0kernel.sysrq = 0kernel.core_uses_pid = 1net.ipv4.tcp_syncookies = 1kernel.msgmnb = 65536kernel.msgmax = 65536kernel.shmmax = 4294967295kernel.shmall = 268435456fs.aio-max-nr = 1048576fs.file-max = 6815744kernel.shmmni = 4096kernel.sem = 250 32000 100 128net.ipv4.ip_local_port_range = 9000 65500net.core.rmem_default = 262144net.core.rmem_max = 4194304net.core.wmem_default = 262144net.core.wmem_max = 1048586#关闭linux时间同步服务：rootnode1 app# service ntpd stopShutting down ntpd: FAILEDrootnode1 app# chkconfig ntpd offrootnode1 app# mv /etc/ntp.conf /etc/ntp.conf_bak/dev/shm共享内存不足的处理：rootnode1 app# df -hFilesystem Size Used Avail Use% Mounted on/dev/sda3 8.0G 3.0G 4.7G 40% /dev/sda2 15G 165M 14G 2% /u01/dev/sda1 99M 12M 83M 12% /boottmpfs 506M 0 506M 0% /dev/shm修改/etc/fstab 添加size=1024mrootnode1 app# cat /etc/fstab |grep tmpfstmpfs /dev/shm tmpfs defaults,size=1024m 0 0重新mount /dev/shm使之生效：# mount -o remount /dev/shmrootnode1 app# df -hFilesystem Size Used Avail Use% Mounted on/dev/sda3 8.0G 3.0G 4.7G 40% /dev/sda2 15G 165M 14G 2% /u01/dev/sda1 99M 12M 83M 12% /boottmpfs 1.0G 0 1.0G 0% /dev/shm修改用户的.bash_profile文件：gridnode1 $ vim .bash_profilegridnode1 $ source .bash_profile gridnode1 $ cat .bash_profile # .bash_profile# Get the aliases and functionsif -f /.bashrc ; then . /.bashrcfi# User specific environment and startup programsPATH=$PATH:$HOME/binTMP=/tmp; export TMPTMPDIR=$TMP; export TMPDIRORACLE_SID=+ASM1;export ORACLE_SIDORACLE_BASE=/u01/app/oracle;export ORACLE_BASEORACLE_HOME=/u01/app/grid/product/11.2.0; export ORACLE_HOMENLS_DATA_FORMAT=yyyy-mm-dd HH24:MI:SS; export NLS_DATA_FORMATPATH=$ORACLE_HOME/bin:$PATHexport PATHoraclenode1 $ vim .bash_profile oraclenode1 $ source .bash_profileoraclenode1 $ cat .bash_profile # .bash_profile# Get the aliases and functionsif -f /.bashrc ; then . /.bashrcfi# User specific environment and startup programsPATH=$PATH:$HOME/binTMP=/tmp; export TMPTMPDIR=$TMP; export TMPDIRORACLE_SID=bule1;export ORACLE_SIDORACLE_BASE=/u01/app/oracle;export ORACLE_BASEORACLE_HOME=/u01/app/oracle/product/11.2.0; export ORACLE_HOMENLS_DATA_FORMAT=yyyy-mm-dd HH24:MI:SS; export NLS_DATA_FORMATLD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib; export LD_LIBRARY_PATHCLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib; export CLASSPATHNLS_LANG=AMERICAN_AMERICA.ZHS16GBK; export NLS_LANGPATH=$ORACLE_HOME/bin:$PATH:/usr/sbinexport PATH格式化硬盘：Fdisk /dev/sdb n p 1 w Partproberootnode1 # fdisk -lDisk /dev/sda: 26.8 GB, 26843545600 bytes255 heads, 63 sectors/track, 3263 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sda1 * 1 13 104391 83 Linux/dev/sda2 1352 3263 15358140 83 Linux/dev/sda3 14 1090 8651002+ 83 Linux/dev/sda4 1091 1351 2096482+ 5 Extended/dev/sda5 1091 1351 2096451 82 Linux swap / SolarisPartition table entries are not in disk orderDisk /dev/sdb: 1073 MB, 1073741824 bytes255 heads, 63 sectors/track, 130 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sdb1 1 130 1044193+ 83 LinuxDisk /dev/sdc: 1073 MB, 1073741824 bytes255 heads, 63 sectors/track, 130 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sdc1 1 130 1044193+ 83 LinuxDisk /dev/sdd: 1073 MB, 1073741824 bytes255 heads, 63 sectors/track, 130 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sdd1 1 130 1044193+ 83 LinuxDisk /dev/sde: 5368 MB, 5368709120 bytes255 heads, 63 sectors/track, 652 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sde1 1 652 5237158+ 83 LinuxDisk /dev/sdf: 5368 MB, 5368709120 bytes255 heads, 63 sectors/track, 652 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sdf1 1 652 5237158+ 83 LinuxDisk /dev/sdg: 5368 MB, 5368709120 bytes255 heads, 63 sectors/track, 652 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sdg1 1 652 5237158+ 83 LinuxDisk /dev/sdh: 5368 MB, 5368709120 bytes255 heads, 63 sectors/track, 652 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System/dev/sdh1 1 652 5237158+ 83 Linux配置裸设备：rootnode1 rules.d# start_udevStarting udev: OK rootnode1 rules.d# raw -qa/dev/raw/raw1: bound to major 8, minor 17/dev/raw/raw2: bound to major 8, minor 33/dev/raw/raw3: bound to major 8, minor 49/dev/raw/raw4: bound to major 8, minor 65/dev/raw/raw5: bound to major 8, minor 81/dev/raw/raw6: bound to major 8, minor 97/dev/raw/raw7: bound to major 8, minor 113rootnode1 rules.d# ls -l /dev/rawtotal 0crw- 1 oracle oinstall 162, 1 Apr 11 15:13 raw1crw- 1 oracle oinstall 162, 2 Apr 11 15:13 raw2crw- 1 oracle oinstall 162, 3 Apr 11 15:13 raw3crw- 1 oracle oinstall 162, 4 Apr 11 15:13 raw4crw- 1 oracle oinstall 162, 5 Apr 11 15:13 raw5crw- 1 oracle oinstall 162, 6 Apr 11 15:13 raw6crw- 1 oracle oinstall 162, 7 Apr 11 15:13 raw7rootnode1 rules.d# cat 60-raw.rules # Enter raw device bindings here.# An example would be:# ACTION=add, KERNEL=sda, RUN+=/bin/raw /dev/raw/raw1 %N# to bind /dev/raw/raw1 to /dev/sda, or# ACTION=add, ENVMAJOR=8, ENVMINOR=1, RUN+=/bin/raw /dev/raw/raw2 %M %m#a to bind /dev/raw/raw2 to the device with major 8, minor 1.ACTION=add, ENVMAJOR=8, ENVMINOR=17, RUN+=/bin/raw /dev/raw/raw1 %M %mACTION=add, ENVMAJOR=8, ENVMINOR=33, RUN+=/bin/raw /dev/raw/raw2 %M %mACTION=add, ENVMAJOR=8, ENVMINOR=49, RUN+=/bin/raw /dev/raw/raw3 %M %mACTION=add, ENVMAJOR=8, ENVMINOR=65, RUN+=/bin/raw /dev/raw/raw4 %M %mACTION=add, ENVMAJOR=8, ENVMINOR=81, RUN+=/bin/raw /dev/raw/raw5 %M %mACTION=add, ENVMAJOR=8, ENVMINOR=97, RUN+=/bin/raw /dev/raw/raw6 %M %mACTION=add, ENVMAJOR=8, ENVMINOR=113, RUN+=/bin/raw /dev/raw/raw7 %M %mACTION=add,KERNEL=raw1-7,OWNER=oracle,GROUP=oinstall,MODE=”0660”生成节点2：拷贝文件或者workstation的full clone（full clone会将共享磁盘拷贝入内，full clone完毕后在节点2中删除这些共享磁盘文件，在启动节点2时，会提示重新找寻这些磁盘的路径，指定到节点1目录。）修改IP(/etc/sysconfig/network-script/)，节点名字（/etc/sysconfig/network）修改/etc/hosts 将 修改为node2配置节点互信：（使用grid,oracle分别配置）主实施节点：rootnode2 app# su - oracleoraclenode2 $ mkdir .sshoraclenode2 $ cd .sshoraclenode2 .ssh$ ssh-keygen -t rsaGenerating public/private rsa key pair.Enter file in which to save the key (/home/oracle/.ssh/id_rsa): Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /home/oracle/.ssh/id_rsa.Your public key has been saved in /home/oracle/.ssh/id_rsa.pub.The key fingerprint is:a6:c6:3d:b3:0c:e0:7e:c0:e7:3a:de:ad:df:29:3d:a1 oraclenode2oraclenode2 .ssh$ ssh-keygen -t dsaGenerating public/private dsa key pair.Enter file in which to save the key (/home/oracle/.ssh/id_dsa): Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /home/oracle/.ssh/id_dsa.Your public key has been saved in /home/oracle/.ssh/id_dsa.pub.The key fingerprint is:7b:7a:d8:ec:24:da:2e:d8:82:11:2a:52:25:9f:14:03 oraclenode2oraclenode2 .ssh$ lsid_dsa id_dsa.pub id_rsa id_rsa.puboraclenode2 .ssh$ cat id_rsa.pub authorized_keysoraclenode2 .ssh$ cat id_dsa.pub authorized_keys从实施节点：rootnode1 # su - oracleoraclenode1 $ mkdir .sshoraclenode1 $ lsoraclenode1 $ ssh-keygen -t rsaGenerating public/private rsa key pair.Enter file in which to save the key (/home/oracle/.ssh/id_rsa): Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /home/oracle/.ssh/id_rsa.Your public key has been saved in /home/oracle/.ssh/id_rsa.pub.The key fingerprint is:45:01:d5:26:c0:ff:57:55:28:67:ce:6b:96:9a:48:a4 oraclenode1oraclenode1 $ ssh-keygen -t dsaGenerating public/private dsa key pair.Enter file in which to save the key (/home/oracle/.ssh/id_dsa): Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /home/oracle/.ssh/id_dsa.Your public key has been saved in /home/oracle/.ssh/id_dsa.pub.The key fingerprint is:a0:23:f8:c5:72:48:2e:cf:c6:bc:98:a4:d0:ce:6e:5c oraclenode1主实施节点：oraclenode2 .ssh$ ssh node1 cat /.ssh/id_rsa.pub authorized_keys The authenticity of host node1 (08) cant be established.RSA key fingerprint is 69:dc:b9:40:f5:fa:fe:75:4f:cb:2c:52:86:7f:ec:8b.Are you sure you want to continue connecting (yes/no)? yesWarning: Permanently added node1,08 (RSA) to the list of known hosts.oraclenode1s password: oraclenode2 .ssh$ ssh node1 cat /.ssh/id_dsa.pub authorized_keys oraclenode1s password: oraclenode2 .ssh$ scp authorized_keys node1:/.ssh/authorized_keys oraclenode1s password: authorized_keys 100% 1992 2.0KB/s 00:00 主实施节点测试互信：oraclenode2 .ssh$ ssh node1 dateThu Apr 11 16:02:41 CST 2013oraclenode2 .ssh$ ssh node2 dateThe authenticity of host node2 (09) cant be established.RSA key fingerprint is 69:dc:b9:40:f5:fa:fe:75:4f:cb:2c:52:86:7f:ec:8b.Are you sure you want to continue connecting (yes/no)? yesWarning: Permanently added node2,09 (RSA) to the list of known hosts.Thu Apr 11 16:02:46 CST 2013oraclenode2 .ssh$ ssh node1-priv dateThe authenticity of host node1-priv (01) cant be established.RSA key fingerprint is 69:dc:b9:40:f5:fa:fe:75:4f:cb:2c:52:86:7f:ec:8b.Are you sure you want to continue connecting (yes/no)? yesWarning: Permanently added node1-priv,01 (RSA) to the list of known hosts.Thu Apr 11 16:02:55 CST 2013oraclenode2 .ssh$ ssh node2-priv dateThe authenticity of host node2-priv (02) cant be established.RSA key fingerprint is 69:dc:b9:40:f5:fa:fe:75:4f:cb:2c:52:86:7f:ec:8b.Are you sure you want to continue connecting (yes/no)? yesWarning: Permanently added node2-priv,02 (RSA) to the list of known hosts.从实施节点测试互信：oraclenode1 $ ssh node1 dateThe authenticity of host node1 () cant be established.RSA key fingerprint is 69:dc:b9:40:f5:fa:fe:75:4f:cb:2c:52:86:7f:ec:8b.Are you sure you want to continue connecting (yes/no)? yesWarning: Permanently added node1 (RSA) to the list of known hosts.Thu Apr 11 16:03:23 CST 2013oraclenode1 $ ssh node2 dateThe authenticity of host node2 (09) cant be established.RSA key fingerprint is 69:dc:b9:40:f5:fa:fe:75:4f:cb:2c:52:86:7f:ec:8b.Are you sure you want to continue connecting (yes/no)? yesWarning: Permanently added node2,09 (RSA) to the list of known hosts.Thu Apr 11 16:03:28 CST 2013oraclenode1 $ ssh node1-privThe authenticity of host node1-priv (01) cant be established.RSA key fingerprint is 69:dc:b9:40:f5:fa:fe:75:4f:cb:2c:52:86:7f:ec:8b.Are you sure you want to continue connecting (yes/no)? yesWarning: Permanently added node1-priv,01 (RSA) to the list of known hosts.oraclenode1 $ ssh node1-priv dateThu Apr 11 16:03:44 CST 2013oraclenode1 $ ssh node2-priv dateThe authenticity of host node2-priv (02) cant be established.RSA key fingerprint is 69:dc:b9:40:f5:fa:fe:75:4f:cb:2c:52:86:7f:ec:8b.Are you sure you want to continue connecting (yes/no)? yesWarning: Permanently added node2-priv,02 (RSA) to the list of known hosts.Thu Apr 11 16:03:49 CST 2013安装GRID：gridnode1 $ cd grid/gridnode1 grid$ lsdoc install response rpm runcluvfy.sh runInstaller sshsetup stage welcome.html装前脚本检查：gridnode1 grid$ ./runcluvfy.sh stage -pre crsinst -n node1,node2 -fix