RHEL5.5 64位+oracle11Gr2_RAC+grid+iscsi.docx

RHEL5.5 64位+oracle11Gr2_RAC+grid+iscsi3台rhel5.5，一台做iscsi，两台做rac，安装操作系统略一、安装iscsi服务端1、创建yum本地源（略）2、安装iscsi服务器软件包yum install scsi-target-utils3、启动服务/etc/rc.d/init.d/tgtd start4、开机启动chkconfig -level 345 tgtd on5、创建4个lv（略）6、创建一个targettgtadm -lld iscsi -op new -mode target -tid=1 -targetname .iscsi:rac.iscsi7、创建lun，对应lv，这里要只创建了1个，其他3个和这个类似tgtadm -lld iscsi -op new -mode=logicalunit -tid=1 -lun=1 -backing-store /dev/datavg/lv018、允许访问的ip段tgtadm -lld iscsi -op bind -mode=target -tid=1 -initiator-address=/249、重启服务后创建的信息会丢失，要一直存在需要存放在配置文件中/etc/tgt/targets.conf backing-store /dev/datavg/lv01 backing-store /dev/datavg/lv02 backing-store /dev/datavg/lv03 backing-store /dev/datavg/lv04 initiator-address /2410、查看配置的信息tgtadm -lld iscsi -op show -mode target二、配置iscsi客户端访问（两台rac机器都执行以下操作）1、客户端配置yum本地源（略）2、安装iscsi客户端yum install iscsi-initiator-utils.x86_643、启动服务service iscsi startiscsiadm -mode discovery -type sendtargets -portal 04iscsiadm -mode node -targetname .iscsi:rac.iscsi -portal 04:3260 -login4、查看挂载的lunfdisk -l三、安装rac1、创建yum本地源（略）2、安装所需软件包#yum install binutils compat-libstdc+ elfutils-libelf elfutils-libelf-devel glibc glibc-common glibc-devel glibc-headers gcc gcc-c+ libaio libaio-devel libgcc libstdc+ libstdc+-devel make numactl-devel sysstat libXp unixODBC-devel#rpm -ivh oracleasm-2.6.18-194.el5-2.0.5-1.el5.x86_64.rpm#rpm -ivh oracleasmlib-2.0.4-1.el5.i386.rpm#rpm -ivh oracleasm-support-2.1.8-1.el5.i386.rpm(内核对应)3、配置参数#vi /etc/sysctl.confkernel.shmall = 2097152 (实际的物理内存的大小)kernel.shmmax = 2147483648 (实际物理内在*1024*1024/2)kernel.shmmni = 4096kernel.sem = 250 32000 100 128fs.aio-max-nr = 1048576fs.file-max = 6815744net.ipv4.ip_local_port_range = 9000 65500net.core.rmem_default=262144net.core.rmem_max=4194304net.core.wmem_default=262144net.core.wmem_max=10485766#sysctl -p#vi /etc/security/limits.conf* soft nproc 2047* hard nproc 16384* soft nofile 1024* hard nofile 65536#vi /etc/pam.d/loginsession required /lib64/security/pam_limits.so#vi /etc/profileif $USER = oracle | $USER = grid ; thenif $SHELL = /bin/ksh ; thenulimit -p 16384ulimit -n 65536elseulimit -u 16384 -n 65536fifivi /etc/hosts localhost.localdomain localhost1 rac pri11 vip12 rac pri22 vip290 racscan4、添加用户并创建目录和设置变量#groupadd oinstall#groupadd dba#groupadd oper#groupadd asmadmin#groupadd asmdba#groupadd asmoper#useradd -g oinstall -G asmadmin,asmdba,asmoper,dba grid#passwd grid#useradd -g oinstall -G dba,oper,asmdba,asmadmin oracle#passwd oracle#mkdir -p /u01/product/oracle/11.2.0/dbhome_1#mkdir -p /u02/product/grid/11.2.0#mkdir -p /u03/product/grid/crs#chmod -R 775 /u01/product/#chmod -R 775 /u02/product/#chmod -R 775 /u03/product/#chown -R oracle.oinstall /u01/#chown -R grid.oinstall /u02/#chown -R grid.oinstall /u03/#su - oracle$vi /.bash_profileexport TMP=/tmpexport TMPDIR=$TMPexport ORACLE_BASE=/u01/product/oracleexport ORACLE_HOME=$ORACLE_BASE/11.2.0/dbhome_1export ORACLE_SID=orcl1 | orcl2export ORACLE_TERM=xtermexport PATH=$ORACLE_HOME/bin:$PATHexport LD_LIBRARY_PATH=$ORACLE_HOME/lib:$LD_LIBRARY_PATHexport CLASSPATH=$ORACLE_HOME/jre:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib:$ORACLE_HOME/network/jlib:$CLASSPATHexport NLS_LANG=AMERICAN_AMERICA.zhs16gbkexport DISPLAY=21:0.0#su - gridexport TMP=/tmpexport TMPDIR=$TMPexport ORACLE_BASE=/u03/product/grid/crsexport ORACLE_HOME=/u02/product/grid/11.2.0/export ORACLE_SID=+ASM1 | +ASM2export ORACLE_TERM=xtermexport PATH=$ORACLE_HOME/bin:$PATHexport LD_LIBRARY_PATH=$ORACLE_HOME/lib:$LD_LIBRARY_PATHexport CLASSPATH=$ORACLE_HOME/jdk/jre:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib:$ORACLE_HOME/network/jlib:$CLASSPATHexport NLS_LANG=AMERICAN_AMERICA.zhs16gbkexport DISPLAY=21:0.05、给添加的4个磁盘进行分区，并且使用asm工具#fdisk /dev/sdb (/dev/sdc /dev/sdd /dev/sde这些设置一样，重复就行)Command (m for help): n 添加一个分区p primary partition (1-4) p 添加一个主分区First cylinder (1-261, default 1): 从第1个柱面开始Last cylinder or +size or +sizeM or +sizeK (1-261, default 261): 到最后一个柱面结束Command (m for help): w保存#oracleasm configure -iDefault user to own the driver interface : gridDefault group to own the driver interface : asmadminStart Oracle ASM library driver on boot (y/n) n: yScan for Oracle ASM disks on boot (y/n) y: yWriting Oracle ASM library driver configuration: done#oracleasm configure#oracleasm init#oracleasm scandisks#oracleasm createdisk ASM_DATA01 /dev/sdb1#oracleasm createdisk ASM_DATA02 /dev/sdc1#oracleasm createdisk ASM_FRA /dev/sdd1#oracleasm createdisk OCR_VOTE01 /dev/sde1#oracleasm listdisks安装cvuqdisk包，以发现共享磁盘#export CVUQDISK_GRP=oinstall#cd /opt/grid/rpm#rpm -ivh cvuqdisk-1.0.7-1.rpm6、关闭npt服务器,并开启服务器间同步时间#service ntpd stop#chkconfig ntpd off#mv /etc/ntp.conf /etc/#chkconfig time-stream onRAC2上执行#crontab -e*/2 * * * * rdate -s 1#/etc/rc.d/init.d/crond restart7、配置ssh认证#su - grid$mkdir .ssh$chmod 700 .ssh$cd .ssh$ssh-keygen -t rsa（一直回车）$ssh-keygen -t dsa（一直回车）以下在rac1上执行$cat id_rsa.pub authorized_keys$cat id_dsa.pub authorized_keys$ssh rac2 cat /home/grid/.ssh/id_rsa.pub authorized_keys $ssh rac2 cat /home/grid/.ssh/id_dsa.pub authorized_keys $scp authorized_keys rac2:/home/grid/.ssh/以下在rac1、2上都执行$chmod 600 authorized_keys$ssh rac2 date$ssh rac1 date$ssh pri1 date$ssh pri2 date在rac1的软件目录下执行来检查安装环境$./runcluvfy.sh stage -pre crsinst -n rac1,rac2 -fixup -verbose通过后执行以下安装grid,安装过程中注意只添加OCR组，执行脚本一定要等第一个执行完毕后在执行其他的。安装完成后会出现INS-20802错误，可以跳过或者执行以下操作.#mv /usr/bin/nslookup /usr/bin/nslookup.bak#vi /usr/bin/nslookup#!/bin/bashHOSTNAME=$1if $HOSTNAME = racscan ; then echo Server: 1|22 echo Address: 1|22 #53 echo Non-author