oracle10gr2rachacmp文档.doc

Install oracle 10R2 RAC with HACMP 5.2 on IBM AIX 5.3软件环境 AIX5L5.3ML4 AIX补丁 HACMP5.2 Oracle Oracle补丁 硬件环境 RS60002台 (每台主机有4个以太网网卡、2个光纤卡、一个串口) 光纤磁盘阵列DS43001台1、 安装aix系统 扩充/2gb 扩充/home4gb 扩充/usr4gb 扩充/var4gb 扩充/tmp2gb 扩充/opt20gb 扩充/var/adm/ras/platform1gb /etc/hosts文件 01 rac1 02 rac2 03 rac1vip 04 rac2vip 01 rac1priv 02 rac2priv 2、 在rac1和rac2上，创建oinstall、dba、hagsuser组 /bin/mkgroupoinstall /bin/mkgroupdba /bin/mkgrouphagsuser 3、 在rac1和rac2上，创建oracle用户： #smittyuser AddaUser Typeorselectvaluesinentryfields. PressEnterAFTERmakingalldesiredchanges. *UserNAMEoracle UserID500 PrimaryGROUPoinstall GroupSETdba,hagsuser SoftFILEsize-1 SoftCPUtime-1 SoftDATAsegment-1 SoftSTACKsize-1 保证两台主机的组号要一致！ /etc/group oinstall:!:203: dba:!:204: hagsuser:!:205: #idoracle uid=500(oracle)gid=203(oinstall)groups=204(dba),205(hagsuser) 4、 配置系统配置参数 配置每用户的最大进程数、调整watermark smittychgsys MaximumnumberofPROCESSESallowedperuser4096 HIGHwatermarkforpendingwriteI/Osperfile33 LOWwatermarkforpendingwriteI/Osperfile24 StackExecutionDisable(SED)Modeoff 配置网络可调参数 修改文件/etc/，将如下几行加到文件的尾部： if-f/usr/sbin/nothen /usr/sbin/no-p-oudp_sendspace=65536 /usr/sbin/no-p-oudp_recvspace=655360 /usr/sbin/no-p-otcp_sendspace=65536 /usr/sbin/no-p-otcp_recvspace=65536 /usr/sbin/no-p-orfc1323=1 /usr/sbin/no-p-osb_max=1310720 /usr/sbin/no-r-oipqmaxlen=512 fi 修改异步I/O（须重启） smittychgaio EntryFields MINIMUMnumberofservers30# MAXIMUMnumberofservers60# maximumnumberofREQUESTS4096# serverPRIORITY39# STATEtobeconfiguredatsystemrestartavailable+ Stateoffastpathenable+ #mkdevlaio0使异步I/O可用 调整syncd频率 修改文件/sbin/rc.boot #nohup/usr/sbin/syncd60/dev/null2&1& nohup/usr/sbin/syncd10/dev/null2&1& 5、 创建串口设备 smittymktty 测试串口设备 cat/dev/tty0 6、 安装oracle、hacmp支持包 smittyinstallp 需要安装以下操作系统包： Bos.adt bos.cifs_fs Bos.clvm pat bos.data Bos.perf rsct.basic pat.basic pat.clients rsct.core （在扩展盘上HACMP5.2不需要，5.3需要） rsct.exp.cimrm （以下包在AIXToolboxforLinuxApplications盘上，安装SSH的前提包） openssl-0.9.7g openssl-devel-0.9.7g openssl-doc-0.9.7g （以下包在扩展盘上） openssh.base openssh.license openssh.man.en_US 要将license改为接受！ （在网上download） xlC.aix50.rte: xlC.rte: 7、 安装hacmp软件 smittyinstallp 8、 安装磁盘阵列，创建共享卷 准备磁盘阵列 #hostname rac1 #lspv hdisk00002e54aa58657e9rootvgactive hdisk10002657c5acf302bNone hdisk20002657c4d26e7baNone hdisk30002657c5acf4bc3None hdisk40002657c4cc04d52None hdisk50002ee503cc8dcaaNone # #hostname rac2 #lspv hdisk00002e5baa58258aarootvgactive hdisk10002657c5acf302bNone hdisk20002657c4d26e7baNone hdisk30002657c5acf4bc3None hdisk40002657c4cc04d52None hdisk50002ee503cc8dcaaNone 创建一个并行vg名字为oracle_vg #hostname rac1 # #smittymkvg AddaBigVolumeGroup Typeorselectvaluesinentryfields. PressEnterAFTERmakingalldesiredchanges. EntryFields VOLUMEGROUPnameoracle_vg PhysicalpartitionSIZEinmegabytes128 *PHYSICALVOLUMEnameshdisk5 Forcethecreationofavolumegroup?yes ActivatevolumegroupAUTOMATICALLYno atsystemrestart? VolumeGroupMAJORNUMBER60 CreateVGConcurrentCapable?enhancedconcurrent #varyonvgoracle_vg 创建oracle使用的并行卷 mklv-ydy_crs1024m-wn-sn-rnoracle_vg8hdisk5 mklv-ydy_vote1024m-wn-sn-rnoracle_vg8hdisk5 mklv-ydy_system_1024m-wn-sn-rnoracle_vg10hdisk5 mklv-ydy_pwdfile_100m-wn-sn-rnoracle_vg1hdisk5 mklv-ydy_sysaux_800m-wn-sn-rnoracle_vg10hdisk5 mklv-ydy_undo1_4096m-wn-sn-rnoracle_vg40hdisk5 mklv-ydy_undo2_4096m-wn-sn-rnoracle_vg40hdisk5 mklv-ydy_temp_4096m-wn-sn-rnoracle_vg40hdisk5 mklv-ydy_example_800m-wn-sn-rnoracle_vg10hdisk5 mklv-ydy_users_800m-wn-sn-rnoracle_vg10hdisk5 mklv-ydy_redo1_1_500m-wn-sn-rnoracle_vg10hdisk5 mklv-ydy_redo1_2_500m-wn-sn-rnoracle_vg10hdisk5 mklv-ydy_redo1_3_500m-wn-sn-rnoracle_vg10hdisk5 mklv-ydy_redo1_4_500m-wn-sn-rnoracle_vg10hdisk5 mklv-ydy_redo1_5_500m-wn-sn-rnoracle_vg10hdisk5 mklv-ydy_redo1_6_500m-wn-sn-rnoracle_vg10hdisk5 mklv-ydy_redo2_1_500m-wn-sn-rnoracle_vg10hdisk5 mklv-ydy_redo2_2_500m-wn-sn-rnoracle_vg10hdisk5 mklv-ydy_redo2_3_500m-wn-sn-rnoracle_vg10hdisk5 mklv-ydy_redo2_4_500m-wn-sn-rnoracle_vg10hdisk5 mklv-ydy_redo2_5_500m-wn-sn-rnoracle_vg10hdisk5 mklv-ydy_redo2_6_500m-wn-sn-rnoracle_vg10hdisk5 mklv-ydy_ctl1_110m-wn-sn-rnoracle_vg1hdisk5 mklv-ydy_ctl2_110m-wn-sn-rnoracle_vg1hdisk5 mklv-ydy_ctl3_110m-wn-sn-rnoracle_vg1hdisk5 mklv-ydy_spfile_110m-wn-sn-rnoracle_vg1hdisk5 mklv-ydy_recover4096m-wn-sn-rnoracle_vg40hdisk5 在另外一台主机上import共享卷 #hostname rac2 #smittyvg VolumeGroups MovecursortodesireditemandpressEnter. ImportaVolumeGroup ImportaVolumeGroup Typeorselectvaluesinentryfields. PressEnterAFTERmakingalldesiredchanges. EntryFields VOLUMEGROUPnameoracle_vg *PHYSICALVOLUMEnamehdisk5+ VolumeGroupMAJORNUMBER60+# 修改共享卷的属性（两台主机都要做） varyonvgoracle_vg chownoracle:dba/dev/*dy_* varyoffvgoracle_vg9、 配置SSH ConfiguringSSHonAllClusterNodes BeforeyouinstallanduseOracleRealApplicationclusters,youmustconfiguresecure shell(SSH)fortheoracleuseronallclusternodes.OracleUniversalInstalleruses thesshandscpcommandsduringinstallationtorunremotecommandsonandcopy filestotheotherclusternodes.YoumustconfigureSSHsothatthesecommandsdo notpromptforapassword. ConfiguringSSHonClusterMemberNodes ToconfigureSSH,youmustfirstcreateRSAandDSAkeysoneachclusternode,and thencopythekeysfromallclusternodemembersintoanauthorizedkeysfileoneach node.Todothistask,completethefollowingsteps: CreateRSAandDSAkeysoneachnode:Completethefollowingstepsoneach node: 1.Loginastheoracleuser. 2.Ifnecessary,createthe.sshdirectoryintheoracleusershomedirectoryand setthecorrectpermissionsonit: mkdir/.ssh chmod700/.ssh 3.EnterthefollowingcommandstogenerateanRSAkeyforversion2oftheSSH protocol: /usr/bin/ssh-keygen-trsa Attheprompts: Acceptthedefaultlocationforthekeyfile. Enterandconfirmapassphrasethatisdifferentfromtheoracleusers password. Thiscommandwritesthepublickeytothe/.ssh/id_rsa.pubfileandthe privatekeytothe/.ssh/id_rsafile.Neverdistributetheprivatekeytoanyone. 4.EnterthefollowingcommandstogenerateaDSAkeyforversion2oftheSSH protocol: /usr/bin/ssh-keygen-tdsa Attheprompts: Acceptthedefaultlocationforthekeyfile Enterandconfirmapassphrasethatisdifferentfromtheoracleusers password Thiscommandwritesthepublickeytothe/.ssh/id_dsa.pubfileandthe privatekeytothe/.ssh/id_dsafile.Neverdistributetheprivatekeyto anyone. Addkeystoanauthorizedkeyfile:Completethefollowingsteps: 1.Onthelocalnode,determineifyouhaveanauthorizedkeyfile (/.ssh/authorized_keys).Iftheauthorizedkeyfilealreadyexists,then proceedtostep2.Otherwise,enterthefollowingcommands: touch/.ssh/authorized_keys cd/.ssh ls Youshouldseetheid_dsa.pubandid_rsa.pubkeysthatyouhavecreated. 2.UsingSSH,copythecontentsofthe/.ssh/id_rsa.puband /.ssh/id_dsa.pubfilestothefile/.ssh/authorized_keys,andprovide theOracleuserpasswordasprompted.Thisprocessisillustratedinthefollowing syntaxexamplewithatwo-nodecluster,withnodesnode1andnode2,wherethe Oracleuserpathis/home/oracle: oraclerac1.ssh$sshrac1cat/home/oracle/.ssh/id_rsa.pubauthorized_keys oraclenode1spassword: oraclerac1.ssh$sshrac1cat/home/oracle/.ssh/id_dsa.pubauthorized_keys oraclerac1.ssh$sshrac2cat/home/oracle/.ssh/id_rsa.pubauthorized_keys oraclenode2spassword: oraclerac1.ssh$sshrac2cat/home/oracle/.ssh/id_dsa.pubauthorized_keys oraclenode2spassword: 3.UseSCP(SecureCopy)orSFTP(SecureFTP)tocopytheauthorized_keysfile totheOracleuser.sshdirectoryonaremotenode.Thefollowingexampleiswith SCP,onanodecallednode2,wheretheOracleuserpathis/home/oracle: oraclenode1.sshscpauthorized_keysnode2:/home/oracle/.ssh/ 4.Repeatstep2and3foreachclusternodemember.Whenyouhaveaddedkeys fromeachclusternodemembertotheauthorized_keysfileonthelastnodeyou wanttohaveasaclusternodemember,thenuseSCPtocopythecomplete authorized_keysfilebacktoeachclusternodemember Note:Repeatthisprocessforeachnodeinthecluster Note:TheOracleusers/.ssh/authorized_keysfileonevery nodemustcontainthecontentsfromallofthe/.ssh/id_rsa.pub and/.ssh/id_dsa.pubfilesthatyougeneratedonallcluster nodes. 5.ChangethepermissionsontheOracleusers/.ssh/authorized_keysfileon allclusternodes: chmod600/.ssh/authorized_keys Atthispoint,ifyouusesshtologintoorrunacommandonanothernode,you arepromptedforthepassphrasethatyouspecifiedwhenyoucreatedtheDSA key. EnablingSSHUserEquivalencyonClusterMemberNodes ToenableOracleUniversalInstallertousethesshandscpcommandswithoutbeing promptedforapassphrase,followthesesteps: 1.OnthesystemwhereyouwanttorunOracleUniversalInstaller,loginasthe oracleuser. 2.Enterthefollowingcommands: exec/usr/bin/ssh-agent$SHELL /usr/bin/ssh-add 3.Attheprompts,enterthepassphraseforeachkeythatyougenerated. IfyouhaveconfiguredSSHcorrectly,thenyoucannowusethesshorscp commandswithoutbeingpromptedforapasswordorapassphrase. 4.Ifyouareonaremoteterminal,andthelocalnodehasonlyonevisual(whichis typical),thenusethefollowingsyntaxtosettheDISPLAYenvironmentvariable: Bourne,Korn,andBashshells $exportDISPLAY=hostname:0 Cshell: $setenvDISPLAY0 Forexample,ifyouareusingtheBashshell,andifyourhostnameisnode1,then enterthefollowingcommand: $exportDISPLAY=node1:0 5.TotesttheSSHconfiguration,enterthefollowingcommandsfromthesame terminalsession,testingtheconfigurationofeachclusternode,where nodename1,nodename2,andsoon,arethenamesofnodesinthecluster: $sshnodename1date $sshnodename2date . . . Thesecommandsshoulddisplaythedatesetoneachnode. Ifanynodepromptsforapasswordorpassphrase,thenverifythatthe /.ssh/authorized_keysfileonthatnodecontainsthecorrectpublickeys. Ifyouareusingaremoteclienttoconnecttothelocalnode,andyouseeamessage similartoWarning:Noxauthdata;usingfakeauthenticationdataforX11 forwarding,thenthismeansthatyourauthorizedkeysfileisconfiguredcorrectly, butyoursshconfigurationhasX11forwardingenabled.Tocorrectthis,proceedto step6. Note:ThefirsttimeyouuseSSHtoconnecttoanodefroma particularsystem,youmayseeamessagesimilartothefollowing: Theauthenticityofhostnode1(53)cantbe established. RSAkeyfingerprintis 7z:ez:e7:f6:f4:f2:4f:8f:9z:79:85:62:20:90:92:z9. Areyousureyouwanttocontinueconnecting(yes/no)? Enteryesattheprompttocontinue.Youshouldnotseethis messageagainwhenyouconnectfromthissystemtothatnode. Ifyouseeanyothermessagesortext,apartfromthedate,thenthe installationcanfail.Makeanychangesrequiredtoensurethatonly thedateisdisplayedwhenyouenterthesecommands. Youshouldensurethatanypartsofloginscriptsthatgenerateany output,oraskanyquestions,aremodifiedsothattheyactonly whentheshellisaninteractiveshell 6.ToensurethatX11forwardingwillnotcausetheinstallationtofail,createa user-levelSSHclientconfigurationfilefortheOraclesoftwareowneruser,as follows: a.Usinganytexteditor,editorcreatetheoracle/.ssh/configfile. b.MakesurethattheForwardX11attributeissettono.Forexample: Host* ForwardX11no 7.YoumustrunOracleUniversalInstallerfromthissessionorremembertorepeat steps2and3beforeyoustartOracleUniversalInstallerfromadifferentterminal session. PreventingOracleClusterwareInstallationErrorsCausedbysttyCommands DuringanOracleClusterwareinstallation,OracleUniversalInstallerusesSSH(if available)toruncommandsandcopyfilestotheothernodes.Duringtheinstallation, hiddenfilesonthesystem(forexample,.bashrcor.cshrc)willcauseinstallationerrors iftheycontainsttycommands. Toavoidthisproblem,youmustmodifythesefilestosuppressalloutputonSTDERR, asinthefollowingexamples: Bourne,Bash,orKornshell: if-t0;then sttyintrC fi Cshell: test-t0 if($status=0)then sttyintrC endif Note:ThefirsttimeyouuseSSHtoconnecttoanodefroma particularsystem,youmayseeamessagesimilartothefollowing: Theauthenticityofhostnode1(53)cantbe established. RSAkeyfingerprintis 7z:ez:e7:f6:f4:f2:4f:8f:9z:79:85:62:20:90:92:z9. Areyousureyouwanttocontinueconnecting(yes/no)? Enteryesattheprompttocontinue.Youshouldnotseethis messageagainwhenyouconnectfromthissystemtothatnode. Ifyouseeanyothermessagesortext,apartfromthedate,thenthe installationcanfail.Makeanychangesrequiredtoensurethatonly thedateisdisplayedwhenyouenterthesecommands. Youshouldensurethatanypartsofloginscriptsthatgenerateany output,oraskanyquestions,aremodifiedsothattheyactonly whentheshellisaninteractiveshell Note:WhenSSHisnotavailable,theInstallerusesthershand rcpcommandsinsteadofsshandscp. Iftherearehiddenfilesthatcontainsttycommandsthatareloaded bytheremoteshell,thenOUIindicatesanerrorandstopsthe installation.10、 安装fix包所需补丁 到IBM网站上下载补丁 11、 重启动主机 shutdown-Fr 12、 配置hacmp 创建集群 #smittyhacmp InitializationandStandardConfiguration AddNodestoanHACMPCluster ConfigureNodestoanHACMPCluster(standard) Typeorselectvaluesinentryfields. PressEnterAFTERmakingalldesiredchanges. EntryFields *ClusterNametest NewNodes(via