Veritas Cluster for AIX安装配置指南.doc

VCS for AIX安装配置指南1. 建议安装最新的AIX补丁oslevel r#5100-05 表示已经安装了ML05 2. 硬件环境准备 公网（如en0, en1）已经连接到网络上 私网（如en2, en3）通过两根交叉线互连 共享磁盘阵列连接正常，并能被两台服务器识别 足够的磁盘空间（/opt 78M、/usr 13M、/var 2M、/ 3M）3. 设置PATH和MANPATH环境变量PATH=/sbin:/usr/sbin:/opt/VRTSvcs/bin:$PATH; export PATHMANPATH=$MANPATH:/opt/VRTS/man; export MANPATH4. 允许两台服务器之间可以rlogin在每台服务器的根目录下编辑/.rhosts文件，在其中写上一个+号。为了安全起见，在安装完成后建议将/.rhosts文件删除。5. 修改/etc/pse.conf使得LLT Driver工作 去除ethernet driver所在行前的注释符，如下所示d+ dlpi en /dev/dlpi/en # streams dlpi ethernet driver 在PSE Modules部分加上如下一行d llt# LLTdriver Reboot the server6. 设置SCSI Identifier对于光纤磁盘阵列，跳过这一步，直接进入第7步。每台服务器必须使用唯一的SCSI Identifier，检查是否每台AIX服务器使用相同的SCSI Identifier，通常AIX SCSI Identifier被设置成缺省值7。通过下面的命令可以显示id值：dy_db2:/opt#lsdev -Cc adapter | grep scsiscsi0 Available 1S-08 Wide/Ultra-3 SCSI I/O Controllerscsi1 Available 1S-09 Wide/Ultra-3 SCSI I/O Controllerscsi2 Available 1c-08 Wide/Fast-20 SCSI I/O Controllerdy_db2:/opt#lsattr -El scsi0 -a idid 7 Adapter card SCSI ID Truedy_db1:/#lsdev -Cc adapter | grep scsiscsi0 Available 1S-08 Wide/Ultra-3 SCSI I/O Controllerscsi1 Available 1S-09 Wide/Ultra-3 SCSI I/O Controllerscsi2 Available 1c-08 Wide/Fast-20 SCSI I/O Controllerdy_db1:/#lsattr -El scsi0 -a idid 7 Adapter card SCSI ID True通过smitty scsia或下面的命令可以更改id值：dy_db1:/chdev p l scsi a id=5更改完成后需要重新启动服务器，然后通过lspv命令去检查是否每台服务器都能识别共享磁盘阵列上的硬盘设备。7. 校验共享磁盘设备通过lspv命令来校验是否每台服务器都能识别到共享磁盘north# lspvhdisk0 0003128f6f283f95 rootvghdisk1 none Nonehdisk2 none Nonehdisk3 none Nonehdisk4 none Nonesouth# lspvhdisk0 0003127f6e97dbe6 rootvghdisk1 none Nonehdisk2 none Nonehdisk3 none Nonehdisk4 none None如果LVM或VxVM没有控制某块硬盘，那么共享的Physical Volumes ID number可能不会显示，可以执行如下命令后再校验。north # chdev -l hdisk2 -a pv=yeshdisk2 changedsouth # chdev -l hdisk2 -a pv=yeshdisk2 changed通过再次运行lspv，可以看到hdisk2在两台服务器上使用相同的PV ID number，也就表示这是同一块硬盘被共享使用。north# lspvhdisk0 0003128f6f283f95 rootvghdisk1 none Nonehdisk2 0003127fe6ee6473Nonehdisk3 none Nonehdisk4 none Nonesouth# lspvhdisk0 0003127f6e97dbe6 rootvghdisk1 none Nonehdisk2 0003127fe6ee6473 Nonehdisk3 none Nonehdisk4 none None8. 关于Logical Volume Manager (LVM) LVM is installed by default. Use smit or the command line to configure volume groups and logical volumes. Shared logical volumes cannot be in volume group rootvg. Disks on the shared bus must be configured into volume groups other than rootvg. Shared volume groups must be imported on all systems in the cluster, but active on no more than one system in the cluster at any time. Be sure that all /etc/filesystems mount entries have a mount = false declaration. VCS mounts these file systems automatically Do not add file systems to /etc/exports. VCS exports them automatically. Whether creating volume groups on shared storage, or creating file systems using mkfs or crfs to reside on shared storage, create them on one system only. VCS mounts them on other systems in the cluster as necessary. Make sure that the auto-on attribute of a volume group is set to a “no” value. VCS must control the activation and deactivation of a volume group. 9. 设置共享VG的auto_on属性为n Determine the current value of the auto_on attribute using the command:lsattr -El volume-group-nameThe auto_on attribute is set to “y” in the following example output:dy_db2:/#lsattr -El datavgvgserial_id 00575bac00004c00000000fcb68cd7df N/A Falseauto_on y N/A Trueconc_capable n N/A Trueconc_auto_on n N/A Truetimestamp 40b43e9f2ec11946 N/A True Change the auto_on attribute to “n” on all systems. Note that the volume group must be activated on the system where you enter the chvg command:dy_db1# chvg -a n datavgdy_db1# varyoffvg datavgdy_db2# varyonvg datavgdy_db2# chvg -a n datavg Confirm the change:dy_db2:/#lsattr -El datavgvgserial_id 00575bac00004c00000000fcb68cd7df N/A Falseauto_on n N/A Trueconc_capable n N/A Trueconc_auto_on n N/A Truetimestamp 40b43e9f2ec11946 N/A True10. 创建/etc/filesystems条目When using AIX version 5, you must create mount entries in the /etc/filesystems file on all systems. These entries are needed to determine the volumes virtual file system type.Entries using LVM logical volumes and the JFS file system resemble this:/opt/oracle/wacos: dev = /dev/wacos vfs = jfs log = /dev/loglv00 mount = false check = false options = rw account = falseEntries using VxVM volumes and the VxFS file system resemble this:/opt/oracle/wacos: dev = /dev/vx/dsk/oradg/wacosvol vfs = vxfs mount = false check = false11. 获得VCS License KeyYou can obtain your license key most efficiently using the VERITAS vLicense web site. The License Key Request Form (LKRF) has all the information needed to establish a User Account on vLicense and generate your license key. The LKRF is a one-page insert included with the CD in your product package. You must have this form to obtain a software license key for your VERITAS product.如果只是想试用，请联系VERITAS销售代表或技术人员获得试用License Key。12. 准备安装Cluster需要的信息 A name for the cluster. The name must begin with a letter of the alphabet (a-z, A-Z). dydbvcs A unique ID number for the cluster.Within the site containing the cluster, each cluster must have a unique ID. The host names of the systems in the cluster Valid license keys for each system in the cluster, or a valid site license key Device names of the network interface cards used by the private networks among systems13. Cluster Manager需要的虚拟IP地址 The device name for the NIC providing public network access. A virtual IP address associated with the NIC. This virtual IP address becomes a resource for use by the ClusterService group that includes the VCS Cluster Manager (Web Console). The “Cluster Virtual IP address” can fail over to another cluster system, making the Web Console highly available. The subnet used with the Virtual Address.14. 配置SMTP通知需要准备的信息 The domain-based address of the SMTP server that is to send notification email about the events within the cluster. For example, The email address of each SMTP recipient to be notified. For example, The minimum severity of events for SMTP email notification. Events have four levels of severity: Information, Warning, Error, and SevereError.15. 配置SNMP通知需要准备的信息 The port number for the SNMP trap daemon; by default this is 162 The machine name for each SNMP console The minimum severity of events for SNMP trap notification. Events have four levels of severity: Information, Warning, Error, and SevereError.16. 开始VCS软件的安装#mount V cdrfs o ro /dev/cd0 /cdrom#cd /cdrom#./installvcs接下来，按照屏幕提示输入相应的信息，详细安装过程及输入信息如下所示：# ./installvcsEnter the names of the systems on which VCS is to be installed, separated by spaces (example: system1 system2): dy_db1 dy_db2 Checking for ssh on dy_db1 . not found Checking OS version on dy_db1 . AIX 5.1 Checking /dev/dlpi/en in /etc/pse.conf on dy_db1 found Checking llt in /etc/pse.conf on dy_db1 . found Verifying communication with dy_db2. ping successful Attempting rsh with dy_db2 . rsh successful Checking OS version on dy_db2 . AIX 5.1 Checking /dev/dlpi/en in /etc/pse.conf on dy_db2 found Checking llt in /etc/pse.conf on dy_db2 . found Creating /tmp subdirectory on dy_db2 . /tmp subdirectory createdUsing /usr/bin/rsh and /usr/bin/rcp to communicate with dy_db2Communication check completed successfullyVCS licensing verification: Checking dy_db1 . No license key foundEnter the license key for dy_db1: PJPU-W6RP-7WXS-W4O4-VUZPValid VCS Demo key entered for dy_db1 Registering key PJPU-W6RP-7WXS-W4O4-VUZP on dy_db1 . Done Registering key PJPU-W6RP-7WXS-W4O4-VUZP on dy_db2 . DoneVCS licensing completed successfullyAre you ready to start the Cluster installation now? (Y) yChecking current installation on dy_db1: Checking VRTSvcsw.rte . Not installed Checking VRTSweb.rte . Not installed Checking VRTSvcs.man . Not installed Checking VRTSvcs.doc . Not installed Checking VRTSvcsag.rte . Not installed Checking VRTSvcs.msg.en_US . Not installed Checking VRTSvcs.rte . Not installed Checking VRTSgab.rte . Not installed Checking VRTSllt.rte . Not installed Checking VRTSvlic . Not installedChecking current installation on dy_db2: Checking VRTSvcsw.rte . Not installed Checking VRTSweb.rte . Not installed Checking VRTSvcs.man . Not installed Checking VRTSvcs.doc . Not installed Checking VRTSvcsag.rte . Not installed Checking VRTSvcs.msg.en_US . Not installed Checking VRTSvcs.rte . Not installed Checking VRTSgab.rte . Not installed Checking VRTSllt.rte . Not installed Checking VRTSvlic . Not installedInstallation check completed successfullyTo configure VCS the following is required: A unique Cluster name A unique Cluster ID number between 0-255 Two NIC cards on each system used for private network heartbeat linksAre you ready to configure VCS on these systems? (Y) yTo configure VCS the following is required: A unique Cluster name A unique Cluster ID number between 0-255 Two NIC cards on each system used for private network heartbeat linksAre you ready to configure VCS on these systems? (Y) yEnter the unique cluster name: dydbvcsEnter the unique Cluster ID number from 0-255: 1 Discovering ENs on dy_db1 . discovered en0 en1 en2 en3Enter the EN for the first private network heartbeat link on dy_db1: (en0 en1 en2 en3) en2Enter the EN for the second private network heartbeat link on dy_db1: (en0 en1 en3) en3Are you using the same ENs for private heartbeat links on all systems? (Y) yCluster information verification: Cluster Name: dydbvcs Cluster ID Number: 1 Private Network Heartbeat Links for dy_db1: link1=en2 link2=en3 Private Network Heartbeat Links for dy_db2: link1=en2 link2=en3Is this information correct? (Y) yThe following information is required to configure Cluster Manager: A public Ethernet Network used by each system in the cluster One or more Network Host IP addresses for connection checking A Virtual IP address and netmask for Cluster ManagerDo you want to configure Cluster Manager (Web Console) (Y) yActive EN devices discovered on dy_db1: en0 en2* en3Enter the EN for Cluster Manager (Web Console) to use on dy_db1: (en0) en0Is en0 the public EN used for all systems (Y) yEnter the Network Host IP addresses, separated by spaces: Enter the Virtual IP address for Cluster Manager: 50Enter the netmask for IP 50: ()Cluster Manager (Web Console) verification: EN: en0 NetworkHost: IP: 50 Netmask: Is this information correct? (Y) yThe following information is required to configure SMTP notification: The domain based address of the SMTP server The email address of each SMTP recipient A minimum severity level of messages to send to each recipientDo you want to configure SMTP notification? (Y) nThe following information is required to configure SNMP notification: System names of SNMP console(s) to receive VCS trap messages SNMP trap daemon port numbers for each console A minimum severity level of messages to send to each consoleDo you want to configure SNMP notification? (Y) nInstalling VCS on dy_db1: Installing VRTSvlic package . Done Installing VRTSllt.rte package . Done Installing VRTSgab.rte package . Done Installing VRTSvcs.rte package . Done Installing VRTSvcs.msg.en_US package . Done Installing VRTSvcsag.rte package . Done Installing VRTSvcs.doc package . Done Installing VRTSvcs.man package . Done Installing VRTSweb.rte package . Done Installing VRTSvcsw.rte package . Done Copying the installer to /opt/VRTSvcs/install . Done Copying VCS Release Notes to /opt/VRTSvcs/docs . DoneInstalling VCS on dy_db2: Copying VRTSvlic binaries . Done Installing VRTSvlic package . Done Copying VRTSllt.rte binaries . Done Installing VRTSllt.rte package . Done Copying VRTSgab.rte binaries . Done Installing VRTSgab.rte package . Done Copying VRTSvcs.rte binaries . Done Installing VRTSvcs.rte package . Done Copying VRTSvcs.msg.en_US binaries . Done Installing VRTSvcs.msg.en_US package . Done Copying VRTSvcsag.rte binaries . Done Installing VRTSvcsag.rte package . Done Copying VRTSvcs.doc binaries . Done Installing VRTSvcs.doc package . Done Copying VRTSvcs.man binaries . Done Installing VRTSvcs.man package . Done Copying VRTSweb.rte binaries . Done Installing VRTSweb.rte package . Done Copying VRTSvcsw.rte binaries . Done Installing VRTSvcsw.rte package . Done Copying the installer to /opt/VRTSvcs/install . Done Copying VCS Release Notes to /opt/VRTSvcs/docs . DonePackage installation completed successfully Configuring VCS . Done Copying VCS configuration files to dy_db1 . Done Copying VCS configuration files to dy_db2 . DoneConfiguration files copied successfullyDo you want to start the cluster components now? (Y) yStarting VCS on dy_db1 Starting LLT . Started Starting GAB . Started Starting VCS . StartedStarting VCS on dy_db2 Starting LLT . Started Starting GAB . StartedStarting VCS . StartedInitial VCS configuration files are backed up with a .init.dydbvcs extensionThe Cluster can be managed using Cluster Manager (Web Console) using the URL: 50:8181/vcsusing the User Name: admin and the Password: password.Use the /opt/VRTSvcs/bin/hauser command to add new users.To manage your Cluster(s) using Cluster Manager (Java Console) add theVRTScscm.rte package to a non-clustered system.A VCS install report has been saved at: /var/VRTSvcs/installvcsReport.dydbvcsVCS installation completed successfully17. VCS Oracle Agent软件的安装需要在每台服务器上执行如下命令：#mount V cdrfs o ro /dev/cd0 /cdrom#cd /cdrom#installp ac d /cdrom/VRTSvcsor.rte.bff VRTSvcsor.rte18. Oracle的深层次监控Oracle的深度监控可以监控到进程在但实际数据库无法访问的情况，如果需要对Oracle进行深度监控，则需要执行以下步骤。For Oracle versions 9i and above, enter:$ $ORACLE_HOME/bin/sqlplus / as sysdbaAs the database administrator, issue the following statements to create the test table:SQLPLUS create user vcsuser2 identified by vcspasswd3 default tablespace USERS4 temporary tablespace TEMP5 quota 500K on USERS;SQLPLUS grant create session to vcsuserSQLPLUS create table vcsuser.vcstable ( tstamp date );SQLPLUS insert into vcsuser.vcstable (tstamp) values (SYSDATE);19. VCS及Oracle Agent的配置 #cp /etc/VRTSvcs/conf/OracleTypes.cf /etc/VRTSvcs/conf/config/OracleTypes.cf #cp /etc/VRTSvcs/conf/sampl