Veritas Cluster for AIX安装配置指南

VCS for AIX 安装配置指南安装配置指南 1 建议安装最新的 AIX 补丁 oslevel r 5100 05 表示已经安装了 ML05 2 硬件环境准备 公网 如 en0 en1 已经连接到网络上 私网 如 en2 en3 通过两根交叉线互连 共享磁盘阵列连接正常 并能被两台服务器识别 足够的磁盘空间 opt 78M usr 13M var 2M 3M 3 设置 PATH 和 MANPATH 环境变量 PATH sbin usr sbin opt VRTSvcs bin PATH export PATH MANPATH MANPATH opt VRTS man export MANPATH 4 允许两台服务器之间可以 rlogin 在每台服务器的根目录下编辑 rhosts 文件 在其中写上一个 号 为了安 全起见 在安装完成后建议将 rhosts 文件删除 5 修改 etc pse conf 使得 LLT Driver 工作 去除 ethernet driver 所在行前的 注释符 如下所示 d dlpi en dev dlpi en streams dlpi ethernet driver 在 PSE Modules 部分加上如下一行 d llt LLTdriver Reboot the server 6 设置 SCSI Identifier 对于光纤磁盘阵列 跳过这一步 直接进入第 7 步 每台服务器必须使用唯 一的 SCSI Identifier 检查是否每台 AIX 服务器使用相同的 SCSI Identifier 通常 AIX SCSI Identifier 被设置成缺省值 7 通过下面的命令可以显示 id 值 dy db2 opt lsdev Cc adapter grep scsi scsi0 Available 1S 08 Wide Ultra 3 SCSI I O Controller scsi1 Available 1S 09 Wide Ultra 3 SCSI I O Controller scsi2 Available 1c 08 Wide Fast 20 SCSI I O Controller dy db2 opt lsattr El scsi0 a id id 7 Adapter card SCSI ID True dy db1 lsdev Cc adapter grep scsi scsi0 Available 1S 08 Wide Ultra 3 SCSI I O Controller scsi1 Available 1S 09 Wide Ultra 3 SCSI I O Controller scsi2 Available 1c 08 Wide Fast 20 SCSI I O Controller dy db1 lsattr El scsi0 a id id 7 Adapter card SCSI ID True 通过 smitty scsia 或下面的命令可以更改 id 值 dy db1 chdev p l scsi a id 5 更改完成后需要重新启动服务器 然后通过 lspv 命令去检查是否每台服务 器都能识别共享磁盘阵列上的硬盘设备 7 校验共享磁盘设备 通过 lspv 命令来校验是否每台服务器都能识别到共享磁盘 north lspv hdisk0 0003128f6f283f95 rootvg hdisk1 none None hdisk2 none None hdisk3 none None hdisk4 none None south lspv hdisk0 0003127f6e97dbe6 rootvg hdisk1 none None hdisk2 none None hdisk3 none None hdisk4 none None 如果 LVM 或 VxVM 没有控制某块硬盘 那么共享的 Physical Volume s ID number 可能不会显示 可以执行如下命令后再校验 north chdev l hdisk2 a pv yes hdisk2 changed south chdev l hdisk2 a pv yes hdisk2 changed 通过再次运行 lspv 可以看到 hdisk2 在两台服务器上使用相同的 PV ID number 也就表示这是同一块硬盘被共享使用 north lspv hdisk0 0003128f6f283f95 rootvg hdisk1 none None hdisk2 0003127fe6ee6473None hdisk3 none None hdisk4 none None south lspv hdisk0 0003127f6e97dbe6 rootvg hdisk1 none None hdisk2 0003127fe6ee6473 None hdisk3 none None hdisk4 none None 8 关于 Logical Volume Manager LVM LVM is installed by default Use smit or the command line to configure volume groups and logical volumes Shared logical volumes cannot be in volume group rootvg Disks on the shared bus must be configured into volume groups other than rootvg Shared volume groups must be imported on all systems in the cluster but active on no more than one system in the cluster at any time Be sure that all etc filesystems mount entries have a mount false declaration VCS mounts these file systems automatically Do not add file systems to etc exports VCS exports them automatically Whether creating volume groups on shared storage or creating file systems using mkfs or crfs to reside on shared storage create them on one system only VCS mounts them on other systems in the cluster as necessary Make sure that the auto on attribute of a volume group is set to a no value VCS must control the activation and deactivation of a volume group 9 设置共享 VG 的 auto on 属性为 n Determine the current value of the auto on attribute using the command lsattr El volume group name The auto on attribute is set to y in the following example output dy db2 lsattr El datavg vgserial id 00575bac00004c00000000fcb68cd7df N A False auto on y N A True conc capable n N A True conc auto on n N A True timestamp 40b43e9f2ec11946 N A True Change the auto on attribute to n on all systems Note that the volume group must be activated on the system where you enter the chvg command dy db1 chvg a n datavg dy db1 varyoffvg datavg dy db2 varyonvg datavg dy db2 chvg a n datavg Confirm the change dy db2 lsattr El datavg vgserial id 00575bac00004c00000000fcb68cd7df N A False auto on n N A True conc capable n N A True conc auto on n N A True timestamp 40b43e9f2ec11946 N A True 10 创建 etc filesystems 条目 When using AIX version 5 1 0 15 you must create mount entries in the etc filesystems file on all systems These entries are needed to determine the volume s virtual file system type Entries using LVM logical volumes and the JFS file system resemble this opt oracle wacos dev dev wacos vfs jfs log dev loglv00 mount false check false options rw account false Entries using VxVM volumes and the VxFS file system resemble this opt oracle wacos dev dev vx dsk oradg wacosvol vfs vxfs mount false check false 11 获得 VCS License Key You can obtain your license key most efficiently using the VERITAS vLicense web site The License Key Request Form LKRF has all the information needed to establish a User Account on vLicense and generate your license key The LKRF is a one page insert included with the CD in your product package You must have this form to obtain a software license key for your VERITAS product 如果只是想试用 请联系VERITAS销售代表或技术人员获得试用License Key 12 准备安装 Cluster 需要的信息 A name for the cluster The name must begin with a letter of the alphabet a z A Z dydbvcs A unique ID number for the cluster Within the site containing the cluster each cluster must have a unique ID The host names of the systems in the cluster Valid license keys for each system in the cluster or a valid site license key Device names of the network interface cards used by the private networks among systems 13 Cluster Manager 需要的虚拟 IP 地址 The device name for the NIC providing public network access A virtual IP address associated with the NIC This virtual IP address becomes a resource for use by the ClusterService group that includes the VCS Cluster Manager Web Console The Cluster Virtual IP address can fail over to another cluster system making the Web Console highly available The subnet used with the Virtual Address 14 配置 SMTP 通知需要准备的信息 The domain based address of the SMTP server that is to send notification email about the events within the cluster For example The email address of each SMTP recipient to be notified For example admin The minimum severity of events for SMTP email notification Events have four levels of severity Information Warning Error and SevereError 15 配置 SNMP 通知需要准备的信息 The port number for the SNMP trap daemon by default this is 162 The machine name for each SNMP console The minimum severity of events for SNMP trap notification Events have four levels of severity Information Warning Error and SevereError 16 开始 VCS 软件的安装 mount V cdrfs o ro dev cd0 cdrom cd cdrom installvcs 接下来 按照屏幕提示输入相应的信息 详细安装过程及输入信息如下所示 installvcs Enter the names of the systems on which VCS is to be installed separated by spaces example system1 system2 dy db1 dy db2 Checking for ssh on dy db1 not found Checking OS version on dy db1 AIX 5 1 Checking dev dlpi en in etc pse conf on dy db1 found Checking llt in etc pse conf on dy db1 found Verifying communication with dy db2 ping successful Attempting rsh with dy db2 rsh successful Checking OS version on dy db2 AIX 5 1 Checking dev dlpi en in etc pse conf on dy db2 found Checking llt in etc pse conf on dy db2 found Creating tmp subdirectory on dy db2 tmp subdirectory created Using usr bin rsh and usr bin rcp to communicate with dy db2 Communication check completed successfully VCS licensing verification Checking dy db1 No license key found Enter the license key for dy db1 PJPU W6RP 7WXS W4O4 VUZP Valid VCS Demo key entered for dy db1 Registering key PJPU W6RP 7WXS W4O4 VUZP on dy db1 Done Registering key PJPU W6RP 7WXS W4O4 VUZP on dy db2 Done VCS licensing completed successfully Are you ready to start the Cluster installation now Y y Checking current installation on dy db1 Checking VRTSvcsw rte Not installed Checking VRTSweb rte Not installed Checking VRTSvcs man Not installed Checking VRTSvcs doc Not installed Checking VRTSvcsag rte Not installed Checking VRTSvcs msg en US Not installed Checking VRTSvcs rte Not installed Checking VRTSgab rte Not installed Checking VRTSllt rte Not installed Checking VRTSvlic Not installed Checking current installation on dy db2 Checking VRTSvcsw rte Not installed Checking VRTSweb rte Not installed Checking VRTSvcs man Not installed Checking VRTSvcs doc Not installed Checking VRTSvcsag rte Not installed Checking VRTSvcs msg en US Not installed Checking VRTSvcs rte Not installed Checking VRTSgab rte Not installed Checking VRTSllt rte Not installed Checking VRTSvlic Not installed Installation check completed successfully To configure VCS the following is required A unique Cluster name A unique Cluster ID number between 0 255 Two NIC cards on each system used for private network heartbeat links Are you ready to configure VCS on these systems Y y To configure VCS the following is required A unique Cluster name A unique Cluster ID number between 0 255 Two NIC cards on each system used for private network heartbeat links Are you ready to configure VCS on these systems Y y Enter the unique cluster name dydbvcs Enter the unique Cluster ID number from 0 255 1 Discovering ENs on dy db1 discovered en0 en1 en2 en3 Enter the EN for the first private network heartbeat link on dy db1 en0 en1 en2 en3 en2 Enter the EN for the second private network heartbeat link on dy db1 en0 en1 en3 en3 Are you using the same ENs for private heartbeat links on all systems Y y Cluster information verification Cluster Name dydbvcs Cluster ID Number 1 Private Network Heartbeat Links for dy db1 link1 en2 link2 en3 Private Network Heartbeat Links for dy db2 link1 en2 link2 en3 Is this information correct Y y The following information is required to configure Cluster Manager A public Ethernet Network used by each system in the cluster One or more Network Host IP addresses for connection checking A Virtual IP address and netmask for Cluster Manager Do you want to configure Cluster Manager Web Console Y y Active EN devices discovered on dy db1 en0 en2 en3 Enter the EN for Cluster Manager Web Console to use on dy db1 en0 en0 Is en0 the public EN used for all systems Y y Enter the Network Host IP addresses separated by spaces 10 144 129 1 Enter the Virtual IP address for Cluster Manager 10 144 129 150 Enter the netmask for IP 10 144 129 150 255 255 255 0 255 255 255 0 Cluster Manager Web Console verification EN en0 NetworkHost 10 144 129 1 IP 10 144 129 150 Netmask 255 255 255 0 Is this information correct Y y The following information is required to configure SMTP notification The domain based address of the SMTP server The email address of each SMTP recipient A minimum severity level of messages to send to each recipient Do you want to configure SMTP notification Y n The following information is required to configure SNMP notification System names of SNMP console s to receive VCS trap messages SNMP trap daemon port numbers for each console A minimum severity level of messages to send to each console Do you want to configure SNMP notification Y n Installing VCS 3 5 0 0 on dy db1 Installing VRTSvlic package Done Installing VRTSllt rte package Done Installing VRTSgab rte package Done Installing VRTSvcs rte package Done Installing VRTSvcs msg en US package Done Installing VRTSvcsag rte package Done Installing VRTSvcs doc package Done Installing VRTSvcs man package Done Installing VRTSweb rte package Done Installing VRTSvcsw rte package Done Copying the installer to opt VRTSvcs install Done Copying VCS Release Notes to opt VRTSvcs docs Done Installing VCS 3 5 0 0 on dy db2 Copying VRTSvlic binaries Done Installing VRTSvlic package Done Copying VRTSllt rte binaries Done Installing VRTSllt rte package Done Copying VRTSgab rte binaries Done Installing VRTSgab rte package Done Copying VRTSvcs rte binaries Done Installing VRTSvcs rte package Done Copying VRTSvcs msg en US binaries Done Installing VRTSvcs msg en US package Done Copying VRTSvcsag rte binaries Done Installing VRTSvcsag rte package Done Copying VRTSvcs doc binaries Done Installing VRTSvcs doc package Done Copying VRTSvcs man binaries Done Installing VRTSvcs man package Done Copying VRTSweb rte binaries Done Installing VRTSweb rte package Done Copying VRTSvcsw rte binaries Done Installing VRTSvcsw rte package Done Copying the installer to opt VRTSvcs install Done Copying VCS Release Notes to opt VRTSvcs docs Done Package installation completed successfully Configuring VCS Done Copying VCS configuration files to dy db1 Done Copying VCS configuration files to dy db2 Done Configuration files copied successfully Do you want to start the cluster components now Y y Starting VCS on dy db1 Starting LLT Started Starting GAB Started Starting VCS Started Starting VCS on dy db2 Starting LLT Started Starting GAB Started Starting VCS Started Initial VCS configuration files are backed up with a init dydbvcs extension The Cluster can be managed using Cluster Manager Web Console using the URL http 10 144 129 150 8181 vcs using the User Name admin and the Password password Use the opt VRTSvcs bin hauser command to add new users To manage your Cluster s using Cluster Manager Java Console add the VRTScscm rte package to a non clustered system A VCS install report has been saved at var VRTSvcs installvcsReport dydbvcs VCS installation completed successfully 17 VCS Oracle Agent 软件的安装 需要在每台服务器上执行如下命令 mount V cdrfs o ro dev cd0 cdrom cd cdrom installp ac d cdrom VRTSvcsor rte bff VRTSvcsor rte 18 Oracle 的深层次监控 Oracle的深度监控可以监控到进程在但实际数据库无法访问的情况 如果需 要对Oracle进行深度监控 则需要执行以下步骤 For Oracle versions 9i and above enter ORACLE HOME bin sqlplus ORACLE HOME bin sqlplus asas sysdba sysdba As the database administrator issue the following statements to create the test table SQLPLUS createcreate useruser vcsuservcsuser 2 identifiedidentified byby vcspasswdvcspasswd 3 defaultdefault tablespacetablespace USERSUSERS 4 temporarytemporary tablespacetablespace TEMPTEMP 5 quotaquota 500K500K onon USERS USERS SQLPLUS grantgrant createcreate sessionsession toto vcsuservcsuser SQLPLUS createcreate tabletable vcsuser vcstablevcsuser vcstable tstamptstamp datedate SQLPLUS insertinsert intointo vcsuser vcstablevcsuser vcstable tstamp tstamp valuesvalues SYSDATE SYSDATE 19 VCS 及 Oracle Agent 的配置 cp etc VRTSvcs conf OracleTypes cf etc VRTSvcs conf config OracleTypes cf cp etc VRTSvcs conf sample oracle main cf etc VRTSvcs conf config main cf 对main cf做相应的修改 如cluster name system name VG name LVM IP address etc 修改后的main cf例子如下 include types cf include OracleTypes cf cluster dydbvcs UserNames admin cDRpdxPmHpzS Administrators admin CounterInterval 5 system dy db1 system dy db2 group ClusterService SystemList dy db1 0 dy db2 1 AutoStartList dy db1 dy db2 OnlineRetryLimit 3 IPMultiNIC webip Address 10 144 129 150 NetMask 255 255 255 0 MultiNICAResName mnic MultiNICA mnic Device dy db1 en0 10 144 129 11 en1 10 144 129 11 Device dy db2 en0 10 144 129 12 en1 10 144 129 12 NetMask 255 255 255 0 Gateway 10 144 129 1 BroadcastAddr 10 144 129 255 HandshakeInterval 3 NetworkHosts 10 144 129 1 VRTSWebApp VCSweb Critical 0 AppName vcs InstallDir opt VRTSweb VERITAS TimeForOnline 5 VCSweb requires webip webip requires mnic resource dependency tree group ClusterService VRTSWebApp VCSweb IPMultiNIC webip MultiNICA mnic group oragrp SystemList dy db1 0 dy db2 1 AutoStartList dy db1 IPMultiNIC oraip Address 10 144 129 10 NetMask 255 255 255 0 MultiNICAResName mnic LVMVG Ora Vol VolumeGroup oravg MajorNumber 50 Disks dlmfdrv2 dlmfdrv0 dlmfdrv1 Mount archmnt MountPoint opt oracle arch BlockDevice dev arch FSType jfs FsckOpt y Mount backupmnt MountPoint opt oracle backup BlockDevice dev backup FSType jfs FsckOpt y Mount db02mnt MountPoint opt oracle db02 BlockDevice dev db02 FSType jfs FsckOpt y Mount db03mnt MountPoint opt oracle db03 BlockDevice dev db03 FSType jfs FsckOpt y Mount db04mnt MountPoint opt oracle db04 BlockDevice dev db04