corosync+pacemaker安装配置实验

Corosync安装测试一、实验要求1、corosync+pacemaker集群安装测试二、架构拓扑网络要求：所有服务器位于同一VLan机器无特殊要求。三、系统环境1、操作系统：CentOS6.62、相关软件：corosync、pacemaker、pcs3、网络要求：/etc/hosts文件添加双方主机名列表。四、地址规划名称角色IP地址虚拟IP地址CentOS-66A主服务器15CentOS-66B从服务器25五、安装软件1、安装支持软件#在编译安装之前，必须安装内核开发包，以及支持库[shell]#yum-yinstallgccgcc-c++kernel-developensslopenssl-devel[shell]#yum-yinstallautomakeautoconfpkgconfignssnss-devel[shell]#yum-yinstalllibqblibqb-devellibtoollibtool-ltdl-devel[shell]#yum-yinstallglib2glib2-devellibuuidlibuuid-devel[shell]#yum-yinstalllibxml2libxml2-devellibxsltlibxslt-devel[shell]#yum-yinstallbzip2bzip2-develdbusdbus-devel[shell]#yum-yinstallpampam-devellibesmtplibesmtp-devel[shell]#yum-yinstallfence-agentsresource-agentsdocbook-style-xsl[shell]#yum-yinstallcluster-gluecluster-glue-libscluster-glue-libs-devel[shell]#yum-yinstallgnutlsgnutls-develpythonpython-develpython-lxml2.1、创建所需的用户和组#在编译安装之前，创建软件所需的用户(hacluster)和组(haclient)[shell]#groupadd-g201haclient[shell]#useradd-ghaclient-u201-s/sbin/nologin-Mhacluster[shell]#passwdhacluster##设置群集管理用户的密码2.2、编译安装corosync、pacemaker、pcs软件，使用默认路径安装。##编译安装corosync（作为通信层并提供关系管理服务）[shell]#tar-xvzfcorosync-2.3.4.tar.gz-C/usr/local/src[shell]#cd/usr/local/src/corosync-2.3.4[shell]#./configure##--prefix=/usr/local/corosync[shell]#make&&makeinstall##编译安装pacemaker（实现资源管理）[shell]#tar-xvzfpacemaker-master.tar.gz-C/usr/local/src[shell]#cd/usr/local/src/pacemaker-master[shell]#exportPKG_CONFIG_PATH=/usr/lib64/pkgconfig##指定corosync相关库[shell]#./autogen.sh##用于生成configure文件[shell]#./configure[shell]#make&&makeinstall##使用yum安装pcs&pcsd（Pacemaker/Corosync配置工具）[shell]#yum-yinstallpcs#注：可以编译安装resource-agents以获取更多ocf格式资源包，也可以使用crmshCLI工具来配置管理群集。#推荐使用yum安装corosync+pacemaker[shell]#yum-yinstallcorosyncpacemakerpcs2.3、拷贝配置文件、启动脚本[shell]#mkdir-p/etc/cluster/[shell]#ln-s/etc/rc.d/init.d/corosync/etc/rc.d/init.d/cman[shell]#ln-s/usr/sbin/corosync-cmapctl/usr/sbin/corosync-objctl[shell]#cp/etc/corosync/corosync.conf.example/etc/corosync/corosync.conf2.4启动软件[shell]#ldconfig–v##刷新系统运行库缓存[shell]#servicepcsdstart[shell]#servicecorosyncstart[shell]#servicepacemakerstart六、软件配置1、主配置文件（/etc/corosync/corosync.conf）：[shell]#vi/etc/corosync/corosync.conf#Pleasereadthecorosync.conf.5manualpagetotem{version:2secauth:offthreads:0rrp_mode:active##使用多个心跳接口时，必须指定rrp_mode参数：none,active,orpassiveinterface{ringnumber:0bindnetaddr:mcastaddr:mcastport:5405ttl:1}##配置第二条心跳路径的接口IPinterface{ringnumber:1bindnetaddr:mcastaddr:mcastport:5405ttl:1}}logging{fileline:offto_stderr:noto_logfile:yeslogfile:/var/log/cluster/corosync.logto_syslog:yesdebug:offtimestamp:onlogger_subsys{subsys:AMFdebug:off}}##只有二个群集节点时，corosync2.x配置文件中必须配置quorum内容：quorum{ #Enablethetwo_nodesdirectiveprovider:corosync_votequorumexpected_votes:2two_node:1}##加载CorosyncPacemakerplugin[shell]#vi/etc/corosync/service.d/pcmkservice{ #LoadthePacemakerClusterResourceManager name:pacemaker ver:1}##推荐：corosync节点使用加密通信，利用“/dev/random”随机数函数生成密钥[shell]#corosync-keygen[shell]#scp/etc/corosync/authkeyroot@2:/etc/corosync/2、配置群集主机间SSH信任连接[shell]#ssh-keygen-trsa[shell]#scp/root/.ssh/id_rsa.pubroot@2:/root[shell]#cat/root/id_rsa.pub>>/root/.ssh/authorized_keys3、配置群集ConfigureCorosync##配置群集节点的认证asthehaclusteruser:[shell]#pcsclusterauthnode11node12[shell]#pcsclustersetup--namemyclusternode11node12…………4、因没有Fencing设备，禁用STONITH组件功能##TodisableSTONITH,setthestonith-enabledclusteroptiontofalse:[shell]#pcspropertysetstonith-enabled=false[shell]#crm_verify-L-V5、二个节点时，禁用quorum策略功能[shell]#pcspropertysetno-quorum-policy=ignore6、pcsd相关配置（/usr/lib/pcsd/）##启用pcsd（pscwebgui）远程管理，端口2224；[shell]#mv/usr/lib/pcsd/pcsd.rb/usr/lib/pcsd/pcsd.rb.bak[shell]#cp/usr/lib/pcsd/pcsd.rb.disable-gui/usr/lib/pcsd/pcsd.rb[shell]#servicepcsdrestart##启动pcsd服务七、测试1、可以使用命令查看日志文件：[shell]#tail-f/var/log/messages[shell]#tail-n30/var/log/pacemaker.log[shell]#tail-n30/var/log/cluster/corosync.log2、可以使用corosync-cfgtool命令查看群集：[shell]#corosync-cfgtool-sPrintingringstatus.LocalnodeID2130706433RINGID0id=status=ring0activewithnofaults[shell]#corosync-cmapctl|grepmembers3、可以使用pacemakerd-F命令查看安装组件：[shell]#pacemakerd-FPacemaker1.1.12(Build:d262b21)Supportingv3.0.9:libqb-logginglibqb-ipclha-fencingupstartnagioscorosync-nativeatomic-attrdacls附：错误处理A、软件编译时错误解决办法：1、configure:error:Packagerequirements(nss)werenotmet解决方式：yum-yinstallnssnss-develconfigure:error:Packagerequirements(libqb)werenotmet:解决方式：yum-yinstalllibqblibqb-devel3、configure:error:Youdonothavethelibuuiddevelopmentpackageinstalled解决方式：yum-yinstalllibuuidlibuuid-develglib2glib2-devel4、checkingforcpg...configure:error:Packagerequirements(libcpg)werenotmet:Nopackage'libcpg'found解决方式：exportPKG_CONFIG_PATH=/usr/local/corosync/lib/pkgconfig2、软件运行时错误处理1、[shell]#pcsclusterauthnode21node22Error:unabletoconnecttopcsdonnode21Er