RHEL6_LAMP环境双机热备.doc

1. 实验环境节点1： 1节点2： 2Iscsi存储/配置服务器： 1.1. Hosts 文件或DNS设置 localhost localhost.localdomain localhost4 localhost4.localdomain4:1 localhost localhost.localdomain localhost6 localhost6.localdomain61 v12 v2 rhel61.2.配置使用DVD做yum源1. 新建DVD挂载目录rootrhel6 # mkdir /media/iso2. 挂载DVD到指定目录rootrhel6 # mount /dev/cdrom /media/iso/3.进入yum.repos.d文件rootrhel6 # cd /etc/yum.repos.d/4.删除原有的repo文件rootrhel6 yum.repos.d# rm rf *5.使用dvd为源的repo文件rootrhel6 yum.repos.d# vim iso.repoServername=Serverbaseurl=file:/media/iso/Serverenabled=1gpgcheck=0HighAvailabilityname=HighAvailabilitybaseurl=file:/media/iso/HighAvailabilityenabled=1gpgcheck=0LoadBalancername=LoadBalancerbaseurl=file:/media/iso/LoadBalancerenabled=1gpgcheck=06. 清空原有yum信息rootrhel6 yum.repos.d# yum clean all7更新yumrootrhel6 yum.repos.d# yum update2. 配置集群之前 2.1.存储配置 2.1.1. ISCSI服务器 1. 上sda1和sda2为/分区和swap分区，尚余一部分磁盘空间未分配，用fdisk分出sda3一个分区（10G）准备用作iscsi共享存储。 2. 安装scsi-target-utils软件提供iscsi服务rootrhel6 # yum install scsi-target-utils3. 修改/etc/tgt/targets.conf,添加：backing-store /dev/sda3(注：这只是简单的配置，其他详细配置请参考target.cong中的注释说明)4. 重启tgtd服务，并将其设为开机启动：rootrhel6 # /etc/init.d/tgtd restart停止 SCSI target daemon：not running 失败正在启动 SCSI target daemon： 确定rootrhel6 # chkconfig tgtd onrootrhel6 # chkconfig tgtd -listtgtd 0:关闭1:关闭2:启用3:启用4:启用5:启用6:关闭重启电脑5. 查看服务状态，可以看到已经提供了一个10G的ISCSI LUN1卷rootrhel6 /# tgt-admin -sTarget 1: .domain:server.target1 System information: Driver: iscsi State: ready I_T nexus information: LUN information: LUN: 0 Type: controller SCSI ID: IET 00010000 SCSI SN: beaf10 Size: 0 MB, Block size: 1 Online: Yes Removable media: No Readonly: No Backing store type: null Backing store path: None Backing store flags: LUN: 1 Type: disk SCSI ID: IET 00010001 SCSI SN: beaf11 Size: 17176 MB, Block size: 512 Online: Yes Removable media: No Readonly: No Backing store type: rdwr Backing store path: /dev/sda3 Backing store flags: Account information: ACL information: ALL6.打开防火墙端口3260或关闭防火墙vi /etc/sysconfig/iptables 添加-A INPUT -m state -state NEW -m tcp -p tgtd -dport 3260 -j ACCEPT然后重启iptablesrootrhel6 /# /etc/init.d/iptables restartiptables：清除防火墙规则： 确定iptables：将链设置为政策 ACCEPT：nat mangle filter 确定iptables：正在卸载模块： 确定iptables：应用防火墙规则： 确定(注：关闭防火墙更好点)2.1.2. ISCSI客户机1.安装iscsi客户端软件iscsi-initiator-utilsrootv1 yum.repos.d# yum install iscsi-initiator-utils2.发现服务器 的iscsi共享卷(之前应该打相应服务tgtd)rootv1 /# iscsiadm -m discovery -t sendtargets -p rhel6:3260,1 .domain:server.target1You have new mail in /var/spool/mail/rootrootv1 /# iscsiadm -m discovery -t sendtargets -p :3260,1 .domain:server.target13.登录iscsi存储：rootv1 /# iscsiadm -m node -T .domain:server.target1 -p :3260 -lLogging in to iface: default, target: .domain:server.target1, portal: ,3260Login to iface: default, target: .domain:server.target1, portal: ,3260 successful.(注：使用iscsiadm -m node -T target 名称 -p targetip地址：端口号 -login 命令)4.查看本地存储，可以发现/dev/sdarootv1 /# fdisk -lDisk /dev/sda: 34.4 GB, 34359738368 bytes255 heads, 63 sectors/track, 4177 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0x000ad1e4 Device Boot Start End Blocks Id System/dev/sda1 * 1 64 512000 83 LinuxPartition 1 does not end on cylinder boundary./dev/sda2 64 2611 20458496 8e Linux LVMDisk /dev/mapper/VolGroup-lv_root: 18.8 GB,bytes255 heads, 63 sectors/track, 2289 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0x00000000Disk /dev/mapper/VolGroup-lv_root doesnt contain a valid partition tableDisk /dev/mapper/VolGroup-lv_swap: 2113 MB, 2113929216 bytes255 heads, 63 sectors/track, 257 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0x00000000Disk /dev/mapper/VolGroup-lv_swap doesnt contain a valid partition tableDisk /dev/sdb: 17.2 GB,bytes255 heads, 63 sectors/track, 2088 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0x00000000 Device Boot Start End Blocks Id System/dev/sdb1 1 2089 16773166 83 Linux5.卸载ISCSI存储rootv1 /# iscsiadm -m node -T .domain:server.target1 -p :3260 -uLogging out of session sid: 1, target: .domain:server.target1, portal: ,3260Logout of sid: 1, target: .domain:server.target1, portal: ,3260 successful.6.再次查看本地存储，/dev/sdb已经卸载rootv1 /# fdisk -lDisk /dev/sda: 34.4 GB, 34359738368 bytes255 heads, 63 sectors/track, 4177 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0x000ad1e4 Device Boot Start End Blocks Id System/dev/sda1 * 1 64 512000 83 LinuxPartition 1 does not end on cylinder boundary./dev/sda2 64 2611 20458496 8e Linux LVMDisk /dev/mapper/VolGroup-lv_root: 18.8 GB,bytes255 heads, 63 sectors/track, 2289 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0x00000000Disk /dev/mapper/VolGroup-lv_root doesnt contain a valid partition tableDisk /dev/mapper/VolGroup-lv_swap: 2113 MB, 2113929216 bytes255 heads, 63 sectors/track, 257 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0x00000000Disk /dev/mapper/VolGroup-lv_swap doesnt contain a valid partition table7. 在其他的节点上挂载ISCSI,可以看到：rootv2 桌面# iscsiadm -m node -T .domain:server.target1 -p :3260 -lLogging in to iface: default, target: .domain:server.target1, portal: ,3260Login to iface: default, target: .domain:server.target1, portal: ,3260 successful.rootv2 桌面# fdisk -lDisk /dev/sda: 21.5 GB, 21474836480 bytes255 heads, 63 sectors/track, 2610 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0x000ad1e4 Device Boot Start End Blocks Id System/dev/sda1 * 1 64 512000 83 LinuxPartition 1 does not end on cylinder boundary./dev/sda2 64 2611 20458496 8e Linux LVMDisk /dev/mapper/VolGroup-lv_root: 18.8 GB,bytes255 heads, 63 sectors/track, 2289 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0x00000000Disk /dev/mapper/VolGroup-lv_root doesnt contain a valid partition tableDisk /dev/mapper/VolGroup-lv_swap: 2113 MB, 2113929216 bytes255 heads, 63 sectors/track, 257 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0x00000000Disk /dev/mapper/VolGroup-lv_swap doesnt contain a valid partition tableDisk /dev/sdb: 17.2 GB,bytes255 heads, 63 sectors/track, 2088 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0x00000000 Device Boot Start End Blocks Id System/dev/sdb1 1 2089 16773166 83 Linux2.2.集群软件包安装 分为集群节点和配置管理器（Luci, RHCS的web管理工具，仅仅只是配置工具，集群可脱离它正常运行） 2.2.1.集群节点 1.配置好yum源后，安装集群软件包rootv1 /# yum install ricci openais cman rgmanager lvm2-cluster gfs2-utils 3. 或者直接禁用防火墙rootv1 /# /etc/init.d/iptables stoprootv1 /# chkconfig iptables off4. 关闭节点上的acpi服务rootv1 /# /etc/init.d/acpid stoprootv1 /# chkconfig -level 2345 acpid offrootv1 /# chkconfig -list acpid5.禁用NetworkManagerrootv1 /# /etc/init.d/NetworkManager stoprootv1 /# chkconfig NetworkManager off6. 给软件用户ricci设置密码：rootv1 /# passwd ricci7. 启动ricci服务rootv1 /# /etc/init.d/ricci start2.2.2 集群配置管理器(luci) 可以安装在节点上，我现在安装在存储服务器上，更利于监控集群状态。 1.配置好yum源后，安装管理软件： rootrhel6 /# yum install luci 3.或直接禁用防火墙 4.启动luci: rootrhel6 /# /etc/init.d/luci start3.创建集群 1.登陆管理服务器的luci界面： 2.输入用户名root和密码，登录 3.转到manage cluster界面 4.点击create,创建集群 5.此处密码为ricci密码 6.集群创建成功 7. 转到Fence Devices 创建 fence设备，因为不是有的服务器，没有fence设备，我随意建了一个SRF,实际生产环境中，必须使用fence硬件设备。回到nodes菜单下，点击，出现节点详情后点击add fence method添加一个method,4.建立GFS文件系统 4.1.创建LVM卷 1.创建物理卷 rootv1 # pvcreate /dev/sdb Physical volume /dev/sdb successfully created 2.查看物理卷rootv1 # pvdisplay 3.创建卷组vg1 rootv1 # vgcreate vg1 /dev/sdb Volume group vg1 successfully created 4.查看卷组 rootv1 # vgdisplay 5. 创建逻辑卷lv1 rootv1 # lvcreate -L 9.9G -n lv1 vg1 Logical volume lv1 created 6. 现在在两台节点上手动重启/etc/clvmd服务 rootv1 # /etc/init.d/clvmd restartRestarting clvmd: 确定 7. 这时可以用fdisk l分别在两个节点查看。会看到Disk /dev/mapper/vg1-lv1: 10.6 GB, 10632560640 bytes255 heads, 63 sectors/track, 1292 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0x000000004.2. 创建GFS2文件系统1.在将LVM卷lv1格式化成GFS2文件系统rootv1 #mkfs.gfs2 p lock_dlm t mycluster:data1 j 4 /dev/vg1/lv1This will destroy any data on /dev/vg2/lv2.It appears to contain: symbolic link to ./dm-3Are you sure you want to proceed? y/n yDevice: /dev/vg2/lv2Blocksize: 4096Device Size 9.90 GB (2595840 blocks)Filesystem Size: 9.90 GB (2595838 blocks)Journals: 4Resource Groups: 40Locking Protocol: lock_dlmLock Table: mycluster:data1UUID: 263327C1-012D-B359-D823-20651CE93BED2. 节点上挂载GFS2文件系统rootv1 #mkdir /datarootv1 #mount /dev/vg1/lv1 /datarootv2 #mkdir /datarootv2 #mount /dev/vg1/lv1 /data3. 测试GFS2文件系统是否正常运行，在v1和v2上分别新建文件，在双方查看是否同步4让GFS文件系统开机自动挂载 （1）查看mount （2）分别修改节点/etc/fstab文件，加入 /dev/mapper/vg1-lv1 /data gfs2 defaults 0 0 （3） 用df -h重启节点验证5.1 安装LMAP环境 1. 安装httpd rootv1 # yum install httpd 2. 安装mysql rootv1 # yum install php 3.安装mysql rootv1 # yum install mysql-server 4.安装mysql与php的关联插件 rootv1 # yum install php-mysql5.2. 软件配置5.2.1 php 配置 在 Red Hat Enterprise Linux 6中，安装完php、httpd、mysql-server 以及php-mysql等软件包后，基本的PHP功能就已经自动配置好了。当然，前提条件是安装DVD中自带的软件版本。5.2.2 httpd配置1. 修改两个节点上的/etc/httpd/conf/httpd.conf,将其中的/var/www全部替换为 /data/www ,rootv1 # vim /etc/httpd/conf/httpd.confrootv2 # vim /etc/httpd/conf/httpd.conf2. 新建目录及php测试文件phpinfo.phprootv2 # mkdir -p /data/www/htmlrootv2 # vim /data/www/html/phpinfo.php3. 复制原默认目录下的文件到/data/www下rootv2 # cp -a /var/www/* /data/www/4. 启动http服务rootv2 # /etc/init.d/httpd startrootv1 # /etc/init.d/httpd start （注：出现DocumentRoot must be a directory，不能启动时。解法from google:原因是使用了SELinux, 可以禁止使用SELinux运行 system-config-securitylevel (或 redhat-config-securitylevel) 来禁止对http的SELinux 设置或给新路径设置SELinux权限:chcon -R -h -t httpd_sys_content_t/data/w