Solaris-IPMP配置.docx

IPMP配置IPMP解释一、IPMP介绍IP 网络多路径 (IP network multipathing, IPMP) 为在同一 IP 链路上具有多个接口的系统提供物理接口故障检测和透明网络访问故障转移功能。IPMP 还为具有多个接口的系统提供了包负荷分配。通过IPMP，可以将一个或多个物理接口配置到IP多路径组（IPMP）中，配置IPMP后，IPMP的故障转移功能可以保持连接并防止断开任何现有的连接。二、名词解释IPMP组：由同一个系统中使用同一个IPMP组名称配置的一个或多个物理接口组成。IPMP组中的所有接口都必须连接到同一个IP链路，同一字符串的IPMP组名称用于标识组中的所有接口。数据地址：引导指定的或通过ifconfig命令手动指定给NIC的接口的常规地址（可理解为对外服务的ip地址）测试地址：由in.mpathd守护进程使用的特定于IPMP的地址，对于要使用基于探测器的故障和修复检测的接口，至少必须为其配置一个测试地址。（可理解为物理网卡自身的地址）在接口出现故障后，测试地址将一直保留在故障接口上，以便in.mpathd可以继续发送探测器以检查后续修复。必须专门配置测试地址，以便应用程序不会意外使用它们，需将测试地址标记为deprecated.三、IPMP基本要求1.IPMP组中的所有接口都必须具有唯一的MAC地址；2.IPMP组中的所有接口IP都必须都在同一网段网卡信息查询：bash-3.2# dladm show-devbge0 link: up speed: 1000 Mbps duplex: fullbge1 link: unknown speed: 0 Mbps duplex: unknownbge2 link: up speed: 1000 Mbps duplex: fullbge3 link: up speed: 1000 Mbps duplex: fullclprivnet0 link: unknown speed: 0 Mbps duplex: unknownclprivnet1 link: unknown speed: 0 Mbps duplex: unknownclprivnet2 link: unknown speed: 0 Mbps duplex: unknownclprivnet3 link: unknown speed: 0 Mbps duplex: unknownbash-3.2# ifconfig bge1 plumbbash-3.2# dladm show-devbge0 link: up speed: 1000 Mbps duplex: fullbge1 link: up speed: 1000 Mbps duplex: fullbge2 link: up speed: 1000 Mbps duplex: fullbge3 link: up speed: 1000 Mbps duplex: fullclprivnet0 link: unknown speed: 0 Mbps duplex: unknownclprivnet1 link: unknown speed: 0 Mbps duplex: unknownclprivnet2 link: unknown speed: 0 Mbps duplex: unknownclprivnet3 link: unknown speed: 0 Mbps duplex: unknownProbe-based IPMP ConfigurationsProbe-based IPMP ：基于IP寻查,我们常用的是这种，需要测试IP，且必须能ping通网关1. Verify the Solaris OS release.要求系统版本至少solaris8以上bash-3.2# cat /etc/release Oracle Solaris 10 1/13 s10s_u11wos_24a SPARC Copyright (c) 1983, 2013, Oracle and/or its affiliates. All rights reserved. Assembled 17 January 20132. Configure unique MAC addresses.在SPARC平台上，每个基于SPARC的系统都具有系统范围的MAC的地址，默认情况下所有的接口都使用该地址，故默认情况下,每个接口的MAC地址是相同的，但要使用IPMP，则组中的每个接口必须具有唯一的MAC地址，这些地址必须使用出厂安装的MAC地址。可以使用“eeprom local-mac-address?”命令来检测当前系统的所有接口是否使用了系统范围的MAC地址：bash-3.2# eeprom local-mac-address?local-mac-address?=flasebash-3.2# eeprom local-mac-address?=truebash-3.2# eeprom local-mac-address?local-mac-address?=true3. Define IP addresses.bash-3.2# cat /etc/hosts# Internet host table#:1 localhost 127.0.0.1 localhost 10.233.23.151 cluster-01 loghost / Data address10.233.23.155 test-bge0/ Test address for bge010.233.23.156 test-bge1/ Test address for bge1也可以配置两个业务地址，每个网卡都配置数据地址和测试地址：# cat /etc/inet/hosts# Internet host table127.0.0.1 localhost192.168.1.1 sys11 loghost # Data address for hme0# Modifications made for IPMP192.168.1.21 sys11-data-qfe1 # Data address for qfe1192.168.1.51 sys11-test-hme0 # Test address for hme0192.168.1.71 sys11-test-qfe1 # Test address for qfe1# cat /etc/hostname.hme0sys11 netmask + broadcast + group mpgrp-one up addif sys11-test-hme0 deprecated netmask + broadcast + -failover up# cat /etc/hostname.qfe1sys11-data-qfe1 netmask + broadcast + group mpgrp-one up addif sys11-test-qfe1 deprecated netmask + broadcast + -failover up#只有一个业务IP地址的时候配置文件中无需添加符号4. Configure the interfacesbash-3.2# vi /etc/hostname.bge0cluster-01 netmask + broadcast + group sc_ipmp0 up addif test-bge0 netmask + broadcast + deprecated + -failover upbash-3.2# cat /etc/hostname.bge1test-bge1 netmask + broadcast + group sc_ipmp0 deprecated + -failover up-cluster-01:设置的对外服务器的主机名，已在/etc/hosts文件中进行了设置，此处可以用IP地址代替（10.233.23.151）；-netmask+:设置子网掩码，根据/etc/netmask文件获得；-broadcast+:对应于/etc/netmask 计算出一个网络的广播地址，对于网络的广播地址，一般就是此网段中最大地址；-group sc_ipmp0:设置IPMP组名为sc_ipmp0；-up：类似于网卡的启用功能；-addif test-bge0：IPMP组中增加一个子接口，此处可以是IP地址，由于已在hosts文件中进行了定义，故可直接使用名称；-deprecated：标记此地址为测试地址；-failover：告知系统，这个地址代表的连接如果失效，不做切换（测试地址）5. Reboot the system.重启系统让配置生效bash-3.2# init66. View the interface configuration.查看接口配置bash-3.2# ifconfig -alo0: flags=2001000849 mtu 8232 index 1 inet 127.0.0.1 netmask ff000000 bge0: flags=1000843 mtu 1500 index 2 inet 10.233.23.151 netmask ffffff80 broadcast 10.233.23.255 groupname sc_ipmp0 ether 0:3:ba:d6:f2:33 bge0:1: flags=4009040842 mtu 1500 index 2 inet 10.233.23.155 netmask ffffff80 broadcast 10.233.23.255bge1: flags=4009040842 mtu 1500 index 3 inet 10.233.23.156 netmask ffffff80 broadcast 10.233.23.255 groupname sc_ipmp0 ether 0:3:ba:d6:f2:34 bge2: flags=1008843 mtu 1500 index 5 inet 172.16.0.65 netmask ffffffc0 broadcast 172.16.0.127 ether 0:3:ba:d6:f2:35 bge3: flags=1008843 mtu 1500 index 4 inet 172.16.0.129 netmask ffffffc0 broadcast 172.16.0.191 ether 0:3:ba:d6:f2:36 clprivnet0: flags=1008843 mtu 1500 index 6 inet 172.16.2.1 netmask ffffff00 broadcast 172.16.2.255 ether 0:0:0:0:0:1 bash-3.2#切换测试1. 可以拔插网线来进行测试2. if_mpadm测试if_mpadm：if_mpadm d 停止一个网卡if_mpadm r 恢复一个网卡“bge0”：之前分配了数据地址，由于网卡被停用，故此处的ip已经迁移至其它网卡。“bge0:1”此网卡的测试地址（10.233.23.155）在其逻辑接口；“bge1”：分配了测试地址(10.233.23.156)“bge1:1”:由于“bge0”网卡被停用，故数据ip迁移至此网卡的逻辑接口之上，继续对外提供服务bash-3.2# if_mpadm -d bge0bash-3.2# ifconfig -alo0: flags=2001000849 mtu 8232 index 1 inet 127.0.0.1 netmask ff000000 bge0: flags=89000842 mtu 0 index 2 inet 0.0.0.0 netmask 0 groupname sc_ipmp0 ether 0:3:ba:d6:f2:33 bge0:1: flags=4089040842 mtu 1500 index 2 inet 10.233.23.155 netmask ffffff80 broadcast 10.233.23.255bge1: flags=4009040842 mtu 1500 index 3 inet 10.233.23.156 netmask ffffff80 broadcast 10.233.23.255 groupname sc_ipmp0 ether 0:3:ba:d6:f2:34 bge1:1: flags=1000843 mtu 1500 index 3 inet 10.233.23.151 netmask ffffff80 broadcast 10.233.23.255bge2: flags=1008843 mtu 1500 index 5 inet 172.16.0.65 netmask ffffffc0 broadcast 172.16.0.127 ether 0:3:ba:d6:f2:35 bge3: flags=1008843 mtu 1500 index 4 inet 172.16.0.129 netmask ffffffc0 broadcast 172.16.0.191 ether 0:3:ba:d6:f2:36 clprivnet0: flags=1008843 mtu 1500 index 6 inet 172.16.2.1 netmask ffffff00 broadcast 172.16.2.255 ether 0:0:0:0:0:1恢复bge0bash-3.2# if_mpadm -r bge0bash-3.2# ifconfig -alo0: flags=2001000849 mtu 8232 index 1 inet 127.0.0.1 netmask ff000000 bge0: flags=1000843 mtu 1500 index 2 inet 10.233.23.151 netmask ffffff80 broadcast 10.233.23.255 groupname sc_ipmp0 ether 0:3:ba:d6:f2:33 bge0:1: flags=4009040842 mtu 1500 index 2 inet 10.233.23.155 netmask ffffff80 broadcast 10.233.23.255bge1: flags=4009040842 mtu 1500 index 3 inet 10.233.23.156 netmask ffffff80 broadcast 10.233.23.255 groupname sc_ipmp0 ether 0:3:ba:d6:f2:34 bge2: flags=1008843 mtu 1500 index 5 inet 172.16.0.65 netmask ffffffc0 broadcast 172.16.0.127 ether 0:3:ba:d6:f2:35 bge3: flags=1008843 mtu 1500 index 4 inet 172.16.0.129 netmask ffffffc0 broadcast 172.16.0.191 ether 0:3:ba:d6:f2:36 clprivnet0: flags=1008843 mtu 1500 index 6 inet 172.16.2.1 netmask ffffff00 broadcast 172.16.2.255 ether 0:0:0:0:0:1Link-based IPMP ConfigurationsLink-based IPMP：基于链路类，不需测试IP1. Verify the Solaris OS release.2. 要求系统版本至少solaris8以上3. bash-3.2# cat /etc/release 4. Oracle Solaris 10 1/13 s10s_u11wos_24a SPARC5. Copyright (c) 1983, 2013, Oracle and/or its affiliates. All rights reserved.6. Assembled 17 January 20132. Configure unique MAC addresses.在SPARC平台上，每个基于SPARC的系统都具有系统范围的MAC的地址，默认情况下所有的接口都使用该地址，故默认情况下,每个接口的MAC地址是相同的，但要使用IPMP，则组中的每个接口必须具有唯一的MAC地址，这些地址必须使用出厂安装的MAC地址。可以使用“eeprom local-mac-address?”命令来检测当前系统的所有接口是否使用了系统范围的MAC地址：bash-3.2# eeprom local-mac-address?local-mac-address?=flasebash-3.2# eeprom local-mac-address?=truebash-3.2# eeprom local-mac-address?local-mac-address?=true3. Define IP addresses.bash-3.2# cat /etc/hosts# Internet host table#:1 localhost 127.0.0.1 localhost 10.233.23.151 cluster-01 loghost / Data address4. Configure the interfaces.bash-3.2# cat /etc/hostname.bge0cluster-01 netmask + broadcast + group sc_ipmp0 upbash-3.2# cat /etc/hostname.bge1group sc_ipmp0 up4. Reboot the system.重启服务使配置生效bash-3.2# init 65. View the interface configuration.查看网口配置bash-3.2# ifconfig -alo0: flags=2001000849 mtu 8232 index 1 inet 127.0.0.1 netmask ff000000 bge0: flags=1000843 mtu 1500 index 2 inet 10.233.23.151 netmask ffffff80 broadcast 10.233.23.255 groupname sc_ipmp0 ether 0:3:ba:d6:f2:33 bge1: flags=1000843 mtu 1500 index 3 inet 0.0.0.0 netmask ff000000 broadcast 0.255.255.255 groupname sc_ipmp0 ether 0:3:ba:d6:f2:34 bge2: flags=1008843 mtu 1500 index 5 inet 172.16.0.65 netmask ffffffc0 broadcast 172.16.0.127 ether 0:3:ba:d6:f2:35 bge3: flags=1008843 mtu 1500 index 4 inet 172.16.0.129 netmask ffffffc0 broadcast 172.16.0.191 ether 0:3:ba:d6:f2:36 clprivnet0: flags=1008843 mtu 1500 index 6 inet 172.16.2.1 netmask ffffff00 broadcast 172.16.2.255 ether 0:0:0:0:0:1 切换测试bash-3.2# if_mpadm -d bge0bash-3.2# bash-3.2# ifconfig -alo0: flags=2001000849 mtu 8232 index 1 inet 127.0.0.1 netmask ff000000 bge0: flags=89000842 mtu 0 index 2 inet 0.0.0.0 netmask 0 groupname sc_ipmp0 ether 0:3:ba:d6:f2:33 bge1: flags=1000843 mtu 1500 index 3 inet 0.0.0.0 netmask ff000000 broadcast 0.255.255.255 groupname sc_ipmp0 ether 0:3:ba:d6:f2:34 bge1:1: flags=1000843 mtu 1500 index 3 inet 10.233.23.151 netmask ffffff80 broadcast 10.233.23.255bge2: flags=1008843 mtu 1500 index 5 inet 172.16.0.65 netmask ffffffc0 broadcast 172.16.0.127 ether 0:3