vplex方案实施 VPLEX

祥光铜业 EMC VPLEX实施文档EMC VPLEX实施文档山东思宏信息科技有限公司2014.7目录一.VPLEX3二.IP规划、介绍32.1.IP地址、用户名32.2.VPLEX介绍42.2.1VPLEX视图42.2.2连接和IO路径4三.VPLEX LOCAL初始化配置63.1.计算FE和BE port wwn63.2.Switch zoning63.3.Backend storage provision63.3.1根据规划，交换机创建wwn zone63.3.2在VNX5400、VNX5500注册vplex63.4.VPLEX initial setup73.4.1连接到 management server73.4.2进入 VPLEXCLI83.4.3设置management server 主机名和IP地址83.4.4检查系统健康状态83.4.5检查软件版本93.4.6同步时间93.4.7利用EZ-setup初始化VPLEX9四.VPLEX Local配置154.1.登录VplexGui154.2.Claim storage154.3.封装Lun184.4.建立storage view21五.VPLEX管理第三方存储27六.双活测试39七.VPLEX中RAID1 LUN54一. VPLEXEMC VPLEX二. IP规划、介绍2.1. IP地址、用户名TypeIP AddressNetmaskGetwayVPLEX40TypeUsernamePasswordVPLEXserviceMiDim7T2.2. VPLEX介绍2.2.1 VPLEX视图2.2.2 连接和IO路径控制器 A 和控制器 B 各有四个 I/O 模块。I/O 模块 A0 和 B0 配置用于主机连接且标识为前端，而 A1 和 B1 配置用于阵列连接且标识为后端。前端端口将登录到结构并将自己作为分区目标提供给主机启动器，而后端端口将作为用于分区到阵列目标的启动器登录到结构。每个控制器都将连接到既带前端端口又带后端端口的两个 SAN 结构。前端 (FE) 端口提供到主机适配器（也称为主机启动器端口）的连接。 VPLEX 前端口不支持主机直连方式 每个Director有4个前端口，每两个前端口连接到一个Fabric 每台主机至少有两条链路分别连通过两个FABRIC接到VPLEX（必须） 在每一个Fabric上每台主机至少有2个Path一个能连接到A Driector,另外一个连接到B Director.总共至少4个逻辑路径连接到VPLEX（NDU必须） 从性能角度考虑主机应该连接到一对Director以最小化Cache内容传递 如果存在VPLEX前端口多台主机共享，需要尽量避免多台繁忙度高的主机共享相同的VPLEX的前端口 每个Director的一个前端口应不超过100个initiator，整个VPLEX系统不能超过400个initiator(HBA port)注 1：从最大冗余角度考虑可以使主机通过两个Fabric连接到所有2个Director;从最大性能角度考虑可以使主机通过两个Fabric连接到同一Engine的两个Director. 本次方案规划满 足了冗余（NDU需求）同时兼顾了性能。注2：如果存在并发方式访问device的cluster，建议Cluster内的所有主机通过不同 的VPLEX 前端口，访问相同的一组Director 后端 (BE) 端口提供到存储阵列的连接。 所有的Director必须看到完全相同的存储设备 所有的Director必须通过每一个Fabric访问到相同的存储设备 每个Director最多有四条路径访问到一个存储设备（LUN） 每个Director后端端口连接盘阵端口不能超过256个 每个VPLEX最多分配8000个storage volumes三. VPLEX LOCAL初始化配置3.1. 计算FE和BE port wwn利用VPLEX Port WWN Calculator工具计算出前端端口和后端端口的WWN。Seed number：机器后贴的一个8位的号码。3.2. Switch zoning按照规划完成VPLEX backend zoning3.3. Backend storage provision3.3.1 根据规划，交换机创建wwn zone3.3.2 在VNX5400、VNX5500注册vplex在两台存储上分别注册vplex，并创建Storage group。并把metadata volumes分配给vplex。system volumesVPLEX的system volumes分为两种：metadata volumes 和 logging volumesmeta data volumesmeta data volumes里包含VPLEX cluster的系统配置信息，主要为： virtual-to-physical mapping information data about the devices and virtual volumes system configuration settings本次VPLEX LOCAL安装需要4个78GB的volume，分别用于meta-volume, mirrored copy of meta-volume, backups of meta-volume and mirrored-meta-volume. Vnx5500-1: meta-volume mirrored copy of meta-volume Vnx5500-2: backups of meta-volume mirrored-meta-volume鉴于目前环境中，VPLEX后台有两台存储，这4个volume将分别从两台存储中分配，以达到最大冗余性。3.4. VPLEX initial setup3.4.1 连接到 management serverconnect Ethernet cable to the service port of mgmt server. Config your NIC use DHCP, ip address will be assigned in the range 128.221.252.Default user/password : service/MiDim7TService port IP: SSH client: SecureCRT or PUTTY3.4.2 进入 VPLEXCLI3.4.3 设置management server 主机名和IP地址设置主机名：sudo /opt/emc/VPlex/tools/ipconfig/changehostname.py -n 设置IP地址：management-server set-ip -i / -g eth3查看IP配置：ll /management-server/ports/eth33.4.4 检查系统健康状态VPlexPlatformHealthCheck 可以使用一下参数：-h, which displays the command usage.-l , which allows you to specify a path and filename for the health checkoutput. The default value is/var/log/VPlex/cli/VplexPlatformHealthCheck/.-v, which turns on verbose mode.确认状态：3.4.5 检查软件版本1、连接到所有Directorconfiguration connect-local-directors2、列出连接的所有Directorll /engines/*/directors3、查看版本Version3.4.6 同步时间跟网络中的NTP同步系统时间configuration sync-time f i 3.4.7 利用EZ-setup初始化VPLEX1、启动 EZ安装向导configuration system-setup选1 ，config a VPLEX LocalYes，确认No,不配置No, 没有LDAP或者ADNo，不发送时间信息到EMCNo, 不配置Call-homeNo, 不配置SNMP5, CA证书有效期5年 host 证书有效期2年输入两遍strongswan （passphrase）2、 查看后端端口ll /engines/*/ports -p3、 恢复ES-setup configuration continue-system-setup4、 重启web serverwebserver restart5、 创建meta-volume 列出可用卷（大于等于78GB） configuration show-meta-volume-candidates例如:Name Capacity Vendor IO Status Type Array Name- - - - - -VPD83T3:60000970000192601714533036464234 80.1G EMC alive traditional EMC-SYMMETRIX-192501423VPD83T3:60000970000192601714533036464235 80.1G EMC alive traditional EMC-SYMMETRIX-193601405VPD83T3:60000970000192601714533036464236 80.1G EMC alive traditional EMC-SYMMETRIX-192501415VPD83T3:60000970000192601714533036464238 80.1G EMC alive traditional EMC-SYMMETRIX-192501406VPD83T3:60000970000192601714533036464239 80.1G EMC alive traditional EMC-SYMMETRIX-192601409VPD83T3:600616037e202200d03f54035c1fe012 85G DGC alive traditional EMC-CLARiiON-FNM00083800045VPD83T3:6006016037202200d13e64035c1fe012 85G DGC alive traditional EMC-CLARiiON-FNM00083800045创建meta-volume and a mirror可以多个卷，做Raid 1，一般用两个，每台存储各一个。meta-volume create -n -d ,例如:meta-volume create n c1_meta dVPD83T3:60000970000192501423533036464234VPD83T3:6006016037202200d13e64035c1fe012显示meta-volume状态ll /clusters/cluster-1/system-volumes/ 显示集群状态cluster status6. 创建备份meta-data volume注：需要指定两台存储上的卷，参考前面的规划。configuration metadata-backup7. 注册集群configuration register-product8. 启用前端端口configuration enable-front-end-ports9. 检查集群健康状态health-check 确认输出信息 Operational Status and Health State are ok. Operational Status and Health State of the metadata volumes are ok. There are no unhealthy storage volumes. Each storage volume is visible from all directors and with at least two paths.四. VPLEX Local配置4.1. 登录VplexGui用浏览器登陆Vplex Unisphere管理界面： https：/46用户名：service密码MiDim7T4.2. Claim storage安装Naviseccli利用一下命令收集两台存储上lun对应信息：naviseccli h 40 -user admin -password password -scope 0 getlun -uid -name c:vnx5400.txtnaviseccli -h 42 -user admin -password password -scope 0 getlun -uid -name c:vnx5500.txt选择storage array，选择一台存储，点击“claim storage”，按照向导，所有选项保持缺省Claim盘4.3. 封装Lun选择extents，封装LUN选择RAID类型或1:1 mapping虚拟化功能提供以下功能配置注意事项存储卷封装可以将后端存储阵列上的LUN导入VPLEX实例中，且使用时保持其数据完整性。存储卷会保留设备上的现有数据并利用后端LUN的介质保护和设备特性RAID 0可以聚合VPLEX设备以创建RAID 0分条设备。通过跨LUN进行I/O分条以提升性能RAID-C可以连接VPLEX以形成新的较大设备。提供一种通过组合两个或多个较小设备来创建较大设备的方法RAID 1可在站点内镜像VPLEX设备。不受镜像中对设备故障的影响。设备重建只是从剩余设备拷贝到新修复的设备。所需设备的数量是存储数据所需的数据的两倍（镜像阵列的可用存储容量为50%）。RAID1设备可以来自不同后端阵列LUN，从而能够承受后端阵列故障。选择对应关系对自动封装成Virtual Volume4.4. 建立storage view注册主机的initiator创建storage view并将initiator加入到View将Front-end port加入到View将virtual volume加入到View五. VPLEX管理第三方存储IBM DS50201. Zone the IBM DS5020 storage to the VPLEX back-end ports. Follow the recommendations in the Implementation and Planning Best Practices for EMC VPLEX Technical Notes.2. Install and start the IBM DS Storage Manager 10 Client (10.84.xx.30) in your system. 3. Select the “Setup” tab.4. Click “Add Storage Subsystems”.Figure15. In the Add New Storage Subsystem window, enter the Controller (DNS/Network Name/IPv4 address or IPv6 address).6. Click Add. Figure27. In the left panel, select the Devices tab.8. Right click Storage Subsystem and select Manage Storage Subsystem.Figure39. To create new Host group, in the IBM DS Storage manager 10 window, select the Host Mappings tab.Figure410. Right click on Storage Subsystem.11. Select Host Group. Figure512. In the Define Host Group window, enter the host group name.13. Click OK. Figure614. To create new host, right-click Host Group.15. Select Host.Figure716. In the Define Host window, enter the host name. 17. Click Next.Figure818. In the Alias field, enter the new host port identifier.19. Click Add.Figure920. Select the Host port Identifier.21. Click Next. 22. To specify the Host type (Operating System), select Base.23. Click Next.24. Click Finish.Figure1025. To manage Host Port Identifiers, right click on Host.26. Select Manage Host Port Identifiers.Figure1127. In the Manage Host Port Identifiers window, Add, Edit, Replace or Remove host ports as needed.28. Click close.Figure1229. To create a new array select the Storage & Copy Services tab.30. Right click on Total Unconfigured Capacity.31. Select Create Array. Figure1332. In the Create Array window, click Next.Figure1433. Enter an Array name.34. Click Next.Figure1535. Select the RAID level as required.36. Click Finish. Figure1637. To create logical drive form the newly created Array, right click Free Capacity.38. Select Create Logical Drive. Figure1739. Enter the New logical drive capacity and logical drive name.40. Select the host for mapping.41. Click Finish.Figure1842. Map the additional LUNs to a host by giving the host group/host name and the logical drive name.Figure1943. Verify that the newly created LUNs are mapped to the particular Host.Figure2044. On the VPLEX management server, log in to the VPlexcli, and type the following commands:cd /clusters/cluster-Cluster_ID/storage-elements/storage-arraysarray re-discover a array-name -hard -force For example: VPlexcli:/clusters/cluster-2/storage-elements/storage-arrays array re-discover -a IBM-1814 FAStT-60080e50002c3cb60000000050fd17ac -hard forceNote: The array name must be enclosed in quotes (“ ”)as the IBM array has a space in its name.To enter into the array context, type the command:VPlexcli:/clusters/cluster-2/storage-elements/storage-arrayscd IBM-1814 FAStT-60080e50002c3cb60000000050fd17ac 45. Verify the Active/Passive controllers for each LUNVPlexcli:/clusters/cluster-2/storage-elements/storage-arrays/IBM-1814 FAStT-60080e50002c3cb60000000050fd17ac/logical-units ll46. From the VPlexcli prompt, type the following command to display the LUNs:VPlexcli:/ cd clusters/cluster-2/storage-elements/storage-volumes/VPlexcli:/clusters/cluster-2/storage-elements/storage-volumes ll六. 双活测试1. 在VPLEX中查看测试卷的状态，测试卷是在VNX5400、VNX5500中各划分出100G的空间当做测试卷，由VPLEX做双活并分配给VMware安装Linux系统。2. 测试卷已映射给VMware主机3. 使用PuTTY SSH远程连接到vplex CLI中login as: serviceUsing keyboard-interactive authentication.Password: MiDim7TserviceVplexA: vplexcliTrying .Connected to localhost.Escape character is .Enter User Name: service Password:MiDim7T4. 进入vplex cluster查看VPlexcli:/ cd clusters VPlexcli:/clusters cd cluster-1 VPlexcli:/clusters/cluster-1 llAttributes: Name Value- -allow-auto-join trueauto-expel-count 0auto-expel-period 0auto-join-delay 0cluster-id 1connected truedefault-cache-mode synchronousdefault-caw-template truedefault-write-same-16-template truedirector-names director-1-1-A, director-1-1-Bisland-id 1top-level-assembly CKM00141300452operational-status oktransition-indications transition-progress health-state okhealth-indications Contexts: Name Description- -cluster-connectivity Contains information about subnets, option-sets, port-groups, routing table and other cluster-lever connection properties.consistency-groups Contains information about each consistency group that is relevant to the enclosing cluster.devices Contains information about each device that is local to the enclosing cluster.exports Contains all the configuration for storage exports at this cluster, including initiator and target ports, and how storage is presented to initiators on the target ports.storage-elements Contains information on the storage entities at this cluster, including storage-volumes, extents and storage-arrays.system-volumes Contains information on special volumes used by the Plex at this cluster, including meta-volumes and logging-volumes.uninterruptible-power-supplies One for each uninterruptible power supply within this cluster.virtual-volumes Contains information on the virtual volumes at this cluster that may be exported to hosts. Volumes may be supported by local devices, remote devices, or distributed devices. 5. 进入devices查看所有的LUNVPlexcli:/clusters/cluster-1 cd devices/ VPlexcli:/clusters/cluster-1/devices llName Operational Health Block Block Capacity Geometry Visibility Transfer Virtual Volume-Status State Count Size - - - Size - - - - - - - - - -PIPRD_1 ok ok 26214400 4K 100G raid-1 local 128K PIPRD_1_volPIPRD_2 ok ok 26214400 4K 100G raid-1 local 128K PIPRD_2_volPIPRD_3 ok ok 26214400 4K 100G raid-1 local 128K PIPRD_3_volPIPRD_4 ok ok 26214400 4K 100G raid-1 local 128K PIPRD_4_volSAPPRD_1 ok ok 26214400 4K 100G raid-1 local 128K SAPPRD_1_volSAPPRD_10 ok ok 26214400 4K 100G raid-1 local 128K SAPPRD_10_volSAPPRD_2 ok ok 26214400 4K 100G raid-1 local 128K SAPPRD_2_volSAPPRD_3 ok ok 26214400 4K 100G raid-1 local 128K SAPPRD_3_volSAPPRD_4 ok ok 26214400 4K 100G raid-1 local 128K SAPPRD_4_volSAPPRD_5 ok ok 26214400 4K 100G raid-1 local 128K SAPPRD_5_volSAPPRD_6 ok ok 26214400 4K 100G raid-1 local 128K SAPPRD_6_volSAPPRD_7 ok ok 26214400 4K 100G raid-1 local 128K SAPPRD_7_volSAPPRD_8 ok ok 26214400 4K 100G raid-1 local 128K SAPPRD_8_volSAPPRD_9 ok ok 26214400 4K 100G raid-1 local 128K SAPPRD_9_voldevice_DS5020_SAP_EXP_1 ok ok 268435456 4K 1T raid-0 local - device_DS5020_SAP_EXP_1_voldevice_DS5020_SAP_EXP_log_1_1 ok ok 26214400 4K 100G raid-0 local - device_DS5020_SAP_EXP_log_1_1_voldevice_DS5020_SAP_EXP_log_2_1 ok ok 26214400 4K 100G raid-0 local - device_DS5020_SAP_EXP_log_2_1_voldevice_DS5020_SAP_EXP_log_3_1 ok ok 26214400 4K 100G raid-0 local - device_DS5020_SAP_EXP_log_3_1_voldevice_DS5020_SAP_EXP_log_4_1 ok ok 26214400 4K 100G raid-0 local - device_DS5020_SAP_EXP_log_4_1_voldevice_DS5020_SAP_EXP_log_5_1 ok ok 26214400 4K 100G raid-0 local - device_DS5020_SAP_EXP_log_5_1_voldevice_vnx5400_ECC_DEV_1_1 ok ok 26214400 4K 100G raid-0 local - device_vnx5400_ECC_DEV_1_1_voldevice_vnx5400_ECC_DEV_2_1 ok ok 26214400 4K 100G raid-0 local - device_vnx5400_ECC_DEV_2_1_voldevice_vnx5400_ECC_DEV_3_1 ok ok 26214400 4K 100G raid-0 local - device_vnx5400_ECC_DEV_3_1_voldevice_v