NetApp FAS3220 存储安装配置手册.doc

NetApp存储安装配置文档Netapp 存储安装配置文档2014年7月28日当前版本：1.0版本历史:版 本日 期作 者版本说明1.020140728NetApp 安装配置文档2.020160421RAC 系统升级后，根据要求重新调整卷配置目录Netapp 存储安装配置文档1一、概述4二、NetApp 存储配置信息42.1、产品配置4三、存储部署架53.1、存储架构图53.2、部署架构说明5四、NetAPP 存储配置信息64.1、登录信息：64.2、卷划分6五、初始化安装配置过程75.1、存储初始化75.2、查看配置，输入许可135.3、配置MetroCluster21六、配置vol 和lun71七、配置ISCSI 服务和LUN映射94八、服务器添加存储1038.1、虚拟机添加存储1038.2、Windows 服务器添加存储1088.3、Linux 服务器添加存储111九、图形化操作使用说明1359.1、登录SystemManager1359.2、查看存储信息1369.3、卷的创建1399.4、LUN的创建1409.5、LUN映射的查看与修改1439.6、查看Cluster双机配置1459.7、LUN 映射的取消1469.8、LUN 的删除1479.9、Vol 离线与删除148十、日常基本维护说明14910.1 开机顺序14910.2 关机顺序14910.3 性能检测149十一、常用命令151一、概述 本文档主要记录了在XXX NetApp 存储实施的相关信息，主要内容包括存储的配置信息、存储部署架构、安装配置流程、基本维护操作等。本文旨在记录NetApp存储的安装实施过程及相关配置信息，以供存档和后续维护查看，并不对相关概念和操作进行原理性的解释说明。二、NetApp 存储配置信息2.1、产品配置产品名称产品描述单位数量Netapp FAS3220 HA1） 2个存储控制器，每个存储控制器含4个10Gb SFP+端口（含10GB SFP+ 光模块），4个6GB SAS接口，2个8GB集群接口及相应的软件配置；2） 2个磁盘柜，每个磁盘柜配置24块600GB 10k SAS硬盘；3）SAS连接线缆、电源线、安装导轨、集群连接线等附件；4）存储标准配套软件套1三、存储部署架3.1、存储架构图3.2、部署架构说明 NetApp 控制器A（上面）1口（逻辑端口，由两个物理接口组成）连接 DELL N4032F交换机（上面）21 22口 NetApp 控制器A（上面）2口（逻辑端口，由两个物理接口组成）连接 DELL N4032F交换机（下面）21 22口 NetApp 控制器B（上面）3口（逻辑端口，由两个物理接口组成）连接 DELL N4032F交换机（上面）23 24口 NetApp 控制器B（上面）4口（逻辑端口，由两个物理接口组成）连接 DELL N4032F交换机（下面）23 24口 DELL N4032F为10GB 以太网光纤交换机 NetAPP FAS3220 控制器的PCI-E 1槽通过HA线进行连接，用于集群间的数据通信 NetAPP FAS3220 控制器的PCI-E 2 3槽，用于和外部主机进行数据传输 其中Vmware 虚拟化集群有6台服务器；Windows服务器为2台Windows 2012 的服务器；数据库服务器为2台Linux 服务器四、NetAPP 存储配置信息4.1、登录信息：登录方式：通过telnet 或 NetApp OnCommand System Manager ,通过NetApp OnCommand System Manager图示：4.2、卷划分应用系统控制器LUN大小备注Vmware虚拟化A控制器/vol/vol_vm1/lun13.9TVmware虚拟化B控制器/vol/vol_vm2/lun22.0TOracle for linuxB控制器/vol/Vol/ora_data1/LUN_ora_data1200GASM 数据盘，RAC两节点共享Oracle for linuxB控制器/vol/Vol/ora_data2/LUN_ora_data2200GASM 数据盘，RAC两节点共享Oracle for linuxB控制器/vol/Vol/ora_data3/LUN_ora_data3200GASM 数据盘，RAC两节点共享Oracle for linuxB控制器/vol/Vol/ora_vote1/LUN_ora_vote12GRAC仲裁盘Oracle for linuxB控制器/vol/Vol/ora_vote2/LUN_ora_vote22GRAC仲裁盘Oracle for linuxB控制器/vol/Vol/ora_vote3/LUN_ora_vote32GRAC仲裁盘Windows 2012B控制器/vol/vol_win1/lun41000G共享卷Windows 2012B控制器/vol/vol_win1/lun41000G五、初始化安装配置过程5.1、存储初始化NetApp FAS是NetApp产品中一款有双机头的磁盘阵列，在出厂时预先会安装好Data OnTap 操作系统 ，需要先在每个机头中配置好操作系统，才能正常使用。 配置步骤如下： 首次配置，需要连接到console口，波特率 96001， 通过笔记本电脑或其它Windows平台PC机的串口，连接到机头上的串口上； 2， 通过超级终端，以默认值连接来进行操作，进入配置画面。通过setup 命令进行初始化的配置：fas3220b setupThe setup command will rewrite the /etc/rc, /etc/exports,/etc/hosts, /etc/hosts.equiv, /etc/dgateways, /etc/nsswitch.conf,and /etc/resolv.conf files, saving the original contents ofthese files in .bak files (e.g. /etc/exports.bak).Are you sure you want to continue? yes NetApp Release 8.1.3 7-Mode: Sat Jun 8 08:11:51 PDT 2013 System ID: 2017886331 (fas3220b); partner ID: 2017870126 (fas3220a) System Serial Number: 450000056236 (fas3220b) System Rev: B7 System Storage Configuration: Multi-Path HA System ACP Connectivity: NA slot 0: System Board Processors: 4 Processor type: Intel(R) Xeon(R) CPU L5410 2.33GHz Memory Size: 12288 MB Memory Attributes: Bank Interleaving Hoisting Rank Interleaving Chipkill ECC Service Processor Status: Online IOXM Status: present Power: Good Agent version: N/A Serial Number: 9441912947 Part Number: 111-00647 Version: D1 slot 0: Dual 10G Ethernet Controller T320E-SFP/KR c0a MAC Address: 00:a0:98:55:9a:8c (auto-unknown-enabling) c0b MAC Address: 00:a0:98:55:9a:8d (auto-unknown-enabling) slot 0: Internal BGE 10/100 Ethernet Controller e0M MAC Address: 00:a0:98:55:9a:8e (auto-100tx-fd-down) e0P MAC Address: 00:a0:98:55:9a:8f (auto-100tx-fd-up) slot 0: Dual 10/100/1000 Ethernet Controller G20 e0a MAC Address: 00:a0:98:55:9a:8a (auto-unknown-down) e0b MAC Address: 00:a0:98:55:9a:8b (auto-unknown-down) slot 0: SAS Host Adapter 0a 24 Disks: 13440.0GB 1 shelf with IOM6 slot 0: SAS Host Adapter 0b 24 Disks: 13440.0GB 1 shelf with IOM6 slot 0: FC Host Adapter 0c slot 0: FC Host Adapter 0d slot 0: Intel ICH USB EHCI Adapter u0a (0xdfb01400) boot0 Micron Technology Real SSD eUSB 2GB, class 0/0, rev 2.00/11.10, addr 2 1936MB 512B/sect (0FF0022700323779) slot 1: Dual 10 Gigabit Ethernet Controller IX1-SFP+ e1a MAC Address: 90:e2:ba:54:e4:dc (auto-10g_sr-fd-up) e1b MAC Address: 90:e2:ba:54:e4:dd (auto-10g_sr-fd-up) slot 2: Dual 10 Gigabit Ethernet Controller IX1-SFP+ e2a MAC Address: 90:e2:ba:56:22:7c (auto-10g_sr-fd-up) e2b MAC Address: 90:e2:ba:56:22:7d (auto-10g_sr-fd-up) slot 3: SAS Host Adapter 3a slot 3: SAS Host Adapter 3b 24 Disks: 13440.0GB 1 shelf with IOM6 slot 3: SAS Host Adapter 3c 24 Disks: 13440.0GB 1 shelf with IOM6 slot 3: SAS Host Adapter 3d slot 5: FCVI Host Adapter 5a slot 5: FCVI Host Adapter 5b Please enter the new hostname fas3220b: #配置主机名Do you want to enable IPv6? n: Thu Jul 24 02:42:00 GMT fas3220b:monitor.globalStatus.ok:info: The systems global status is normal. Do you want to configure interface groups? y: #是否需要配置接口组Number of interface groups to configure? 1 2 #配置接口组的数量Name of interface group #1 vif1: #配置接口组名称Is vif1 a single s, multi m or a lacp l interface group? s #端口状态#single -active-standby#Multi -active-activeNumber of links for vif1? 2 #几个物理端口绑定成一个vifName of link #1 for vif1 e0a: e1a #端口名字（name可在端口下面看到）Name of link #2 for vif1 e0b: e1bName of interface group #2 : vif2Is vif2 a single s, multi m or a lacp l interface group? m sNumber of links for vif2? 0 2Name of link #1 for vif2 : e2aName of link #2 for vif2 : e2bPlease enter the IP address for Network Interface vif1 : #设置vif1 的IP地址Please enter the netmask for Network Interface vif1 : #子网掩码Should interface group vif1 take over a partner interface group during failover? y: #是否允许虚拟网卡在故障切换时切换到另一个机头上，这里输入yPlease enter the partner interface name to be taken over by vif1 vif1: #输入另一个机头上的会被切换过来的虚拟网卡的名字Please enter the IP address for Network Interface vif2 : #设置vif2 的IP地址Please enter the netmask for Network Interface vif2 : Should interface group vif2 take over a partner interface group during failover? n: y#是否允许虚拟网卡在故障切换时切换到另一个机头上，这里输入yPlease enter the partner interface name to be taken over by vif2 : vif2#输入vif2另一个机头上的会被切换过来的虚拟网卡的名字Please enter the IP address for Network Interface e0a : #设置e0a 管理端口的IP地址Please enter the netmask for Network Interface e0a : #设置子网掩码Should interface e0a take over a partner IP address during failover? n: y#是否允许e0a在故障切换时切换到另一个机头上，这里输入yPlease enter the IPv4 address or interface name to be taken over by e0a : e0a#输入e0a另一个机头上的会被切换过来的网卡的名字Please enter media type for e0a 100tx-fd, tp-fd, 100tx, tp, auto (10/100/1000) auto: #设置网卡类型，这里设置为自适应Please enter flow control for e0a none, receive, send, full full: Do you want e0a to support jumbo frames? n: #是否允许巨型帧Please enter the IP address for Network Interface e0b : Thu Jul 24 02:43:41 GMT fas3220b:cf.fsm.partnerOk:notice: Failover monitor: partner ok Thu Jul 24 02:43:41 GMT fas3220b:cf.fsm.takeoverOfPartnerDisabled:notice: Failover monitor: takeover of fas3220a disabled (interconnect error). Thu Jul 24 02:43:41 GMT fas3220b:cf.fsm.takeoverByPartnerDisabled:notice: Failover monitor: takeover of fas3220b by fas3220a disabled (interconnect error). Thu Jul 24 02:43:43 GMT fas3220b:cf.hwassist.DefaultPrtnrAddr:notice: The system automatically chose 10 as the hardware-assist partner address. If you want to use a different IP address, change it using the command options cf.hw_assist.partner.address. Thu Jul 24 02:43:43 GMT fas3220b:cf.hwassist.socBindFailed:error: hw_assist: bind failed to port 4444 on IP address 19. Error 49 Should interface e0b take over a partner IP address during failover? n: Thu Jul 24 02:43:43 GMT fas3220b:cf.hwassist.localMonitor:warning: hw_assist: hw_assist functionality is inactive. Please enter the IP address for FC Network Interface ql5a : #直接回车Should interface ql5a take over a partner IP address during failover? n: Please enter the IP address for FC Network Interface ql5b : Should interface ql5b take over a partner IP address during failover? n: e0M is a Data ONTAP dedicated management port. NOTE: Dedicated management ports cannot be used for data protocols (NFS, CIFS, iSCSI, NDMP or Snap*), and if they are configured they should be on an isolated management LAN. The default route will use dedicated mgmt ports only as the last resort, since data protocol traffic will be blocked by default.Please enter the IP address for Network Interface e0M : #直接回车Should interface e0M take over a partner IP address during failover? n: Please enter the name or IP address of the IPv4 default gateway 54: 54 #设置数据端口的网关 The administration host is given root access to the filers /etc files for system administration. To allow /etc root access to all NFS clients enter RETURN below.Please enter the name or IP address of the administration host: #输入超级管理主机的主机名或IP地址，没有就直接回车；Please enter timezone GMT: #设置时区Thu Jul 24 02:44:00 GMT fas3220b:monitor.globalStatus.critical:CRITICAL: Controller failover of fas3220a is not possible: interconnect error. Thu Jul 24 02:44:01 GMT fas3220b:cf.hwassist.DefaultPrtnrAddr:notice: The system automatically chose 10 as the hardware-assist partner address. If you want to use a different IP address, change it using the command options cf.hw_assist.partner.address. Asia/ShanghaiWhere is the filer located? zhoushan: #问磁盘阵列设备的位置，可以随便写Enter the root directory for HTTP files /vol/vol0/home/http: Do you want to run DNS resolver? n: #配置DNS，不需要设置就直接回车Do you want to run NIS client? n: This system will send event messages and weekly reports to NetApp Technical Support. To disable this feature, enter options autosupport.support.enable off within 24 hours. Enabling AutoSupport can significantly speed problem determination and resolution should a problem occur on your system. For further information on AutoSupport, please see: /autosupport/ Press the return key to continue. The Service Processor (SP) provides remote management capabilities including console redirection, logging and power control. It also extends autosupport by sending additional system event alerts. Your autosupport settings are used for sending these alerts via email over the SP LAN interface.Would you like to configure the SP LAN interface y: #是否配置远程管理服务地址，这里输入yWould you like to enable DHCP on the SP LAN interface n: #不使用DHCPPlease enter the IP address for the SP 0: #设置远程管理服务的地址Please enter the netmask for the SP : Please enter the IP address for the SP gateway 54: The mail host is required by your system to send SP alerts and local autosupport email.Please enter the name or IP address of the mail host mailhost: #配置autosupport 邮件服务器，不需要就直接回车You may use the autosupport options to configure alert destinations. The initial aggregate currently contains 3 disks; you may add more disks to it later using the aggr add command.Now type reboot for changes to take effect.fas3220b fas3220b fas3220b fas3220b reboot #配置重启生效 A filer can be configured for multiprotocol access, or as an NTFS-only filer. Since multiple protocols are currently licensed on this filer, we recommend that you configure this filer as a multiprotocol filer(1) Multiprotocol filer(2) NTFS-only filerSelection (1-2)? 1: #设置设置的类型，这里设置为多协议的存储失败Wed Jul 23 11:06:53 GMT fas3220b:cf.hwassist.Default.NodemgmtAddr:notice: The system automatically chose 19 as the local hardware-assist IP address. Wed Jul 23 11:06:56 GMT fas3220b:cf.hwassist.DefaultPrtnrAddr:notice: The system automatically chose 10 as the hardware-assist partner address. If you want to use a different IP address, change it using the command options cf.hw_assist.partner.address. CIFS requires local /etc/passwd and /etc/group files and default files will be created. The default passwd file contains entries for root, pcuser, and nobody.Enter the password for the root user : # 配置超级管理用户Wed Jul 23 11:07:00 GMT fas3220b:monitor.globalStatus.critical:CRITICAL: Controller failover of fas3220a is not possible: Controller Failover takeover disabled. Retype the password: #设置超级用户密码 The default name for this CIFS server is FAS3220B.Would you like to change this name? n: Data ONTAP CIFS services support four styles of user authentication. Choose the one from the list below that best suits your situation.(1) Active Directory domain authentication (Active Directory domains only)(2) Windows NT 4 domain authentication (Windows NT or Active Directory domains)(3) Windows Workgroup authentication using the filers local user accounts(4) /etc/passwd and/or NIS/LDAP authenticationSelection (1-4)? 1: #设置认证方式Wed Jul 23 11:07:08 GMT fas3220b:diskown.RescanMessageFailed:warning: Could not send rescan message to fas3220a. Please type disk show on the console of fas3220a for it to scan the newly inserted disks. 3What is the name of the Workgroup? WORKGROUP: rpc failed: RPC: Timed outWed Jul 23 11:07:12 GMT fas3220b:passwd.changed:info: passwd for user root changed. CIFS - Starting SMB protocol. It is recommended that you create the local administrator account (FAS3220Badministrator) for this filer.Do you want to create the FAS3220Badministrator account? y: Enter the new password for FAS3220Badministrator: Retype the password: Welcome to theData ONTAP (fas3220b.)login: WORKGROUP Windows(R) workgroupCIFS local server is running.Wed Jul 23 11:07:22 GMT fas3220b:nbt.nbns.socketError:error: NBT: Cannot send broadcast message on NBNS socket. Error 0x32: Network is down. Data ONTAP (fas3220b.)login: rootPassword: fas3220b Wed Jul 23 11:07:35 GMT fas3220b: console_login_mgr:info: root logged in from consoleWed Jul 23 11:07:36 GMT fas3220b:nbt.nbns.registrationComplete:info: NBT: All CIFS name registrations have completed for the local server. 5.2、查看配置，输入许可fas3220b fas3220b sysconfig -r #查看硬盘信息Aggregate aggr0 (online, raid_dp) (block checksums) Plex /aggr0/plex0 (online, normal, active, pool0) RAID group /aggr0/plex0/rg0 (normal, block checksums) RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks) - - - - - - - - - dparity 3c.10.0 3c 10 0 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696 parity 0a.10.1 0a 10 1 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696 data 3c.10.2 3c 10 2 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696 Pool1 spare disks (empty)Pool0 spare disksRAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)- - - - - - - - -Spare disks for block checksumspare 0a.10.3 0a 10 3 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696 spare 0a.10.5 0a 10 5 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696 spare 0a.10.7 0a 10 7 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696 spare 0a.10.9 0a 10 9 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696 spare 0a