NetApp存储安装、配置和维护手册V10

1、.：.； NETAPP存储系统安装、配置和维护手册 Page PAGE 1 NetApp存储系统安装、配置和维护手册网存 文档信息本安装和维护手册为 XXX 定制，为NetApp规范文档之补充。主题：NETAPP存储系统安装和维护手册版本：V.关键字参考文档：提交时间：-创建人：苏冶清目 录 TOC o - h z u HYPERLINK l _Toc 作业规划步骤 PAGEREF _Toc h HYPERLINK l _Toc 配置步骤 PAGEREF _Toc h HYPERLINK l _Toc .设置磁盘归属，创建ROOT卷 PAGEREF _Toc h HYPERLINK l _To

2、c .检查并更新各部件的firmware系统版本 PAGEREF _Toc h HYPERLINK l _Toc .检查并更新存储操作系统版本 PAGEREF _Toc h HYPERLINK l _Toc .输入软件答应 PAGEREF _Toc h HYPERLINK l _Toc .执行SETUP进展初始化设置 PAGEREF _Toc h HYPERLINK l _Toc .调整ROOT卷的大小 PAGEREF _Toc h HYPERLINK l _Toc .配置VLAN PAGEREF _Toc h HYPERLINK l _Toc .修正HOSTS文件 PAGEREF _Toc

3、h HYPERLINK l _Toc .修正/etc/rc文件 PAGEREF _Toc h HYPERLINK l _Toc .配置AutoSupport效力 PAGEREF _Toc h HYPERLINK l _Toc .配置SSH PAGEREF _Toc h HYPERLINK l _Toc .配置SNMP PAGEREF _Toc h HYPERLINK l _Toc .配置NTP PAGEREF _Toc h HYPERLINK l _Toc .配置MTA PAGEREF _Toc h HYPERLINK l _Toc .配置IPspace PAGEREF _Toc h HYPE

4、RLINK l _Toc .配置MultiStore PAGEREF _Toc h HYPERLINK l _Toc .配置CIFS PAGEREF _Toc h HYPERLINK l _Toc .配置ISCSI PAGEREF _Toc h HYPERLINK l _Toc .配置FCP PAGEREF _Toc h HYPERLINK l _Toc .配置NFS PAGEREF _Toc h HYPERLINK l _Toc .配置反复数据删除 PAGEREF _Toc h HYPERLINK l _Toc .配置Snaprestore PAGEREF _Toc h HYPERLINK

5、l _Toc .容灾实现Snapmirror PAGEREF _Toc h HYPERLINK l _Toc 日常维护 PAGEREF _Toc h HYPERLINK l _Toc .正常开关机 PAGEREF _Toc h HYPERLINK l _Toc .维护手段 PAGEREF _Toc h HYPERLINK l _Toc .Filerview 图形管理接口 PAGEREF _Toc h HYPERLINK l _Toc .命令行(CLI) PAGEREF _Toc h HYPERLINK l _Toc .空间管理：Aggr, Volume和lun的引见 PAGEREF _Toc

6、h HYPERLINK l _Toc .常用命令根本运用 PAGEREF _Toc h HYPERLINK l _Toc .日常系统检查 PAGEREF _Toc h HYPERLINK l _Toc .目测 PAGEREF _Toc h HYPERLINK l _Toc .例行系统检查 PAGEREF _Toc h HYPERLINK l _Toc .autosupport功能简介和配置 PAGEREF _Toc h HYPERLINK l _Toc 缺点处置流程 PAGEREF _Toc h HYPERLINK l _Toc .支持方式 PAGEREF _Toc h HYPERLINK l

7、 _Toc .NetApp on the web (NOW) site和效力 PAGEREF _Toc h HYPERLINK l _Toc .GSC( Global Support Center 全球支持中心) PAGEREF _Toc h HYPERLINK l _Toc .案例开立流程 PAGEREF _Toc h HYPERLINK l _Toc .损坏部件改换流程 PAGEREF _Toc h 作业规划步骤作业步骤作业内容参考文档环境预备检查和开箱并验证部件能否齐全第步和设备上架设备线缆衔接第步加电并验证设备正常Monitoring disk shelf components部分设置

8、磁盘归属，创建ROOT卷第-页检查并更新各部件的firmwareUpdating firmware检查并更新存储系统版本Installing Data ONTAP software images部分输入软件答应调整ROOT卷的大小第页运用SETUP进展初始化设置第-页配置VLANHow VLANs work部分修正hosts文件How the /etc/hosts file works部分修正/etc/rc文件Configuring network interfaces部分配置AutoSupport效力The AutoSupport feature部分配置SSHThe SSH protocol

9、部分配置SNMPHow to monitor your storage system with SNMP部分配置NTPSynchronizing the system time部分配置MTAResponding to sp setup prompts部分配置IpspaceWhat an IPspace is部分配置MultiStoreMultiStore management部分配置CIFSFile access using CIFS部分配置iSCSIBlock access Management guide for iSCSI and FC配置FCPBlock access Manageme

10、nt guide for iSCSI and FC配置NFSFile access using NFS部分配置反复数据删除配置SnaprestoreData Protection using Snapresotre部分配置容灾SnapmirrorData Protection using Snapmirror部分控制器高可用性测试第页Verification Checklist部分配置步骤配置参数表控制器A控制器B称号DSSSGDSSSG控制器序列号XXXXXXXXXXXX硬盘数量RAID级别RAID-DP无热备RAID+无热备vif称号vifvif端口ea、ebea、ebVif方式LACPL

11、ACPvif的IP 地址././.eM端口IP地址././.SP端口IP地址././.SP网关.管理效力器地址.设置磁盘归属，创建ROOT卷#启动控制器APhoenix TrustedCore(tm) Server Copyright - Phoenix Technologies Ltd.All Rights ReservedBIOS version: .Portions Copyright (c) - NetApp, Inc. All Rights ReservedCPU = Processors Detected, Cores per Processor = Intel(R) Xeon(R

12、) CPU E .GHzTesting RAMMB RAM testedMB RAM installed KB L CacheSystem BIOS shadowedUSB .: MICRON eUSB DISKBIOS is scanning PCI Option ROMs, that will take few seconds. Boot Loader version . Copyright (C) - Broadcom Corporation.Portions Copyright (C) - NetAppCPU Type: Intel(R) Xeon(R) CPU E .GHzStart

13、ing AUTOBOOT press Ctrl-C to abort.Loading X_/kernel/primary.krn:x/ xd/ xbf/ xbf/ Entry at xStarting program at xMTRR, will be reset to map region G to G as UCBBSP on that platform is xipmi_init_alloc_request_pool succeed (pool entries x,size per entry xe)ipmi_init: DONE.Press CTRL-C for special boo

14、t menu #进入特殊启动菜单IPMI:IPMI device rev. , firmware rev. ., version .IPMI:Number of channels ipmi_init: DONE.Special boot options menu will be available.Chelsio T RDMA Driver - version .Ipspace iwarp-ipspace createdTue Mar : GMT fci.initialization.failed:error: Initialization failed on Fibre Channel ad

15、apter c.Tue Mar : GMT fci.initialization.failed:error: Initialization failed on Fibre Channel adapter d.NetApp Release .: Thu Jul : PDT Copyright (c) - NetApp.Starting boot on Tue Mar : GMT Tue Mar : GMT nvram.battery.turned.on:info: The NVRAM battery is turned ON. It is turned OFF during system shu

16、tdown.Tue Mar : GMT diskown.isEnabled:info: software ownership has been enabled for that systemTue Mar : GMT config.noPartnerDisks:CRITICAL: No disks were detected for the partner; that node will be unable to takeover correctly() Normal boot.() Boot without /etc/rc.() Change password.() Assign owner

17、ship and initialize disks for root volume.(a) Same as option , but create a flexible root volume.() Maintenance mode boot.Selection (-)? #进入维护方式 Tue Mar : GMT shelf.config.mpha:info: All attached storage on the system is multi-pathed HA. You have selected the maintenance boot option: the system has

18、booted in maintenance mode allowing the following operations to be performed: ? disk fcadmin fcstat sasadmin sasstat acpadmin halt help ifconfig raid_config storage sesdiag sysconfig version vol aggr sldiag environment led_on led_off sata acorn scsi disk_list ha-config fcdiag fctest disktest diskcop

19、y xortest faltest outb disk_mung Type help for more details. In a cluster, you MUST ensure that the partner is (and remains) down, or that takeover is manually disabled on the partner node, because clustering software is not started or fully enabled in Maintenance mode. FAILURE TO DO SO CAN RESULT I

20、N YOUR FILESYSTEMS BEING DESTROYEDContinue with boot? yTue Mar : GMT mgr.boot.reason_ok:notice: System rebooted after a halt command.Tue Mar : GMT console_login_mgr:info: root logged in from console * Ipspace acp-ipspace created* disk show a #查看当前控制器下的磁盘Local System ID: DISK OWNER POOL SERIAL NUMBER

21、 NOTE: Currently disks are unowned. Use disk show -n for additional information.* disk show -v #查看磁盘的归属关系Local System ID: DISK OWNER POOL SERIAL NUMBER a. Not Owned NONE NZKL a. Not Owned NONE NJL a. Not Owned NONE NJML a. Not Owned NONE NZNL a. Not Owned NONE NJL a. Not Owned NONE JSRPL a. Not Owne

22、d NONE NVKL a. Not Owned NONE NYGL a. Not Owned NONE NXZVL a. Not Owned NONE NYLL a. Not Owned NONE NKKL a. Not Owned NONE NJWL * disk assign a. #把磁盘a.分配给当前控制器disk assign: DisTk assigned but uunable to obtain eowner name. Re- run disk assignM with -o optiona to specify namer : GMT diskown.changingOw

23、ner:info: changing ownership for disk a. (S/N JSRPL) from unowned (ID -) to (ID ).* disk assign a. #把磁盘a.分配给当前控制器disk assign: DisTk assigned but uunable to obtain eowner name. Re- run disk assignM with -o optiona to specify namer : GMT diskown.changingOwner:info: changing ownership for disk a. (S/N

24、NJL) from unowned (ID -) to (ID ).* disk assign a. #把磁盘a.分配给当前控制器disk assign: DisTk assigned but uunable to obtain eowner name. Re- run disk assignM with -o optiona to specify namer : GMT diskown.changingOwner:info: changing ownership for disk a. (S/N NJL) from unowned (ID -) to (ID )* disk assign a

25、. #把磁盘a.分配给当前控制器disk assign: DisTk assigned but uunable to obtain eowner name. Re- run disk assignM with -o optiona to specify namer : GMT diskown.changingOwner:info: changing ownership for disk a. (S/N NVKL) from unowned (ID -) to (ID ).* disk assign a. #把磁盘a.分配给当前控制器disk assign: DisTk assigned but

26、 uunable to obtain eowner name. Re- run disk assignM with -o optiona to specify namer. : GMT diskown.changingOwner:info: changing ownership for disk a. (S/N NYLL) from unowned (ID -) to (ID )* disk assign a. #把磁盘a.分配给当前控制器disk assign: DisTk assigned but uunable to obtain eowner name. Re- run disk as

27、signM with -o optiona to specify namer. : GMT diskown.changingOwner:info: changing ownership for disk a. (S/N NJML) from unowned (ID -) to (ID )* disk show v #查看磁盘的归属关系Local System ID: DISK OWNER POOL SERIAL NUMBER a. Not Owned NONE NZKL a. () Pool NVKL a. Not Owned NONE NZNL a. () Pool NJL a. () Po

28、ol NJL a. () Pool NYLL a. Not Owned NONE NYGL a. Not Owned NONE NXZVL a. () Pool NJML a. Not Owned NONE NKKL a. Not Owned NONE NJWL a. () Pool JSRPL * disk show v #拔掉多的块硬盘后，查看磁盘的归属关系Local System ID: Tue Mar : GMT disk.readReservationFailed:error: Disk read reservation failed on a. CDB xe: - SCSI:no

29、sense ( )Tue Mar : GMT diskown.errorDuringIO:error: error (no valid path to disk) on disk a. (S/N NXZVL) while reading reservation stateTue Mar : GMT disk.readReservationFailed:error: Disk read reservation failed on a. CDB xe: - SCSI:no sense ( )Tue Mar : GMT diskown.errorDuringIO:error: error (no v

30、alid path to disk) on disk a. (S/N NZKL) while reading reservation stateTue Mar : GMT disk.readReservationFailed:error: Disk read reservation failed on a. CDB xe: - SCSI:no sense ( )Tue Mar : GMT diskown.errorDuringIO:error: error (no valid path to disk) on disk a. (S/N NZNL) while reading reservati

31、on stateTue Mar : GMT disk.readReservationFailed:error: Disk read reservation failed on a. CDB xe: - SCSI:no sense ( )Tue Mar : GMT diskown.errorDuringIO:error: error (no valid path to disk) on disk a. (S/N NKKL) while reading reservation state DISK OWNER POOL SERIAL NUMBER a. () Pool NVKL a. () Poo

32、l NJL a. () Pool NJL a. () Pool NYLL a. Not Owned NONE NYGL a. () Pool NJML a. Not Owned NONE NJWLa. () Pool JSRPL * haltPhoenix TrustedCore(tm) Server Copyright - Phoenix Technologies Ltd.All Rights ReservedBIOS version: .Portions Copyright (c) - NetApp, Inc. All Rights ReservedCPU = Processors Det

33、ected, Cores per Processor = Intel(R) Xeon(R) CPU E .GHzTesting RAMMB RAM testedMB RAM installed KB L CacheSystem BIOS shadowedUSB .: MICRON eUSB DISKBIOS is scanning PCI Option ROMs, that will take few seconds. +Boot Loader version . Copyright (C) - Broadcom Corporation.Portions Copyright (C) - Net

34、AppCPU Type: Intel(R) Xeon(R) CPU E .GHzLOADER-A autobootLoading X_/kernel/primary.krn:x/ xd/ xbf/ xbf/ Entry at xStarting program at xMTRR, will be reset to map region G to G as UCBBSP on that platform is xipmi_init_alloc_request_pool succeed (pool entries x,size per entry xe)ipmi_init: DONE.Press

35、CTRL-C for special boot menuIPMI:IPMI device rev. , firmware rev. ., version .IPMI:Number of channels ipmi_init: DONE.Chelsio T RDMA Driver - version .Ipspace iwarp-ipspace createdTue Mar : GMT fci.initialization.failed:error: Initialization failed on Fibre Channel adapter d.Tue Mar : GMT fci.initia

36、lization.failed:error: Initialization failed on Fibre Channel adapter c.NetApp Release .: Thu Jul : PDT Copyright (c) - NetApp.Starting boot on Tue Mar : GMT Tue Mar : GMT nvram.battery.turned.on:info: The NVRAM battery is turned ON. It is turned OFF during system shutdown.Tue Mar : GMT diskown.isEn

37、abled:info: software ownership has been enabled for that systemSpecial boot options menu will be available.() Normal boot.() Boot without /etc/rc.() Change password.() Initialize owned disks ( disks are owned by that filer).(a) Same as option , but create a flexible root volume.() Maintenance mode b

38、oot.Selection (-)? aTue Mar : GMT shelf.config.mpha:info: All attached storage on the system is multi-pathed HA.The system has disks assigned whereas it needs to boot, will try to assign the required number.Zero disks and install a new file system? ythat will erase all the data on the disks, are you

39、 sure? yZeroing disks takes about minutes.Tue Mar : GMT coredump.spare.none:info: No sparecore disk was found.#启动控制器B,插上块多的硬盘Phoenix TrustedCore(tm) Server Copyright - Phoenix Technologies Ltd.All Rights ReservedBIOS version: .Portions Copyright (c) - NetApp, Inc. All Rights ReservedCPU = Processors

40、 Detected, Cores per Processor = Intel(R) Xeon(R) CPU E .GHzTesting RAMMB RAM testedMB RAM installed KB L CacheSystem BIOS shadowedUSB .: MICRON eUSB DISKBIOS is scanning PCI Option ROMs, that will take few seconds. +Boot Loader version . Copyright (C) - Broadcom Corporation.Portions Copyright (C) -

41、 NetAppCPU Type: Intel(R) Xeon(R) CPU E .GHzStarting AUTOBOOT press Ctrl-C to abort.Autoboot of PRIMARY image aborted by user.LOADER-B autobootLoading X_/kernel/primary.krn:x/ xd/ xbf/ xbf/ Entry at xStarting program at xMTRR, will be reset to map region G to G as UCBBSP on that platform is xipmi_in

42、it_alloc_request_pool succeed (pool entries x,size per entry xe)ipmi_init: DONE.Press CTRL-C for special boot menuIPMI:IPMI device rev. , firmware rev. ., version .IPMI:Number of channels ipmi_init: DONE.Special boot options menu will be available.Chelsio T RDMA Driver - version .Ipspace iwarp-ipspa

43、ce createdTue Mar : GMT fci.initialization.failed:error: Initialization failed on Fibre Channel adapter c.Tue Mar : GMT fci.initialization.failed:error: Initialization failed on Fibre Channel adapter d.NetApp Release .: Thu Jul : PDT Copyright (c) - NetApp.Starting boot on Tue Mar : GMT Tue Mar : GM

44、T nvram.battery.turned.on:info: The NVRAM battery is turned ON. It is turned OFF during system shutdown.Tue Mar : GMT diskown.isEnabled:info: software ownership has been enabled for that system() Normal boot.() Boot without /etc/rc.() Change password.() Assign ownership and initialize disks for root

45、 volume.(a) Same as option , but create a flexible root volume.() Maintenance mode boot.Selection (-)? Tue Mar : GMT shelf.config.mpha:info: All attached storage on the system is multi-pathed HA. You have selected the maintenance boot option: the system has booted in maintenance mode allowing the fo

46、llowing operations to be performed: ? disk fcadmin fcstat sasadmin sasstat acpadmin halt help ifconfig raid_config storage sesdiag sysconfig version vol aggr sldiag environment led_on led_off sata acorn scsi disk_list ha-config fcdiag fctest disktest diskcopy xortest faltest outb disk_mung Type help

47、 for more details. In a cluster, you MUST ensure that the partner is (and remains) down, or that takeover is manually disabled on the partner node, because clustering software is not started or fully enabled in Maintenance mode. FAILURE TO DO SO CAN RESULT IN YOUR FILESYSTEMS BEING DESTROYEDContinue

48、 with boot? y Tue Mar : GMT netif.linkUp:info: Ethernet cb: Link up.Tue Mar : GMT iwarp-vfilerctrl.rdma.heartBeat:info: Storage Interconnect status: Starting heartbeat to .Tue Mar : GMT mgr.boot.reason_ok:notice: System rebooted after a halt command.Ipspace acp-ipspace createdTue Mar : GMT console_l

49、ogin_mgr:info: root logged in from console* disk show v #查看磁盘的归属关系Local System ID: DISK OWNER POOL SERIAL NUMBER a. () Pool NVKL a. Not Owned NONE NYGL a. Not Owned NONE NKKL a. Not Owned NONE NJWL a. () Pool NJL a. () Pool NJL a. () Pool JSRPL a. () Pool NJML a. () Pool NYLL * disk assign a. #把磁盘a.

50、分配给当前控制器disk assign: Disk assigned but unable to obtain owner name. Re-run disk assign with -o option to specify name.Tue Mar : GMT diskown.changingOwner:info: changing ownership for disk a. (S/N NYGL) from unowned (ID -) to (ID )* disk assign a. #把磁盘a.分配给当前控制器disk assign: Disk assigned but unable t

51、o obtain owner name. Re-run disk assign with -o option to specify name.Tue Mar : GMT diskown.changingOwner:info: changing ownership for disk a. (S/N NJWL) from unowned (ID -) to (ID )* disk assign a. #把磁盘a.分配给当前控制器disk assign: Disk assigned but unable to obtain owner name. Re-run disk assign with -o

52、 option to specify name.Tue Mar : GMT diskown.changingOwner:info: changing ownership for disk a. (S/N NKKL) from unowned (ID -) to (ID ) * disk show #查看磁盘的归属关系Local System ID: DISK OWNER POOL SERIAL NUMBER a. () Pool NVKL a. () Pool NJWL a. () Pool NKKL a. () Pool NJL a. () Pool NJL a. () Pool JSRPL

53、 a. () Pool NJML a. () Pool NYLL a. () Pool NYGL * haltPhoenix TrustedCore(tm) Server Copyright - Phoenix Technologies Ltd.All Rights ReservedBIOS version: .Portions Copyright (c) - NetApp, Inc. All Rights ReservedCPU = Processors Detected, Cores per Processor = Intel(R) Xeon(R) CPU E .GHzTesting RA

54、MMB RAM testedMB RAM installed KB L CacheSystem BIOS shadowedUSB .: MICRON eUSB DISKBIOS is scanning PCI Option ROMs, that will take few seconds. +Boot Loader version . Copyright (C) - Broadcom Corporation.Portions Copyright (C) - NetAppCPU Type: Intel(R) Xeon(R) CPU E .GHzLOADER-B auyobootInvalid c

55、ommand: auyobootAvailable commands: version, update_flash, netboot, boot_diags, boot_backup, boot_primary, boot_ontap, sp, flash, bye, set, lsmod, autoboot, go, boot, load, ndp, ping, arp, ifconfig, show, savenv, saveenv, unsetenv, set-defaults, setenv, printenv, help* command status = -LOADER-B aut

56、obootLoading X_/kernel/primary.krn:x/ xd/ xbf/ xbf/ Entry at xStarting program at xMTRR, will be reset to map region G to G as UCBBSP on that platform is xipmi_init_alloc_request_pool succeed (pool entries x,size per entry xe)ipmi_init: DONE.Press CTRL-C for special boot menuIPMI:IPMI device rev. ,

57、firmware rev. ., version .IPMI:Number of channels ipmi_init: DONE.Special boot options menu will be available.Chelsio T RDMA Driver - version .Ipspace iwarp-ipspace createdTue Mar : GMT fci.initialization.failed:error: Initialization failed on Fibre Channel adapter c.Tue Mar : GMT fci.initialization

58、.failed:error: Initialization failed on Fibre Channel adapter d.NetApp Release .: Thu Jul : PDT Copyright (c) - NetApp.Starting boot on Tue Mar : GMT Tue Mar : GMT nvram.battery.turned.on:info: The NVRAM battery is turned ON. It is turned OFF during system shutdown.Tue Mar : GMT diskown.isEnabled:in

59、fo: software ownership has been enabled for that system() Normal boot.() Boot without /etc/rc.() Change password.() Initialize owned disks ( disks are owned by that filer).(a) Same as option , but create a flexible root volume.() Maintenance mode boot.Selection (-)? aTue Mar : GMT shelf.config.mpha:

60、info: All attached storage on the system is multi-pathed HA.Tue Mar : GMT netif.linkUp:info: Ethernet cb: Link up.Tue Mar : GMT iwarp-vfilerctrl.rdma.heartBeat:info: Storage Interconnect status: Starting heartbeat to .The system has disks assigned whereas it needs to boot, will try to assign the req