Isilon-的安装和维护手册7.0

1、XXXXIsilon IQ集群安装和维护手册IsilonXXXX集群安装和维护手册1. XXXX安装设定总览表目录1. XXXX装设定总览表32. Isilon的硬件安装 42.1. 前面板和铰链的安装 42.2. 滑轨的安装 63. 构建 Isilon 集群 83.1. 配置集群初始节点 83.2. 将新节点加入构建好的集群 144. Isilon后期设置 164.1. 增加所需用户和组 164.2. 设置NFS导出（共享） 174.3. 设置CIFS出（共享）184.4. DNS服务器设定修改204.5. 客户端设置 225. Isilon日常维护手册 245.1. 关闭节点 /集群 24

2、5.2. 替换硬盘 255.3. 替换电源 285.4. 替换电池 285.5. 长期断电电池电量不足的处理方法 296. Isilon后续添加节点说明 30集群部分Isilon集群概括安装节点5个保护级别全局N+2 : 1每节点裸容量（1000为单位）12TB每节点裸容量（1024为单位）10.8TB集群裸容量（1000为单位）60TB集群裸容量（1024为单位）54TB对外千兆以太网接口20网络设定部分内部网络Infiniband内网地址A100/Infiniband 内网地址 B100/内网Failo

3、ver地址100/外部网络使用网络接口5个节点的共个20千兆接口对外子网61-179其他对外子网无DNS服务器地址网关地址54非飘移管理地址SmartConnect VIP10.1103.180客户端连接Zone名称文件共享部分CIFS （Windows 文件共享）设定导出/ifs/data/jsb/ifs/data/test其他设定值domain usersNFS设定/、J无FTP设定FTP服务开启HTTP设定HTTP文件共享开启第3页共32页2. Isilon的硬件安装2.1. 前面板

4、和钱链的安装安装左，右较链支架到机器上第10页共32页LEFT HI临E将前面板和左右较链支架用螺丝固定连接显示线缆和前面板的PC板DI SPLAT CftBLECDNMLIIjR DNPC. BMRD2.2.滑轨的安装抽出滑轨最内侧的轨道将内侧滑轨安装到Isilon节点上KEYHOLEINNER RAILSHOULDER SCREW ON NODE CHASSISBLACK PLASTIC GLCEINTE 胃脑EME R4ILBALL BE A 生ING RETAINER将导轨固定在机柜上SLIDE RAILMOUNTING SCREW 安装Isilon下点到滑轨上给Isilon节点加电B

5、attery Battery PowarChassis IDSASPowor PowerUSBMangemoniSupDlv 1Supnl/2 Ports PortGigE EthernetExternal PortsInfiniBandInternal Ports3. 构建 Isilon 集群3.1. 配置集群初始节点用串口线连接一台电脑和 Isilon 节点的管理端口在电脑上打开“超级终端”程序配置串口连接的设置Transfer rate: 9600 bps IQ 1440/2250 models115,200 bps IQ 1920/3000/6000/9000 and IQ Accel

6、erator models115,200 bps IQ 1920x/3000x/6000x/9000xData bits: 8Parity: NoneStop bits: 1Flow control: Hardware提示符下创建root 和 admin 账户和密码接下来，将被询问是否收集报警信息“ Would you like to allow Isilon Systems, Inc. to receive critical alerts from this cluster? no ”Isilon 的配置向导自动打开Do you wish to1 create a new cluster.2

7、 join an existing cluster.3 exit wizard and configure manually.Wizard >>>创建集群Do you wish to1 create a new cluster.2 join an existing cluster.3 exit wizard and configure manually.Wizard >>> 1>>> 1 create a new cluster.按提示配置集群1 ) Type a new name for the cluster.Set Name >

8、>> isilonCluster name set to 'isilon'2 ) Cluster Encoding:1 Windows-SJIS2 Windows-9493 Windows-12524 EUC-KR5 EUC-JP6 EUC-JP-MS7 UTF-8-MAC8 UTF-89 ISO-8859-1 (Latin-1)10 ISO-8859-2 (Latin-2)11 ISO-8859-3 (Latin-3)12 ISO-8859-4 (Latin-4)13 ISO-8859-5 (Cyrillic)14 ISO-8859-6 (Arabic)15 IS

9、O-8859-7 (Greek)16 ISO-8859-8 (Hebrew)17 ISO-8859-9 (Latin-5)18 ISO-8859-10 (Latin-6)19 ISO-8859-13 (Latin-7)20 ISO-8859-14 (Latin-8)21 ISO-8859-15 (Latin-9)22 ISO-8859-16 (Latin-10)23 er Use default encoding: UTF-8Set Encoding >>> <Enter>3 ) Configure interface int-a:1 Configure Netm

10、ask2 Modify IP RangesEnter Keep the current configuration:Netmask: unsetIP Ranges: No ranges set.Configure Interface int-a >>> 14 ) Type a new netmask.Set int-a Netmask >>> int-a Netmask set to ''5 ) Configure interface int-a:1 Configure Netmask2 M

11、odify IP RangesEnter Keep the current configuration:Netmask: IP Ranges: No ranges set.Configure Interface int-a >>> 26 ) Manage cluster IP ranges 1 Add an IP range. 2 Delete an IP range.Enter Keep current IP ranges: No ranges set.Modify int-a IP Ranges >>> 17 ) Enter t

12、he low IP address of the range to add.Low IP Address (Add) >>> Enter the high IP address of the range. High IP Address (Add) >>> IP range added.8 ) Manage cluster IP ranges 1 Add an IP range. 2 Delete an IP range.Enter Keep current IP ranges: ' -1

13、<Enter>Modify int-a IP Ranges >>> int-a IP ranges configured.9 ) Configure interface int-a: 1 Configure Netmask 2 Modify IP RangesEnter Keep the current configuration:Netmask: IP Ranges: ' -'<Enter>Configure Interface int-a >&

14、gt;>10 ) Select the internal interface to configure. 1 int-a - Primary Internal Interface 2 int-b - Secondary Internal Interface (Failover)Enter Finished with internal interfacesConfigure Internal Interfaces >>><Enter>11 ) Configure External Subnet 1 Configure ext-1Enter Finished c

15、onfiguring External SubnetConfigure External Subnet >>> 112 ) Configure ext-1Configure ext-1 settings 1 Set Netmask 2 Set MTU 3 Set IP RangesEnter Keep the current settings:Netmask: unsetMTU: 1500IP Ranges: No ranges setConfigure ext-1 settings >>> 113 ) Set Netmask for ext-1Type t

16、he netmask:ext-1 netmask >>> 14 ) Configure ext-1 settings 1 Set Netmask 2 Set MTU 3 Set IP RangesEnter Keep the current settings:Netmask: MTU: 1500IP Ranges: No ranges setConfigure ext-1 settings >>> 315 ) Set IP Ranges 1 Add an IP range 2 Delete an IP ra

17、ngeEnter Keep current IP ranges: No ranges setSet IP Ranges for ext-1 >>> 116 ) Add an IP rangeType the low IP address of the range to add:>>> 01Type the high IP address of the range to add:>>> 0517 ) Set IP Ranges 1 Add an IP range 2 Delete an IP rangeE

18、nter Keep current IP ranges: 01 - 05Set IP Ranges for ext-1 >>> <Enter>18 ) Configure ext-1 settings 1 Set Netmask 2 Set MTU 3 Set IP RangesEnter Keep the current settings:Netmask: MTU: 1500IP Ranges: 01 - 05Configure ext-1 settings &

19、gt;>> <Enter>19 ) onfigure default gateway 1 Set Default GatewayEnter Keep current default gateway: '54'Configure default gateway >>> <Enter>20 ) Configure SmartConnect settings 1 SmartConnect Zone Name 2 SmartConnect Service IPEnter Keep current SmartCo

20、nnect settings:SmartConnect Zone Name: '第 17 页 共 32 页SmartConnect Service IP: '08'Configure SmartConnect settings >>><Enter>21) Configure DNS settings 1 Domain Name Servers 2 DNS Search ListEnter Keep current DNS settings:Domain Name Servers: not setDNS Search L

21、ist: not setConfigure DNS settings >>><Enter>22) Configure External Subnet 1 Configure ext-1Enter Finished configuring External SubnetConfigure External Subnet >>> <Enter>23)Manage cluster date and time 1 Set timezone 2 Set day and timeEnter Keep current date and time:“

22、 not setModify Date >>>24) Manage the cluster add node setting 1 Manual join 2 Secure joinEnter Keep current add node setting: 'ManualModify Add Node Setting >>><Enter>Join mode kept as 'Manual'.25) You have made the following configuration changes:- Cluster name

23、changed from unset to 'isilon'.- Interface int-a netmask changed from unset to .- Interface int-a IP ranges have changed from None defined.to 01 - 05- Encoding information changed from unset to UTF-8- External network changed.Do you wish to commit these change

24、s? yesCommit Changes? >>> <Enter>系统启动，进入图形界面https:01:8080Cluster Overview第27页共32页rmrciUihpuT L'ehmdcStaliK)c20O tatonAS 廿 14540 CSTMo nWcmg*知一| 一巴A<Mr*ciIn h4 Clutfa.i| Total Iw HDD LHT MOD、 野钊 1 找rl 9小知，*%口时M£eJ3 a4dressM7筝耳例E$T.5 MMN 口19ST ri一一av，UjG Ad-dvssiniTf

25、 aZSK23GK5.19 a111 AT <1一一 G adit«sis一一AZ 51MT c 1一 UbiK ccMinection sunimaryC Ml UMOf1B： % C lu<tr-r Hirouqliput f*jrbOLiLd aQh3.2.将新节点加入构建好的集群选择加入集群Cluster->Hardware Configuration->add nodeHardware Configuration3UtXrWi«& 网似q。5“第$A«l<l NodeOuster Oetal112.41Versiar

26、 J okisbei".O_Klar fliiBt 昌，甲血TUUAwaiUbii Nori«Q IMflg QMW 441 餐修iff wlP Otlftaeni! |h|JCI4$ BW1 Uwg a®I* w4Hi ucgr-sOwJ i：« ir*4.rgnj*<r f 此若 r lHn ?*:»- t*e<ig wKonhyw»in Spn Hsibg | Dfw* i选择加入集群Add N 5k4. Isilon后期设置4.1. 增加所需用户和组Cluster->Access Management->

27、;Users /GroupsAccass ManagemantLCXAPLoeal PriMerUrs；隔a W Uie-rs+ reMQ-au5<r.Gm事k对 U«fiVir# deriiM iPWMft£ bnlkduK Ui-iiLr*yez;小维加 i Drirte.i*aanRl5 U-SfTSFraBe-d,Ie 隅 lEXtt 1 口-E中由疏个u»r1gemSW ,£1白目决他也l序安值SyUrnUsprna?由EErnllCreate a user 用户没有 NIS 或者 LDAP,增力口 用户 wxx (uid=361, gr

28、oup proc, gid=592 )和 wzz (uid=1000, group proc, gid=592 )使用Isilon集群存储上的空间使用ssh登陆到Isilon集群上，执行如下命令# pw groupadd proc -g 592# pw useradd wxx -u 361 -g proc# pw useradd wzz -u 1000 -g proc4.2. 设置NFS导出(共享)在WebUI管理界面菜单栏 “PROTOCALS下的“NFS'项中配置export目录/ifs/data ,将“Map root users to” 设定为 wxx, “Assign Gro

29、ups” 设定为 proc删除系统默认的/ifs的NFS导出，增加安全性DASHBOARDCLU9TER MANAGEMENTFILE SYSTEM MANAGEMENTATA PROTECTIONPROTOCOLSWin=Slang 作曲山LinJIX Stiamirig |N写|FTPHFTP SeHir，ACLaUNIX Sharing (NFS)刎暗2mfs tMBfdv w物he Mena - 憎i nt*d*ml4 M中w罩修力妗坨国融找4m单的“。口制Im otaatmNFS Export41 上，ce /IT 库 nneed LEsDorrilDPHHicwbfldup?、*

30、dataiL I naaMI LIB立立,L22甲uppNFS共享设置Add NFSLxpon = 用不，gmry 闻mt:.一tPam I ."IhiMfl6fCM0«-r+ 岫i fwrHffmdiPrri'Hkrgr0山口打丽时,如/frkt jkg*i» 2w 0帆n Enabw inounl q“i； 4o tuMlr#donl«t片匕，3L bdr: Jnr« belaw Ihe pattiasi：: tie mcu-Ei皿日0词中UMff Pnp WurwnktO'rXi&MtyGroup' nen

31、e-SVMtf WinM4.3. 设置CIFS导出（共享）在WebUI管理界面菜单栏“ PROTOCALS下的“ Windows Sharing ”项中配置add a share目录/ifs/data ,?各“Map root users to”设定为 wxx, “Assign Groups”设定为 proc删除系统默认的/ifs的CIFS享，增加安全性JDASHBOARDCLUSTER ：.U MAG EM ENTFILE SYSTEM MANAGEMENTATA PROTECTIONPROTOCOLSWindow! Stiariiifl rSUB)| UM Shaiig 阳用FTPSrti

32、ifli HTTP Srttinflfc SOjWindows Sharing (SMB)w iiQn'duiiijirvd内眼ribu叩而 iMniMwi后修mmdasrai漳匚 1io£VfchfrdataiE j baritaM WdHM”mhKW胃侬胃I区或廿握 | totte HhA£li£iAFL 修'm 畜d+曲| h?*史?新建ShareSMB ShartiManage enisnng SMB shafts at mesne ne« sh-ares as 四u neefl Itiem Ga aJlki* diem to 1

33、1HBgm camerrt slnred 的 Islon dusflers5Hm Ec-vfce E1KHS； 5W El»tM SME :红磔写UB $hF + Mift *如iAdd 4111 SMB SMT? + ,id! SIiiwt Nare: 11rHe use3h«!於im wfl ««n 3 IB 的sr«T ar 刈t!” f小口0115V< 5时1舛，F.刖if -。一£W JT上AR, Or-BCH to-B4 Snofid： J&hwpBrowse.串横加卿J ACU «< Ugr

34、 怖HhM rlAull ACLt-J 的 同血酬 f-xivUpg p«rmi»OH9h3iE -YKZ3rs- To sonng. Alkw -uMe tApana-itmImiU Hlh 由他以7 mLl HL 口 工 扪 收:rb«>G dr4F MPm sn." cetti m寸imj*!匚-由 cndtley -»e lie 制IIfy th_*ni3or* wnin btr» arm, ir* &h*« Z 计值 篇建 inm.WE 看 Qrdf；a I+ - HU<4忖 Of -UB1U-

35、9«9 &口 口口 Aei-ounlsAccountftun A« Rdch.P?rmjsiK»nH2nn1%FrfCwLrv3 i -口曲ml*，ml哨附oa匐口丁，加日同川+附小前和施口御日“加加小山制2 -MCB5 pmvic&cl ?r JTDUrlSIICin C4L-ftrtMS >har«iMgmgE /ihdng 般相 aharei or -iejle new snares 财 通 nredinemla Mg dlM 恸岫earlem 才的1附由可口厘看3UH*7e$出 5*l0lnfinibea 加3帧£

36、修於45U日我年、_ Uffmg iPtti4.4. 文件系统管理在原有的/ifs/data目录下新建目录 datal、data2、data3 点击 ExplorerOJUjTER I1AWA&EMENTOA.TA PRO ACTIONF&EMAMAWBiEllTrhi '上叶FfetfIhtatf'U aurKiMi A£3iMCTC3*在 data 目录下新建 datal、data2、data34.5. DNS服务器设定修改要充分发挥SmartConnect功能，需要节点通过 DNS连接Isilon集群的zone名称，以达到不 同的节点连接不同的I

37、P地址的目的。启用 Isilon 的 SmartConnect Advanced 功能然后将VIP设定为指定的16,并为需要做 NFS Failover的地址池（pool）增加Zone 名称，为Isilonnfs.isilon ,具体设定如图Sen日旧I SettingsNetwork Configu ration Hardware CanfigurationNetwork Configurationsubneto - Default esct-l subnet de*也 su1或Settings 辿Subnet10 1 aoMetrnflSK：MTlk1&DCGate

38、way=1&.1,0.2S4, Pno-rily 1SmartConnect service P; 1C t 0 216USN tagging (S02.1Q):DisabledVLAN D:rx>t£etHardware lead ba.ancing IPs' not setIP Address Pools 工函 am日 ponl0 Default ext-1 poolBasic settings EditIP range Jaw-high)： iqj q,2Q1 , 1Q.1 Q,215Access zone:S/sitnEmartConnect setti

39、ngs EditZvnc na rr*e;is-ian>ife. GCcnnectian poky：Hound RobinSmartCpniiect service LCnet; £ubnstOIP alacstion nethaU'OynamicFt cba Ian ce policy:Automatic Fa ilba ckIPfmlDver policy:Hound Robin修改DNS服务器设定1. 修改/etc/named.conf ,增加一个名为"isilon”的zone,并设定使用设置文件 db.isilonzone "isilon&q

40、uot; in type master;file "db.isilon"2. 在 /var/named 下创建 db.isilon 文件，设定内容如下$TTL 86400 IN SOA wnsoft4.nwbcnis. root.wnsoft4.nwbcnis. ( 2008072900 10800 3600 604800 86400 )IN NS wnsoft4.nwbcnis.isilonnfsINNSisilonvipisilonvipIN A703. 在 /etc/named.conf 中添加 forwards 指向 VIPoptions d

41、irectory "/var/named/"forwarders 00;8;4. 运行 rndc reload 命令重新加载named 服务的设置4.6. 客户端设置为客户端设置DNS 服务器修改/etc/resoMconf内容，增加如下条目(客户环境的 DNS服务器地址为50) nameserver 50注：如果已经设定了DNS服务器，此步可以省略挂载 Isilon 集群假如客户端需要挂载文件系统到 /isidata1 上，执行如下命令# mount isilonnfs.isi

42、lon:/ifs/data /isidata1客户端会自动向 DNS服务器请求isilonnfs.isilon的IP地址，此时 DNS会根据Zone的设定向 isilonvip.isilon （即之前设定的 70 ）请求 isilonnfs.isilon 这个主机的 IP 地址，SmartConnect Advanced功能就会根据策略将不同的节点浮动IP地址返回给DNS服务器，再由DNS服务器返回给客户端，达到负载均衡的目的第 29 页 共 32 页5. Isilon日常维护手册5.6. 关闭节点/集群通过命令行关闭节点/集群1. 打开一个安全的外壳程序（SSHH）,

43、连接到想要shutting down的节点上2. 在提示符下输入 shutdown -p now如果想要对集群进行操作，则执行isi_for_array shutdown -p now "3. 等待节点保存日志，完成 shut down进程。在节点完成 shut down时，LED灯熄灭。通过 WebAdmin 方式 Shutting Down 集群1. 在“Cluster Management”菜单下点击“Hardware Configuration ”,然后点击“Shutdown/ Reboot Cluster”2. “Shut down or reboot cluster ”将

44、会出现DASHBOARDCLUSTER MANAGFMFNTGpie阳I Settings Newark 二ongura屈nFILE SYSTEM MANAGEMENTHardware Configuraiionitions Access Mana第 31 页 共 32 页Hardware ConfigurationAdd NodesRemove NodesShutdown & Reboot ControlsShut Duwn or Reboul This Cluster' Shut cown1 Reb3oc5 m mtCancel3.点击“ Reboot”关闭集群并重启，点击

45、“ Shut down”停止集群不重启。5.2. 替换硬盘通过命令行的方式替换硬盘1.在命令提示符下输入 isi devices -a status -d <Node ID#>,系统将显示这个节点所有硬盘的状态。例如：Node 1, OK Bay 1Lnum 0HEALTHYSN:GTF402P6GHURDF/dev/da12Bay 2Lnum 3HEALTHYSN:GTF402P6GHWANF/dev/da9Bay 3Lnum 6HEALTHYSN:GTF402P6GHSJHF/dev/da6Bay 4Lnum 9HEALTHYSN:GTF402P6GHUTYF/dev/da3B

46、ay 5Lnum 1HEALTHYSN:GTF402P6GHW71F/dev/da11Bay 6Lnum 4HEALTHYSN:GTF402P6GHX8DF/dev/da8Bay 7Lnum 7HEALTHYSN:GTF402P6GHWAZF/dev/da5Bay 8Lnum 10HEALTHYSN:GTF402P6GHX4TF/dev/da2Bay 9Lnum 2REPLACESN:GTF402P6GHSZBF/dev/da10Bay 10Lnum 5HEALTHYSN:GTF402P6GHWGAF/dev/da7Bay 11Lnum 8HEALTHYSN:GTF402P6GHWAKF/de

47、v/da4Bay 12Lnum 11HEALTHYSN:GTF402P6GHX11F/dev/da12.把标记为“ REPLACE的硬盘取下，将备件换上。运行 isi devices -a add -d <Node#>:<Drive Bay#>,在本例子中就是isi devices -a add -d 1:93. 插入的硬盘将被格式化，将出现下列信息：A OneFS-formatted drive was found in bay %d and is being attached to the . Wait a few minutes and re-run 'i

48、si devices' to verify that the attach operation completed successfully.通过 WebAdmin 方式替换硬盘1 . 点击“Dashboard-ClusterOverview 中“Status”中的节点名称。DASHBOARDCLUSTER MANAGEMENTFILE SYSTEM KCluster OverviewE 常eMsCluster OverviewClient ConnectionsThroughput Djsihbution第34页共32页Status - - x200 isilonSUt ID j.

49、AddressIn bfs Out lotdl b/3 HDD Used HDD Size % SS13 前Ss导3%5MIK 197 K 557 G W.fl T < 1。2 addressee S07b -配6b5 64G10.S T < 1036 addresses一 -5 56 G 10 B T < 12 . 在"Chassis and drive status”中点中要更换或者损坏的硬盘Chassis and drive statusChck a bmv or drive for further details.PldtfuirmFrontBay ZBw 34335414734Kb's附,Kbj's日立tI6时£576-fflO4354S3Kb'iKbiKb'iKb.'t日叱9机ID痴HBjtli例421眦槛Kbr-iKbr-iKb'sKbitHealtfiy Smart fail or rfstnpe in prcgrcsf tJot available I Suspended Not in u£e3 .如果硬盘可以使用，但是需要更换，点选“Smart Fail"，如果硬盘已经损坏，上图看到的对应方格应为灰色，且不需要Smart Fail,直