GPFS配置手册

1、江西省农信社GPFS安装手册目录1.江西省农信社GPFS规划错误!未定义书签。江西省农信社GPFS1群规划错误！未定义书签。集群Quorum方式错误！未定义书签。NSDB盘组成错误！未定义书签。文件系统基本信息错误！未定义书签。GPFS系统环境示意图错误！未定义书签。2.GPFS安装前准备错误！未定义书签。安装介质及补丁准备错误！未定义书签。Openssl及Openssh错误！未定义书签。Linux节点安装ksh错误！未定义书签。Linux节点修改网络参数错误！未定义书签。3.GPFS安装配置错误!未定义书签。 配置ssh信任关系错误！未定义书签。AIX安装GPFSM错误！未定义书签。Linu

2、x安装GPFSIM错误！未定义书签。GPFS1群配置错误！未定义书签。4.GPFS日常维护错误!未定义书签。GPFS启动错误！未定义书签。GPFS亭止错误！未定义书签。查看GPF豉用犬况错误！未定义书签。1.江西省农信社GPF物划1.1江西省农信社GPFSB群规划IP地址节点名操作系统集群角色76Quorum-manager76Quorum-managerforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerc

3、lientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientf

4、orPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclientforPowerclient1.2集群Quorum方式集群Quorum方式采用NodeQuorum+Tiebreakerdis

5、ks,两个AIX节点加上一块专用的SAN磁盘,目前只有一个AIX节点，第二个AIX节点和SANB盘需要后续添加。1.3NSDW盘组成PV_NAMESIZENSD_NAMEFS_NAMENSDSERVERLISThdisk2500Gbjxrccb_nsd1gpfs47spvhddsLoOOf5rootvgactivehdiskl00f8a6a46e4Sf429rootvgactivehdisk?nonejxrccB_nsdlhdlskSnonejxrccb.nsd?#mmlsnsdFilesystemDiskHaneNSDserversgpfsjxrccb_nsdlgpfs9fi.abs-ixn

6、xsicom1.4文件系统基本信息File5/5File5/5teTattrteTattri ihuterfarhuterfar/de%/de%r rgpf5gpf5: :flagvaluadsc.ription-f1ft1ftfragrbents17eInbyresfragrbents17eInbyres-i512512Tnodfiliar*inbytTnodfiliar*inbyt，-z163B4163B4IndiIndiITITectectblbloc.ksioc.ksizezeininbytesbytes-ri-riigFgFullLnufiberullLnufiberofofn n

7、LaditaLadita叩1111匚心-H-HjflKirfcjmnuThjflKirfcjmnuThifif秘仃必丁门-r-r1 1DefaultnufiberDefaultnufiberofdataofdatareplicasreplicas-R-R2 2MaxMax1 1numrtunbernumrtunbernfdal1nfdal1replitiisreplitiis-jclusterclusterfilgckfilgck”11-3811-38P Pnfnf5 54 4rVelockingrVelocking$色InoffsetInoffset-kallall轧L L5&rtt

8、anr-5&rttanr- ineffectineffectG GEitrutedminberofnodEitrutedminberofnod xthtxthtwillwillrtowntfile1rtowntfile11 1户fafa 5224852248BlocksizeBlocksize-QrKMierKMieQuotaserifoftedQuotaserifoftednortenorte中nTnT”rmhlMrmhlM-file5etdf-file5etdfm mFiFi1 1dfenabled?dfenabled?-w15.235,5.0.7)15.23erwintgptiy

9、nExactnntirerwintgptiyn-5-5g gsuppressaLineiKHmioptionsuppressaLineiKHmioption* *irfwnpwsibleirfwnpwsibleSiSi北工replicaanreplicaan ifonopTionifonopTion-fast-fastpapayesyesFatexternalattributpetriabledFatexternalattributpetriabled-inodie-inodie-limitlimit15680001568000Maximjnnumtmof-inodesMaximjnnumtm

10、of-inodes-P-PDiskllUTAJDiskllUTAJy yP P M1M1 inmeLyslflriinmeLyslflri-djxrcrbmdl;jxrccb-nsd?jxrcrbmdl;jxrccb-nsd?olsks1nolsks1nfilefilesystemsystem- -perfi-perfi1 1eset-quotaeset-quotai im mPer-fiPer-fi1 1esetquotaeotorcenentesetquotaeotorcenent-A-Ag g3EMHCrwunt5M3EMHCrwunt5Ml lionion-0-0g 昨e e.3dii

11、oniigjncoptions.3diioniigjncoptions-T-T沟pf5pf5DefaultnountpointDefaultnountpoint-nourrit-priority-nourrit-priority0 0MountpriorityMountpriority1.5GPFS系统环境示意图GPFSServer:2个AIX分区连接V7000SANStorage:SVCGPFSClient:48个PowerLinux分区GPFSf理网络：千兆交换机2.GPFS安装前准备%)安装介质及补丁准备安装包：GPFS3.5.0补丁：GPFS-%)Openssl及Openssh确认AI

12、X上openssl及openssh是否已 安 装,Linux默 认 已 经 安 装Islpp-l|grepopen#Islpp-1|grepopenopenssh.basecl1entopenssh.base.serveropenssh,man,en_usopenssh.wisg-enUSoperkssl.baseopenssl.licenseopenssl.man.ert_usopenssh.base.clientopensshtbase,servercjenssl.base2.3Linux节点安装kshrooH&scrverlercrpm-qagrepkshksh-20100621

13、-ig.Q16.ppc64-节点修改网络修改/etc/文件，需修改的网络参数如下a) increaseLinuxTCPbufferlimits=8388608=8388608b) increasedefaultandmaximumLinuxTCPbuffersizes=40962621448388608=40962621448388608c) increasemaxbacklogtoavoiddroppedpackets=2500COMMITTECopensecureshellcomnandsCOMMITTEDopensecure shellserverCOMWITTEDopensecure

14、shellCOMMITTEDCOMMITTEDOpenOpenSecureSecureShellShellMessagesMessagesCOMMITTEDpensecure SocketLayerCOMMITTEDOpenSecure SocketLicenseCOMMITTECOpenSecure socketLayerCOMMITTECopensecure shellcomnandsCOMMITTEDCOMMITTEDopensecure she11serverCUMMlCUMMl1 11kU1kUopenSecure socketLayer2.4#rpm-ivhoooooooooooo

15、ooooooooQQOQOOOOOO1 111111 11 1444114444114666622266-2oooos880.08o0.08o. .o.oo.o. .o o. .9 9. .9 9. .9 9. .o.oo.o.9.9.89BA-ni81Brootaerverlere#catsyset1.conf4.Kernelsysct1conf1guratfonfiforRedHatlinux#5.ForhinsryvalLIPS,0isdnsahlp(i,1prahlpd,SPPsysctl(S5and6.sysrTl.conf5jforf 口pdetaiIs.7.cortrolsIPp

16、acketforward1ngnet.ipv4.ip_forwArd=08.cortrolssourcerouteverifcationnet.1pv4,conf,default.rp_fliter=19.DoHOTacceprsourceroutingnet.1pv4.conf,default,accept_source_route=010.controlsthesystemRequestdebuggirgfurctlonalltyofthekernelkernel,s/srq=0年corrrolEwhethercoreduupsw111appendthePIDtorhecoref11ena

17、maffusefulfordebuggingmulLi-threadedappllcarIons.kernel,core_uses_p1d-.111.Control5theU5EofControl5theU5EofTCPTCP.ipv4,tcp_5yncookpv4,tcp_5yncooki i2525= =L L#Disablenstfauthorized_keys氀氀攀琀攀搀开愀攀愀挀 愀 昀 攀昀戀攀愀攀 一甀洀戀攀爀攀搀%24321 愀搀搀戀 攀挀 戀挀 搀搀戀昀戀搀攀昀 一甀洀戀攀爀攀搀开 戀戀 搀搀戀昀戀 甀氀氀攀琀攀搀开挀搀 挀 愀愀 挀搀戀挀 甀氀氀攀琀攀搀开挀hmod600a

18、uthorized_keys#echoStrictHostKeyCheckingnoconfig#chmod600config修改各节点的/etc/hosts文件，加入对集群中各节点的别名和ip地址验证本机无需密码的ssh登录#sshhostname将.ssh目录复制到其他各节点#scp-r/.ssh-r/.ssh#scp-r/.ssh#scp-r/.ssh验证各节点间无密码的ssh登录3.2AIX安装GPFSa件1)安装包放在/home/gpfsaix/iso目录下*pwd/home/pfsaix/isototal58296Q-rw-r一一r一一1rootsystem2548Nov123:4

19、9READKE-rw-r1rooT：system1492377C0Nov1823:49GPF5_ATX_3.5.tar-rw-r-一1rootsystem868352Nov1823:49gpfs.docs.data-rw-r-r-1rootsystem61939712Nov1&23:49gpfs,base-rw-r-r-1rootsystem175104NovIB23:19gpfs.msg.en_is-rw-rr-1roarsystem86242m04Nov1823:49gpfs,gnr2)切换/home/gpfsaix/iso目录下，通过smittyinstallp安装GPF歌件AL

20、L*3S.O.C4HS5rwx (I.S.Enrlidh安装补丁版本，需要升级到以上，补丁下载地址：&product=ibm/power/IBM+General+Parallel+File+System&release=&platform=AIX&function=all下载后上传到服务器后解压：gzip-d-c|tar-xvf-使用smittyupdate_all安装补丁4)安装后检查#lslpp-l|grepgpfsLEn.tiyFieldtlifna方置日7=Asvr1*1dlitanwdLrxl：EuGT*-icluv寸工RE/加值N NREREXmis

21、t孝LsInterAFTESnaluifaJ.1sInterAFTESnaluifaJ.1selectselectx.nns.x.nns.WARW3eraentFeif4iMdiMzrtioninCFeif4iMdiMzrtioninCpETTQFljOET1ftIWCm口Detacl-Jtd.WAf.Mae1H HERER:iirrZ.t卯ARTri?*alljpfs,I IM M狎+3.5*(1+0奸法了.d口匚Etrfjr.EEEE*3鼻口内CPFSbPF：FilFil 旧白StrTtT用师*0emKtdlDaetierrtatiw.hEU1DALLMlMlFI明*mF日o+6*-1Es

22、iE4-D=EsiE4-D= hAllhAllIFI=H1IBsQ*fSeLicrtFMifridiEH?+8*IAS9/=FlJi1F3=C：aftc：elEe?*0=Eltn=FindXAat如果之前已经创建了cluster,在所有node都down的状态下，加载GPFS版本到最新版本：mmchconfigrelease=LATEST;如果是新装的GPFS则可以忽略此步。3.3Linux安装GPFS件1）上传安装介质安装文件位于/home/gpfsrpm/updateupdategprfs.ba5e-S.5.0-O.ppc64.rpvgprfs.ba5e-S.5.0-O.ppc64.rpv

23、gpfs.docs-3.5.0-O_noarch.rpngpfs.docs-3.5.0-O_noarch.rpngpfs-Bsq.en_US-3.5.0-0.march.rpagpfs-Bsq.en_US-3.5.0-0.march.rpa.gpl-3,5.0-0.noarch,rpw.gpl-3,5.0-0.noarch,rpw20100621-19.cl6,ppc64.rpwinstall.sh20100621-19.cl6,ppc64.rpwinstall.sh3）升级GPFSt件版本在补丁文件所在目录下执行：#rpm-Uvhgpfs*.rpm4)检查安装结果#rpm-qa|grepgp

24、fsrootervertgpfsrpmrpm-qa|grepgpfs3pfs.5.Q-LL.ppc643pfs.docs-3.5.O-LL.noarchjpMmsq.en_us-3.5.0-11.noarchjpfs.gpTbin-2.6.32-358,e16.ppc64-3.5.0-11.ppc64jpfs.gpl-3.5.0-11.noarchBuildingtheGPFSportabilitylayer#cd/usr/lpp/mmfs/srcjrwxr-xr-x2rootroot4096oct00:33-rw-rr 1rootroot12062128Nav1。08:02-rw-r-r 1

25、rootFOOT221487Nov19 08:02irwr-二/-41rootroot96585NOV190SiO2-rw-r-r-1rootroot499693NOV1908:021rootroot6515J2NOV1908:02*rwxrxr-x1rootroot206NOVig09:56#Islpp-11grepgpfsgpfs.basegpfs-gnrgpfs.msg.en_usgpfs,basegpfs,docs.data1COMMITTEDGPFSFileManagerL5.0.7L5.0.7COMMITTEDGPFSNativeRAID

26、00COMMITTEDGPFSserverMessages-u..1COMMITTEDGPFSGPFSFileManager3,5,0.43,5,0.4COMMITTEDCOMMITTEDGPFSGPFSServerManpagesandServerManpagesand,补丁文件位于/home/gpfsrpm/updte;root(&serverlgpfsrpm/home；gpfsrpmrootSserverlgpfsrpm#total132322）安装GPFSt件在安装介质所在目录下执行:#rpm-ivhgpfs*.rpm#makeAu

27、toconfig#makeWorld#makeInstallImages修改系统环境变量AIX平台下修改/etc/environment在PATH后增加/usr/lpp/mmfs/bin#vi/etc/environmentrcar23M_PRDLCXi_lS,GIN_IAGP PUniaIsanitai1ygenjLtedprologw wF Fbcslfabcslfairt/bas/eIt/irt/bas/eIt/anv1ranmentanv1ranments senv1ronrieint1.env1ronrieint1.LicensedWaterialls-Propertyof工卧W，C

28、pPVitiGHTIrrterriafionalBusiciestwachirE5Corp.3489.1994r*11nightsReservedrluSGovermerr.tlsersRestrictedRights-LseBduplicatim mordiiclasurrTrt*ci&yniSAA A Schedule：Contes.with3corp.F电承)181,26sre/bosjetcronent.*erwiromert,bos员*b2l07_54AO7/25/0709;fl6;21F FIBM.FHOLOJEND.TAGIBM.FHOLOJEND.TAGCQMPOhLN

29、l.iMMt:bbellrelatedcoftmardsF事OBtGrHS;2?p(c)CGPniGi-nrmternstTionalfiusines.sMschines-corp.1930F1994.AllRightswesertdF FLicensedMteridls-Propertyof口热卜.usGae-rrwemusers1ct#diRishis-dupllcaitww wr01stlwureresrrtcredbyGSAGSAADPscheduleconrracrwliti工心coirp-.Systemwndieenviroinentfile,Thisfileshouldewily

30、contain声ILc*wentline5、6havea才inthe门产打coluwii.2,2,h*f*rsnatnvalAWRNTNC；;Thisfile-isonlyforestablihinnenrv-ironn-eintvariables.日包毗ofeZB 岳fro*chUMieoranyoihur第than；pec:1fled猛门M MuyU3u4或falluireofrhs1n1xlill7aiTl4nprocess.-,SearchinigthecurrentdirectorylastisusuallyaETGt

31、imesaverT TI*If/usr/hebis版thtbegiriniirhgofthePATHPATHtheBSDoftoMiiMidfewillbefo%nd.FAirusrbm;硕e:ysr.sbir:virrucbusr.birXll:sbin:wsr.箝jrt.bin:-tir心5bm:usr/ippnifjbirffZ-As-iaShangFijan-LAI*G-fl_U5IDCIDCPATHPATH* *ur/1ur/1lblbnls/lccnls/lcckLSPATH-usr/libnls/ascK KL LK KM M!/usr1ib/rils/nsg-K.-K.L L

32、* *JSJS. .car.ysrTfb/nls/asg-il.Kcysr1fb/nlsmsg/1.=tN.cAIAI|LC_F*5T56ztru*Linux平台下修改/root/.bashprofile,在PATH后增加/usr/lpp/mmfs/binroor(&5erverl:car/root/,bash_prof11e.bs5hL-prof_ilGetthealiasesandfunctionsif-f-/.bashre;then./*ba弓hr匚fiuserspecificcnvironHeriTandstartiipprogramsPATH=JPATH:3HOME/bin;

33、/usr/7pp/mrnfs/binexportPATH创建集群按照规划，本次集群中包含1个AIX节点和48个Linuxclient;首先在1个AIX节点平台创建GPF隙群创建集群定义文件#cd/home#mkdirgpfs#cdgpfs#vijxrcc_cluster:quorum-manager创建GPFS!群#mmcrcluster-Njxrccb_cluster-p-r/usr/bin/ssh-R/usr/bin/scp-Cjxrccb_cluster-A#mmcrcluster-Njxrccb_cluster-p-r/usr/bin/ssh-R/usr/bin/scp-Cjxrccb

34、_cluster-AWarning:Permanentlyadded(RSA)tothelistofknownhosts.TueNov1920:01:38CST2013:6027-1664mmcrcluster:ProcessingnodeCommandsuccessfullycompletedmmcrcluster:6027-1254Warning:NotallnodeshaveproperGPFSlicensedesignations.配置许可mmchlicenseserver-accept-Nmmchlicenseserver-accept-NThefollowingnodeswillb

35、edesignatedaspossessingGPFSserverlicenses:Commandsuccessfullycompleted添加Linux节点通过如下命令依次添加48个Linux节点：#mmaddnode-Nmmchlicenseserver-accept-N#mmaddnode-Nmmchlicenseserver-accept-N查看集群状态#mmlsclusterGFFSclusterinformationGPFEclustername:GPPScluseeridJGPFSDIDdartain:nerroteshellcdHMnd!ftemotefilecopyconna

36、nd:isrccl?clusT541193787137J9V7jxrect_eluster.abM.j父导箕专.towusr/binsshyusrbin/sepGPFSclustercnrifigurationrariErgurationrariEr弓：Prlnaryserver：qpfs46ab&-JKPXG.comscordAryserver:(non穹jNQti史PitmqnnodenineIPaddressAdnlnnudenamgprfs98afosLjxnxscomgpfsi49,bs.jxnxs.cangpfslSO.Abs.pnxs.conqpfsi51,lbs.jxr

37、xs.cornqpfsl52,己b5.JXTKS.comgp+515与bf JxrKs.conigpfsi4,-abs.xrxi.eonigpfsi56,dbs,rxri)gpfsi57.4bs+jxnxs.ecnigpf&1533必.“EtS.亡Ongpf15g.4bs,jriK$,cangpfmigpfmi 肛 gpfgpfgMc16N.Nbf.gMc16N.Nbf.Kriws.KxtxtTws.Tws.cotscotsXJIHS.-XTIqprsL63.ab:nz.zogpfsifiS.bs.pnxs.congprf169,abs,pruts,conqp-fsl/O.Jbs,co

38、rngpfsl71.jjtr5.conigpfsi72.abs.TXTHS.centgpf5173.abs.gpfsl74T.absJIXHKS.congpfsL75+ab$,：卜-gpfS17S+xrxs.congpfsi77,ab5,lgpfsi78tabTrm.ccngpfsl79*心5*xnxs.congpfSIBOJabSxgpfsi81.Abf.JgpfGgW,由与*:gpfslB44abs,jxnxs.congM与185,购+ixnss-comqpfslflG.ahs.gpfslfl7.abs.gpfslfl8,ab5,XFK5.XFK5.COmCOmX11KS.X11KS.co

39、co X*1KX*1KxrKE.comxnxs.xnxs.umx xrixi.rixi.COMCOMXrXriKS.CDiKS.CD gpfsiB9.ab$gpf5190,.jxrixs.congpf5191.,jxriKS.comgpfS192.ibt,jxrKS.cmgpfs|.03tibs,JxnKjttQm百pf5L94*absxrx$cangpfBL95.abs,Jxrics.匚MgpfsLSO.abs,Mnxs.cofligpf5170.ab.【xnxs-cwngpf5171,abs.;xnscomgpfsl7?xabsH;xnxsBcomgpf5173.abs,iixnxs co

40、mgpfsl74Tab，xnxs congpfSlZS,aM/IJCHMSIJCHMSB BCOWCOWgpf$l7CxahsJixnxs口comgpfsl77,山&,，力*CMgpfsl7B.absrxn*cs.Gxmgpfsi/9.abs.xnx.GQingpfS180Labs.1X0X5CG0gpfSLB1.abs.xnscs congpf5182.abs.5xnxs.coogpfsiea.abs.jxnxs-ccwiigpf51Mabs,xnxscomyjjfslB5.ab5.xnxscoagpf51SC.abs.;ixnxs eongpfsift?,abs,; xnxs co

41、tHgpfsUA.absJxrtKS.comgpfslB$abs*： xnxsewigpf5190.ab”xnx$Bcomgpf5191.abs/MET1M. COH1gpfsi92.ab弓xnxs comgpf$19335T工门富5BQourt600nsdyhreadsPerDisk3nedThreadMethod1pagepool工GpagepQcl4Ggpfs9fipagepoo1MaxPhysMcmPCT75preferchThreads72prefetchThreads1C0Cgpfs98subnets(undef1redjtaccmdPortRanqe(undefined)tieb

42、reakerDnsK5:undefined)uidDomain(undef1red)unmounxonDlskFai-InousePersnstentReservenoverbsports(undefined)verbRdmadisableworkeriThrcads4Se）启动集群#mmstartup-a启动后，查看集群状态#mmgetstate-a确保所有节点的状态为Active*mmgerstate-aNodenumberNodenameGPFSstateL2345678Q-OL234567S9OL23456789O123456789O1234L2345678Q-OL234567S9OL

43、23456789O123456789O12345 567678 89 911111111112222222222333333333344444444441111111111222222222233333333334444444444gpfsQBgpfs149gpfsl50gpfslSlgpfs!52gpfslSigpfsl54gpfsl56gpfsl57gpfs!56gpfs!59gpfslfiOgpfslGlgpfsiesgpfsl62gpf:sl64gpfslGSgpfs166gpfsl67gpfsieegpfsl69gpfs170gpfslZlgpfsl72gpfsl73gpfs174g

44、pfsl75gpfsl76gpfG177gpfslZfigpfsl79gpfslBOgpfslSigpfs182gpfsl63gpfsl84gpfslSSgpf5186gpFslS?gpfsl88gpf5189gpfslQOqpfsl91gpfsi92gpfsl93qpfsl94gpfsl35gpfsl96qpfsl55activeactiacflactiact-acr且eract”act!veVQvev电vevev电activeactiveactiVQactiveact1veactiveact1veact1veatTiveacxiveactiveactiveactiveactiveacTiv

45、e创建NSDB盘修改fscsi参数在所有直接访问SANB的节点上执行#lsdev|grepfscsi|awkprintchdev-l,$1,-adyntrk=yes-afc_err_recov=fast_fail|sh识别外置存储磁盘在所有直接访问SANB的节点上执行#cfgmgr修改hdisk参数在所有直接访问SANB的节点上执行#lsdev-Ccdisk|grepMPIO|awkprintchdev-l,$1,-aalgorithm=round_robin-aqueue_depth=8-areserve_policy=no_reserve|sh创建NSD苗述文件#cd/gpfs#vihdi

46、sk2:jxrccb_nsd1:hdisk3:jxrccb_nsd2:备注文件格式：DiskName:ServerList:DiskUsage:FailureGroup:DesiredName:StoragePool在本集群中，将AIX节点定义为NSDServer,如果NSD较多可以将每块盘的首选NSDServer设置为不同，以均衡NSDSever的负载；生成NSCa#mmcrnsd-F#mmcrnsd-Fnsd.confmmcrnsd:PF口匚essdngdiskhdisk2mmcrnsd;Prccess-ingdiskhdisk?mmcrnsd:6027-1371Propagatingth

47、eclusterconfigurariondataTOal1affectednodes.ThisisanasynchrOFIOJSprocess.查看NSca#mmlsnsd#mmlsnsdFilesystemDisknameNSDservers(freedisk)jxrccb_nsd1(freedisk)jxrccb_nsd2定义Tiebreakerdisks集群处于Down状态时才能定义;#mmshutdown-a#mmchconfigtiebreakerDisks=定义后可用如下命令查看；#mmlsconfig创建GPFSC件系统#mmcrfsgpfs-F-Ayes-B512K-T/gp

48、fs#mmcrfsgpfs-F-Ayes-B512K-T/gpfsGPFS:6027-531ThefollowingdisksofgpfswillbeformattedonnodeABSGPFS1:jxrccb_nsd1:size2KBjxrccb_nsd2:size2KBGPFS:6027-540Formattingfilesystem.GPFS:6027-535DisksuptosizeTBcanbeaddedtostoragepoolsystem.CreatingInodeFileCreatingAllocationMapsCreatingLogFilesClearingInodeAll

49、ocationMapClearingBlockAllocationMapFormattingAllocationMapforstoragepoolsystemGPFS:6027-572Completedcreationoffilesystem/dev/gpfs.mmcrfs:6027-1371Propagatingtheclusterconfigurationdatatoallaffectednodes.Thisisanasynchronousprocess.通过mmlsconfig或mmlsfsall命令可以看到所创建的文件系统#mmlsconfigConfigurafiondataforc

50、lusterjxrccb-:nYMbdctorif1gNumber1ClusterWarnejxrccb_ClusterId9411937827136739327autoloadyesdrnapiFl1eHandleSize32nininRelnReleaaeLeveleaaeLevel.0.0.1111pratchThreads72prefelcnThresdsLOGOpmqcpo014Gcommonfal1ureoetect1OOTIme15niaxMBps4096admimodecentralFT1esystemsinclusterjxrccb-:/dev/gpfs挂载集群

51、文件系统#mmmountall-a挂载后查看集群文件系统的mount状态#mmlsmountallFilesystemgpfsismountedon49nodes.修改文件系统inode最大值#mmchfsgpfs-inode-limit修改挂载文件系统的最大节点数#mmchfsgpfs-n=128查看文件系统的属性#mmlsfsallGPFSC件系统支寸e的最大inode数，可根据如下公式进行计算：maximumnumberoffiles=(totalfilesystemspace)/(inodesize+subblocksize)备注：subblocksize是创建文件系统时所指定Bloc

52、ksize的1/32；例如：按文件系统400Ginodesize为512bytes,Blocksize为512k来计算maximumnumberoffiles=(600*1024*1024*1024)/(512+524288/32)=File$卢Lgnaicrfbuc骼for/devgpfs:GPFSH常维护GPF丽动启动所有的节点：mmstartup-a启动单个节点：例如启动节点mmstartup-N停止GPFS亭止步骤：umount挂载的FS停止所有的nodeumount挂载的FS:umount所有节点mmumount-aflagvalud?scriptlan3616616-fiil5td

53、f-V-V-create-11w-fuicsa-inode-llrait-P-d-perf1Te&et-quoca-ATnount-nr1nr1tvcIuiitvnfs4all12g52428BfKMWfKMWTO13.23C3-S-O-7)TueNg19上。-201Jy”no4194104rmnheripg，ibIeyes1155ECMasystemjxTc.cb.nsdl:jxrccb.nsdZTOyesnon#/flpfsminimumfrautenrml上电inbyresnrtdcTireirtaytrTKiitiKiitirectrectblactblactsizeinsizein