通过facebook拥抱下一代——分布式文件系统.pdf通过facebook拥抱下一代——分布式文件系统.pdf

收藏 分享

资源预览需要最新版本的Flash Player支持。
您尚未安装或版本过低,建议您

NEXTGENERATIONHADOOPOPERATIONSWHAT’SAHEADINTHENEXT12MONTHSFORHADOOPCLUSTERADMINISTRATIONANDREWRYANAPPOPSENGINEERFEB16,20111HADOOPOPERATIONSFACEBOOKANOVERVIEW2EXISTINGOPERATIONALBESTPRACTICES3THECHALLENGESAHEADNEWDIRECTIONSINHADOOP4EMERGINGOPERATIONALBESTPRACTICES5CONCLUSIONSANDNEXTSTEPSAGENDAHADOOPOPERATIONSFACEBOOK▪LEANSTAFFING,FASTMOVING,HIGHLYLEVERAGED▪BASICONCALLSTRUCTURE▪LEVEL124X7SYSADMINTEAM“SRO”FORWHOLESITE▪LEVEL22PEOPLE“APPOPS”TRADING1WEEKONCALLSHIFTS▪LEVEL34DIFFERENTHADOOPDEVSUBTEAMSWITH1WEEKROTATIONS▪PLUSONCALLSFROMOTHERADJUNCTTEAMSSITEOPSFORMACHINEREPAIRS,NETENGFORNETWORK,ETC▪EVERYENGINEERFBISISSUEDACELLPHONEANDEXPECTEDTOBEAVAILABLEINEMERGENCIESAND/ORIFTHEYMAKEACHANGETOAPRODUCTIONSYSTEMORCODEOPERATIONALGAPSINHADOOPOURBESTPRACTICESADDRESSALLTHESEGAPS▪HARDWARESELECTION,PREPARATION,ANDCONFIGURATION▪INSTALLATION/PACKAGING▪UPGRADES▪AUTOSTART/START/STOP/RESTART/STATUSASCORRECTUNIXUSER▪NODELEVELAPPLICATIONANDSYSTEMMONITORING▪CLUSTERLEVELANDJOBLEVELMONITORING▪INTEGRATEDLOGVIEWING/TAILING/GREPPING▪FAST,RELIABLE,CENTRALLYLOGGEDCLUSTERLEVELSHELLSLAVESSHEXISTINGOPERATIONALBESTPRACTICES1SYSADMIN▪ALLTHESTUFFYOUWOULDDOFORALARGEDISTRIBUTEDSYSTEMBUTESPECIALLY▪FAILED/FAILINGHARDWAREISYOURBIGGESTENEMYFINDITANDFIXIT,ORGETITOUTOFYOURCLUSTERSTHE‘EXCLUDES’FILEISYOURFRIEND▪REGULARLYRUNEVERYPOSSIBLEDIAGNOSTICTOSAFELYSCANFORBADHARDWARE▪IDENTIFYANDREMOVE“REPEATOFFENDER”HARDWARE▪FAILFAST,RECOVERQUICKLY,SMALLTHINGSADDUPINBIGCLUSTERS▪RHEL/CENTOSKICKSTARTSTEALSYOURDISKSPACE153PERDISK▪NOSWAPVMPANIC_ON_OOM1KERNELKDB0FOR“FASTAUTOREBOOTONOOM”▪NEVERFSCKEXT3DATADRIVESUNLESSHADOOPSAYSYOUHAVETOSYSADMINEXAMPLEIDENTIFYINGYOUR“AMERICA’SMOSTWANTED”PAYSOFFEXISTINGOPERATIONALBESTPRACTICES2TOOLING▪MAINTAINACENTRALREGISTRYOFCLUSTERS,NODES,ANDEACHNODE’SROLEINTHECLUSTER,INTEGRATEDWITHYOURSERVICE/ASSETMANAGEMENTPLATFORM▪BUILDCENTRALLYMAINTAINEDTOOLSTO▪START/STOP/RESTART/AUTOSTARTDAEMONSONHOSTSHADOOPCTL▪VIEW/GREP/TAILDAEMONLOGSONHOSTSHADOOPLOG▪START/STOP,OREXECUTECOMMANDSONENTIRECLUSTERSCLUSTERCTL▪MANAGEEXCLUDESFILESBASEDONREPAIRSTATUSEXCLUDERATOR▪DEPLOYANYARBITRARYVERSIONOFSOFTWARETOCLUSTERS▪MONITORDAEMONHEALTHANDCOLLECTSTATISTICS
编号:201312150000388321    类型:共享资源    大小:873.11KB    格式:PDF    上传时间:2013-12-15
  
3
关 键 词:
IS 电气 高压 110kv 220kv 550kv 800kv
  人人文库网所有资源均是用户自行上传分享,仅供网友学习交流,未经上传用户书面授权,请勿作他用。
关于本文
本文标题:通过facebook拥抱下一代——分布式文件系统.pdf
链接地址:http://www.renrendoc.com/p-218321.html

当前资源信息

4.0
 
(2人评价)
浏览:8次
baixue100上传于2013-12-15

官方联系方式

客服手机:17625900360   
2:不支持迅雷下载,请使用浏览器下载   
3:不支持QQ浏览器下载,请用其他浏览器   
4:下载后的文档和图纸-无水印   
5:文档经过压缩,下载后原文更清晰   

精品推荐

相关阅读

人人文库
关于我们 - 网站声明 - 网站地图 - 资源地图 - 友情链接 - 网站客服客服 - 联系我们

网站客服QQ:2846424093    人人文库上传用户QQ群:460291265   

[email protected] 2016-2018  renrendoc.com 网站版权所有   南天在线技术支持

经营许可证编号:苏ICP备12009002号-5