云计算读书笔记.doc

20102011mapreducehadoopxenit()ititcpumapreducemapreduce1tbmapreduce, mapreducehadoophadoopapachemapreducegoogleapachehadoophadoop distributed file systemhdfshdfslow-costhigh throughputlarge data sethdfsrelaxposixrequirementsstreaming accessthe internet of things-rfidmapreducesimplified data processing on large cluster8mapreducegooglegooglemapreducetmapreducegooglemapreduce apachehadoopjavastanfordphoenixmapreducemapreducegooglewebwebgooglejeffery deanlispmapreducemapkey/valuekeyvaluereducemapreducepckey/valuekey/valuemapreducemapreducekey/valuemapreducekey ivalucereducereducekey ivaluevaluevaluereduce01valuevaluereducevaluewordcountmap(string key, string value):/key: /valuefor each word w in value :emit intermediate(w, 1) ;reduce(string key, iterator values) :/key: /values: int result=0;for each v in values:emit(asstring(resut);map1reducemapreducemapreducemapreducetermmapreducemapk1v1listk2v2reducek2listv2listv2keyvaluekeyvaluekeyvaluekeyvaluesc+grepurlmapreducemapreducegooglemapreduce:1. linux,2-4gb.2. ,.3. ,.4. ide.5. .,.msplit,map.split.key,r(hash(key) mod r),reduce.(r).1mapreduce.mapreduce,(1)1. mapreducem, 1664mb().2. master,masterworker.m maprreduce.mapreduceworker3. mapworkersplit.key/value,key/valuemap.mapkey/value4. key/value,r.master,masterreduce worker5. reduce workermaster,map worker.reduce worker,key.keyreduce,.,6. reduce worker,key,keyvaluereduce.reducereduce7. mapreduce,.,mapreduce,mapreducer(reduce).,r-mapreduce,master mapreducegoogle.,mapreducemapreducegooglewebmapreducegoogle.mapreducemapreduce20101.-epcglobaliotpdarfide-koreau-japanibm1020091011. 1it1. 2saaslaaspaasmaascaassaaslaaslaaspaaspaas2010 free view pointfree view point2. 1rendering3. 2rendering34. .2 idc-idc-idc-idi-cd5. 4websaas(software as a service), paas(platform as a service),iaas(infrastructure as a service)gis webgisgisgis webgisgisogcogcgisesriarcwebgismappoint .netxml webab-xmlogcgml:xmlc .ogc web map service (wms)ocg wms-ogc 1. mobile-net3.software as a service, saas, gmailplatform as a service: