来自网络至网格

totheGridFromtheWebFromtheWebtotheGrid–2007WhywastheWebinventedatCERN?Sciencedependsonfreeaccesstoinformationandexchangeofideas.CERNisthehubofaworldwidecommunityof6500scientistsin80countries.CERNhasalonghistoryofbeingattheforefrontofscientificcomputingandnetworking(firstlabonInternetoutsidetheUS).DuringthepreparationofthepreviouslargeprojectLEP,theneedtosharedocumentsinaglobalwaybecamevital.FromtheWebtotheGrid–2007HowdidtheWebstart?1989:TimBerners-Leecirculates“InformationManagement:Aproposal”tohelpwithfutureLargeHadronColliderproject.1991:EarlywwwsystemreleasedtohighenergyphysicsviatheCERNprogramlibrary.FirstwebserverslocatedinEuropeanphysicslaboratories.1993:FirstMosaicbrowser;webreaches500serversand1%ofInternettraffic;CERNplacesWWWinthepublicdomain.FromtheWebtotheGrid–2007FromtheWebtotheGridTheWorldWideWebprovidesseamlessaccesstoinformationthatisstoredinmanymillionsofdifferentgeographicallocationsIncontrast,theGridisanemerginginfrastructurethatprovidesseamlessaccesstocomputingpoweranddatastoragecapacitydistributedovertheglobe.FromtheWebtotheGrid–2007HowdidtheGridstart?Name“Grid”chosenbyanalogywithelectricpowergrid(FosterandKesselman1997)Vision:plug-incomputerforprocessingpowerjustlikepluggingintoasterforelectricity.Concepthasbeenaroundfordecades(distributedcomputing,metacomputing)KeydifferencewiththeGridistorealisethevisiononaglobalscale.FromtheWebtotheGrid–2007DifferentGridsfordifferentneedsThereisasyetnounifiedGrid,likethereisasingleweb.RathertherearemanyGridsformanyapplications:EnterpriseGridslinktogetherPCswithinonecompany.Volunteercomputinglinkstogetherpubliccomputers.ScientificGridslinktogethermajorcomputingcentres.LatesttrendfederatesnationalGridsintoglobalGridinfrastructure.HighEnergyPhysicsisadrivingforceforthis.FromtheWebtotheGrid–2007TheLargeHadronCollider(LHC)MontBlanc,4810mDowntownGenevaLHCtunnelCERNFromtheWebtotheGrid–2007ViewoftheLHCtunnelFromtheWebtotheGrid–2007ViewoftheATLASdetector(underconstruction)150millionsensors…

…read40milliontimespersecond.FromtheWebtotheGrid–2007WhyistheGridbeingdevelopedatCERN?

Aparticlecollision=aneventPatternrecognitionproblemworkingbackwardsfromelectronicsignalsindetectorstomass,charge,momentumofdecayproductstomass,charge,momentumofshort-livedcollisionproductExampletheHiggsboson:lookforcharacteristicdecaypatternproducing4muonsRecord>8millioneventsperdayOnaverageonlyoneeventperdaywillbeaHiggsbosonFromtheWebtotheGrid–20071Megabyte(1MB)Adigitalphoto

1Gigabyte(1GB)=1000MB5GB=ADVDmovie1Terabyte(1TB)=1000GBWorldannualbookproduction

1Petabyte(1PB)=1000TBAnnualproductionofoneLHCexperiment1Exabyte(1EB)=1000PB3EB=Worldannualinformationproduction

TheLHCdatachallenge40millionbunchcollisionspersecondAfterfiltering,~100collisionsofinterestpersecondperdetector>1Megabyteofdatapercollisionrecordingrate>1Gigabyte/sec1010collisionsrecordedeachyearstoreddata~15Petabytes/year…formorethan10yearsFromtheWebtotheGrid–2007Concorde(15Km)Balloon(30Km)CDstackwith1yearLHCdata!(~20Km)Mt.Blanc(4.8Km)Wherewilltheexperimentsstoreallofthesedata?DataStoragefortheLHCLHCdatacorrespondtoabout20millionCDseachyear!FromtheWebtotheGrid–2007Wherewilltheexperimentsfindsuchacomputingpower?DataProcessingfortheLHCLHCdataanalysisrequiresacomputingpowerequivalentto~100,000oftoday'sPCprocessors!FromtheWebtotheGrid–2007ComputingatCERNHigh-throughputcomputingbasedonreliable“commodity”technology3500dualprocessorPCs10PetabytecapacityontapeNowherenearenough!FromtheWebtotheGrid–2007ComputingforLHCProblem:evenwithComputerCentreupgrade,CERNcanprovideonlyafractionofthenecessaryresources.

Solution:CERNhasover250partnerinstitutesinEurope,over200inrestoftheworld.Mosthavesignificantcomputingresources.BuildaGridthatunitesthesecomputingresources.

FromtheWebtotheGrid–2007LHCacceleratorandfourexperimentsFromtheWebtotheGrid–2007FromtheWebtotheGrid–2007FromtheWebtotheGrid–2007FromtheWebtotheGrid–2007TheGéantResearchNetworkGeneralpurposenetworkconnectingnationalresearchandeducationnets(NREN)ForLHCinaddition:OpticalPrivateNetworkwith10Gb/slinksoverdarkfibresFromtheWebtotheGrid–2007HowdoestheGridwork?Itreliesonadvancedsoftware,calledmiddleware.Middlewareautomaticallyfindsthedatathescientistneeds,andthecomputingpowertoanalyseit.Middlewarebalancestheloadondifferentresources.Italsohandlessecurity,accounting,monitoringandmuchmore.FromtheWebtotheGrid–2007GridApplicationsforScienceMedical/Healthcare

imaging,diagnosisandtreatment

Bioinformatics

studyofthehumangenomeandproteomeNanotechnology

designofnewmaterialsfromthemolecularscale

Engineering

designoptimization,simulation,failureanalysisNaturalResourcesandtheEnvironment

climatemodelling,earthobservationFromtheWebtotheGrid–2007Grid@CERNCERNprojects:LHCComputingGrid(LCG)EU-fundedprojectsledbyCERN:EnablingGridsforE-SciencE(EGEE)Industryfundedprojects:CERNopenlabforDataGridapplicationsFromtheWebtotheGrid–2007LHCComputingGridProject(LCG)Timeline:2002:startproject2003:serviceopened(LCG-1startedinSeptemberwith12sites)2005>100sitescontributing,>10kCPUs,2006:1GB/ssustainedtoTier-1centres2007:fulloperationofLHCcomputingservice.FromtheWebtotheGrid–2007WorldwideLHCComputingGrid(WLCG)Morethan100computingcentres12largecentresforprimarydatamanagement:

CERN(Tier-0)

andelevenTier-1s38federationsofsmallerTier-2centres32countriesinvolvedFromtheWebtotheGrid–2007FromtheWebtotheGrid–2007LCGservicebuiltontwomulti-scienceGridsEnablingGridsforE-science-EGEEOpenScienceGrid-OSGFromtheWebtotheGrid–2007Established10Gbit/sopticalnetworkbetweenCERNandTier-1sDatadistributionfromCERNtoTier-1sat1.6GByte/sec–rateneededin2008ATLASandCMStransfer1PBofdatapermonthtotheircentresRegularlyrunningamillionjobseachmonthacross

thegridDistributedgridoperationacross7sitesinEurope,USandAsia2006MilestonesFromtheWebtotheGrid–2007EGEE91institutionalpartnersinEurope,NorthAmerica,Russia,Asia.37m€budgetfor2ndtwoyearphase.LedbyCERN.Mission:ToprovideaccesstoaproductionqualityGridformultipleapplications,whichwillchangethewayscienceisdoneinEurope.…meteorologicalandgeologicaldataanalysisfromcentresacrossEurope……3Drenderingprogramsfromlaptops….…biomolecularsimulationfrommobilephones…FromtheWebtotheGrid–2007Recentexample:EGEEAttacksAvianFluEGEEusedtoanalyse300,000possiblepotentialdrugcompoundsagainstbirdfluvirus,H5N1.2000computersat60computercentresinEurope,Russia,AsiaandMiddleEastranduringfourweeksinApril-theequivalentof100yearsonasinglecomputer.Potentialdrugcompoundsnowbeingidentifiedandranked.Neuraminidase,oneofthetwomajorsurfaceproteinsofinfluenzaviruses,facilitatingthereleaseofvirionsfrominfectedcells.ImageCourtesyYing-TaWu,AcademiaSinica.FromtheWebtotheGrid–2007TowardsaEuropeanGridInfrastructureEuropeisinaleadingpositioninscientificGridsthankstoEGEE.Mustensuretransitionfromprojectstoasustainablee-infrastructure.RequirescreationofNationalGridInfrastructures.RequirescoordinationbyanewEuropeanOrganization(FP7).RequiresthesupportofEuropeanGovernments.FromtheWebtotheGrid–2007CERNopenlabPlatformcompetencecentreGridinteroperabilitycentreSecurityactivitiesNetworkingactivitiesStudentprogrammeJointeventsFromtheWebtotheGrid–2007EuropeanquadcorelaunchatCERN11/06FromtheWebtotheGrid–2007LHC@home:volunteercomputingBasedonBOINC(usedbySETI@home)CalculatesstabilityofLHCprotonorbits>30kvolunteers,>2000CPU-yearsTwoobjectives:Low-costCPUpowerforLHCRaisepublicawarenessofLHStartedasoutreachin2004(CERN50th)

PartnershipwithNielsBohrInstitute,QueenMary(LondonUni.),TRIUMFPlantodevelopnewphysicsapplicationsFromtheWebtotheGrid–2007The@homecommunityCompetitionfor“credit”(individuals,teams)Websitesandregularupdatesonstatusofprojectbyscientists.Forumsforuserstodiscussthesciencebehindtheproject.ThevolunteersshowgreatinterestinCERNandtheLHC.Supplyeachotherwithscientificinformation.LHC@homescreensaverFromtheWe