An-Infrastructure-Project-for-Climate-Research-in-Europe在欧洲的气候的研究的一个基础设施的项目课件

SophieValcke,CERFACSandthePRISMteamacrossEuropeSophieValcke,CERFACSOutlineENESThePRISMproject:partnersgoalsmodelcomponentsstandardphysicalinterfacesarchitectureandGUIPRISMfirstcoupler:Oasis3(08/2019):configurationcommunicationinterpolations/transformationsPRISMfinalcoupler(12/2019)configuration,communication,interpolations/transformationsComputinginAtmosphericSciencesWorkshop20192OutlineENESComputinginAtmospENESClimateresearchinEurope:Societal/politicalneedsinEuropehigh(IPCC,mitigation,…)Recognisedexcellence;scientificdiversity(models,approaches,…)

HowtoorganiseEarthSystemmodellinginEurope?The«

one-big-centre-does-it-all

»notsuitable:-expertiselieswithinnationalcentresdiversityiskeytoresearchNeedforsharedinfrastructures:-software(PRISM)-hardwareComputinginAtmosphericSciencesWorkshop20193ENESClimateresearchinEuropeENESENES:EuropeanNetworkforEarthSystemmodelling«Thinktank

»toorganize,planandseekfundingforefficientdistributedEarthSystemmodellinginEuropeFollowsaEuroClivarrecommendationOpentoanyinstitute/industry(MoU)CoordinatedbyGuyBrasseur(MPI,Hamburg)50memberssofar()ComputinginAtmosphericSciencesWorkshop20194ENESENES:EuropeanNetworkforAlongtermstrategy:JointlydevelopsharedsoftwareinfrastructureforEarthSystemmodellingProvideEuropeanintegratedservicetoaccessandusethisinfrastructureProvideandmanagehyper-computingaccessby2019PRISMENESComputinginAtmosphericSciencesWorkshop20195Alongtermstrategy:JointlydThePRISMprojectPRISM:PRogramforIntegratedEarthSystemModellingAEuropeanproject,startedDecember2019,funded for3yearsbytheEuropeanCommission(4.8M€)Coordinators:GuyBrasseur(MPI,Hamburg)GerbrandKomen(KNMI,Amsterdam)PRISMDirector:ReinhardBudich(MPI)ComputinginAtmosphericSciencesWorkshop20196ThePRISMprojectPRISM:PRogra=>22partners:leadingclimateresearchinstitutesandcomputervendorsMPG-IMET,GermanyKNMI,NetherlandsMPI-MAD,GermanyMet-Office,UKUREADMY,UKIPSL,FranceMétéo-France,FranceCERFACS,FranceDMI,DenmarkSHMI,SwedenNERSC,NorwayETHZurich,SwitzerlandING,ItalyMPI-BGC,GermanyPIK,GermanyECMWF,EuropeUCL-ASTR,BelgiumNECEuropeFECIT/FujitsuSGIEuropeSUNEuropePRISMpartnersComputinginAtmosphericSciencesWorkshop20197=>22partners:leadingclimatProvidesoftwareinfrastructuretoeasilyassembleEarthsystemcoupledmodelsbasedonexistingstate-of-artEuropeancomponentmodelslaunch/monitorcomplex/ensembleEarthsystemsimulationsPRISMgoalsHelpclimatemodellersspendmoretimeonscience:ComputinginAtmosphericSciencesWorkshop20198Providesoftwareinfrastructur

DefineandpromotetechnicalandscientificstandardsforESM:Scientificstandards:

PhysicalinterfacesbetweenmodelcomponentsGlobalEarthSystemparameters

Technicalstandards:

Compiling,running,post-processingenvironmentArchitectureandGraphicalUserInterface

CouplerandI/OsoftwareDataandgridformatCodingandquality

Interactionwithothergroups(ESMF,ESG/NOMADS,CF,RPN?,...)PRISMgoalsComputinginAtmosphericSciencesWorkshop20199DefineandpromotetechnicalAtmosphere:Météo-France(ARPEGE),MPG-IMET

(ECHAM),IPSL(LMDZ),MetOffice(UnifiedModel),UREADMY,INGVAtmosphericChemistry:MPG-IMET,UREADMY,IPSL,MetOffice,Météo-France,KNMILandSurface:

IPSL(Orchidée),MetOffice,MPG-IMET,UREADMY,Météo-France(ISBA)SeaIce:NERSC,UCL-ASTR,MetOffice,IPSL,MPG-IMETOceanBiogeochemistry:MPI-BGC,IPSL,MPG-IMET,MetOfficeOcean:

UREADMY,MetOffice(FOAM),MPI-M(HOPE),IPSL(OPA/ORCA)RegionalClimate:SHMI,DMI,MetOfficeCoupler:CERFACS,NEC,CCRLE,FECIT,SGI,MPI-MAD

PRISMmodelcomponentsComputinginAtmosphericSciencesWorkshop201910Atmosphere:AtmosphericChemistOceanmodel1-Rainfall+int.energy2-Snowfall+int.energy3-Incomingsolarradiat.4-Solarzenithangle5-Fractionofdiffusesolarradiation6-Downwardinfraredradiation7-Sensitivityofatmostemp.&humiditytosurf.fluxes1*-Sensibleheatflux2*-Surf.emissivity3*-Albedo,direct4*-Albedo,diffuse5*-Surf.radiativetemp.6*-Evaporation+int.energy[+Qlat]7*-Windstress8-Subgridfractions1-Surfacepressure2-4Airtemperature,humidityandwind5-Windmodule6-Heightofthese4variables1*-rCd2*-rCe3*-rCh1x-Nonsolarheatflux2x-Solarradiation3x-Freshwaterflux4x-Saltflux5x-Windstress6x-U^37x-Massofsnowandice8-

Subgridfractions1*-Surf.Temp2*-Surf.Roughness3*-Displacementheight4x-Surfacevelocity1-Continentalrunoff+internalEnergy1-2Temp./Salinityatsea-icebase3-Seasurfacetemperature4-Surf.radiativetemp.5-Surfaceoceancurrent6-Seasurfacesalinity7-Surfaceheight8-Absorbedsolarradiation(infirstoceaniclayer)Icebergparameters12345678

OceansurfacemoduleSurfacelayerturbulenceSeaicemodelwavemodel+3412Atmospheremodel

LandsurfacemodelNoteonsubgridfractiondependance:<>x-SeaIcecategories(incl.openocean)<>*-SeaIceorLandSurf.categoriesAproposalforPRISMstandardO-A-SIphysicalinterfaces:ComputinginAtmosphericSciencesWorkshop201911Oceanmodel1-Rainfall+int.PRISMcentralserver+PRISMlocalsitesGUI:adaptationofECMWFprepIFSandSMSscheduler

User/developerPrismcentralserverPrismlocalsiteWebWebPRISMarchitectureandGUI:

ComputinginAtmosphericSciencesWorkshop201912PRISMcentralserver+PRISMlBasedonOasisdevelopedsince1991inCERFACS

tocoupleexistingGCMsdevelopedindependentlyatthetime:Modelsatrelativelylowresolution(~10000-20000pts)Smallnumberof2Dcouplingfields(~10)Lowcouplingfrequency(~once/day)flexibilitywasveryimportant,efficiencynotsomuch!performs:synchronisationofthecomponentmodelscouplingfieldsexchangeandinterpolationI/OactionstestedonVPP5000,NECSX5,SGIOctaneandO3000,CompaqAlphacluster,LinuxPCcluster(MPI-Globus)PRISMfirstcoupler:Oasis3ComputinginAtmosphericSciencesWorkshop201913BasedonOasisdevelopedsinceOasisregularusers:CERFACSMETEO-FRANCE(France)IPSL-LODYC,LMD,LSCE(France)ECMWF(UK)UCL(Belgium)MPI-M&D(Germany)SMHI(Sweden)BMRC(Australia)IRI(USA)…and:AWI(Germany)PIK(Germany)MetOffice(UK)UGAMP(UK)KNMI(Netherlands)CSIRO(Australia)FSU/COAPS(USA)LASG(China)JAMSTEC(Japan)…?PRISMprojectfirstcoupler:Oasis3ComputinginAtmosphericSciencesWorkshop201914Oasisregularusers:…and:PRISPRISMprojectfirstcoupler:Oasis3Oasis3configuration:IntextfilenamcouplereadbyOasis3atthebeginningoftherun,e.g.totalruntimenumberandnamesofcomponentmodelsnumberandnamesofcouplingfields;foreachfield:sourceandtargetsymbolicnamecouplingand/orI/Ostatus,couplingorI/Operiodtransformations/interpolations…Componentmodelgrid(longitudes,latitudes,masks,meshsurfaces,meshcornerlocations)mustbeavailableinbinaryorNetCDFfiles.

ComputinginAtmosphericSciencesWorkshop201915PRISMprojectfirstcoupler:OPRISMprojectfirstcoupler:Oasis3Oasis3communication:NewPRISMSystemmodelinterface(PSMILe)basedonMPI1orMPI2messagepassingParallelcommunicationbetweenparallelmodelsandOasis3interpolationprocessAAABBBAAAfileAAA

O

O

O

OOasis3DirectcommunicationbetweenmodelswithsamegridandpartitioningI/Ofunctionality(automaticswitchbetweencoupledandforcedmode)Modularity:ateachmodeltimestep,exchangeisperformedornotdependingonuser’sspecificationsinnamcouple.Automatictimeintegrationdependingonuser’sspecificationComputinginAtmosphericSciencesWorkshop201916PRISMprojectfirstcoupler:OOasis3interpolations/transformationsPRISMprojectfirstcoupler:Oasis3AAA

O

O

O

OOasis3Oasis3=>performedbyseparatesequentialprocess=>on2DscalarfieldsonlyInterfacingwithRPNFastScalarINTerpolatorpackage

nearest-neighbour,bilinear,bicubicforregularLat-LongridsInterfacingwithSCRIP1.4library(LosAlamosSoftwareReleaseLACC98-45):

nearest-neighbour,1stand2ndorderconservativeremappingforallgridsbilinearandbicubicinterpolationfor«logically-rectangular»grids

BilinearandbicubicinterpolationforreducedatmosphericgridsOtherspatialtransformations:fluxcorrection,merging,etc.Generalalgebraicoperations

ComputinginAtmosphericSciencesWorkshop201917PRISMprojectfirstcoupler:OPRISMprojectfinalcouplerHigherresolution,parallelandscalablemodelsHighercouplingfrequenciesdesirableHighernumberofmodelsand(3D)couplingfieldsNeedtooptimiseandparallelisethecouplerThefinalPRISMcouplerwillbecomposedof:aDriveraTransformeranewPRISMSystemModelInterfaceLibraryComputinginAtmosphericSciencesWorkshop201918PRISMprojectfinalcouplerHigPRISMprojectfinalcouplerFinalcouplerconfiguration(XMLfiles):TheuserchoosesthemodelsthroughtheGUI.Eachcomponentmodelcomeswith:anApplicationDescription(AD)aPotentialModelInputandOutputDescription(PMIOD).TheuserconfigureshisparticularcoupledrunthroughtheGUI:totalruntime,etc.foreachfielddescribedinthePMIOD:sourceortargetcouplingorI/Ostatus,couplingorI/Operiodtransformations/interpolations,etc.Basedontheuser’schoice,theGUIproducestheXMLconfigurationfiles.Atrun-timetheDriverreadsanddistributesconfigurationinformation.ThePSMILesandTransformeractaccordinglytotheuser’sspecifications.ComputinginAtmosphericSciencesWorkshop201919PRISMprojectfinalcouplerFinPRISMprojectfinalcouplerFinalcouplercommunication:MoreelaboratePSMILebasedonMPI1orMPI2(griddefinitiontransferredthroughthePSMILeAPI)ModularityasforOasis3:ateachmodeltimestep,exchangeisperformedornotdependingonuser’sspecifications.AsforOasis3,automatictimeintegrationAsforOasis3,I/Ofunctionality(automaticswitchbetweencoupledandforcedmode)Parallelcommunication:asforOasis3+repartitioning.OBOBOBCCC

O1

O1CCParallelcalculationofinterpolationweightsandaddressesinthesourcePSMILeExtractionofusefulpartofsourcefieldonly.ComputinginAtmosphericSciencesWorkshop201920PRISMprojectfinalcouplerFinFinalcouplerinterpolations/transformations=>asforOasis3+SupportofvectorfieldsSupportof3DfieldsMoreflexibilityforfieldcombination/merging,etc.

ThePRISMprojectfinalcouplerComputinginAtmosphericSciencesWorkshop201921ThePRISMprojectfinalcoupleConclusionsENESandPRISMPRISMfirstcoupler:Oasis3,nowavailablePRISMfinalcouplerprototypedue11/2019PRISMfinalcouplerdue12/2019…andafterPRISM?Follow-onprojectre-submittedatnextEU-callin2019(CAPRIrejected)Internationalinteractionandcollaborationessentialinallcases!;http//cerfacs.fr/PRISM/prism.htmlvalckecerfacs.fr

ComputinginAtmosphericSciencesWorkshop201922ConclusionsComputinginAtmospPRISMprojectfirstcoupler:Oasis3Oasis3communication;PSMILeAPI::Initialization:callprism_init_comp(…)Retrievalofcomponentmodellocalcommunicatorcallprism_get_localcomm(…)

CouplingorI/Ofielddeclarations(name,type,shape,localpartition,…)callprism_def_var(field_idx,…)Endofdefinitioncallprism_enddef(…)Inmodeltimesteppingloop,couplingorI/Ofieldexchangecallprism_put(field_id1,time,field_array1,ierror),callprism_get(field_id2,time,field_array2,ierror)=>Automaticaveraging/accumulation,couplingexchange,and/orI/Odependingontimeargumentanduser’sspecificationsinnamcoupleTermination:callprism_terminate(…)ComputinginAtmosphericSciencesWorkshop201923PRISMprojectfirstcoupler:OPRISMprojectfinalcouplerFinalcouplercommunication;PSMILeAPI::AsforOasis3PSMILe+Definitionofgrid(1D,2D,3D)callprism_def_grid(…)callprism_set_corners(…)callprism_set_mask(…)Definitionofgridforvectorandbundlefieldscallprism_set_vector(…)Callprism_set_subgrid(…)CouplingorI/Ofielddeclarationssupportvector,bundles,1D,2Dand3DfieldsExtractionofSCCandSMIOCinformation:callprism_get_persist(…)ComputinginAtmosphericSciencesWorkshop201924PRISMprojectfinalcouplerFinATMSMIOC

V1:fromOCE,T1V2:toOCE,T2V3:toLANDuserLANDSMIOC

V3:fromATMV4:fromfileV4userOCESMIOCV1:toATM,T1V2:fromATM,T2userDriverTOCEATMLANDfileV4DefinitionPhaseOCEPMIODV1:out,metadataV1V2:in,metadataV2ATMPMIODV1:in,metadataV1V2:out,metadataV2V3:out,metadataV3LANDPMIODV3:in,metadataV3V4:in,metadataV4LANDADATMADOCEADV2V1V1V3V4DeploymentPhaseV2userCompositionPhaseuserSC