ParaView教程及算例Overview

IntroductiontoScientificVisualization,Agenda,09:00OverviewofComputerGraphicsandScientificVisualization10:30Break10:45Lab1:VisualizingwithParaView11:45LunchBreak01:00Lab2:Remote&CollaborativeVisualization01:45Lab3:VisualizingwithVisIt02:45Break03:00Lab4:ParallelVisualization04:00Adjourn,VisualizationSystemsandSoftware(UserEnvironment),LonghornVisualizationandDataAnalysis,InNovember2008,NSFacceptedproposalsfortheExtremeDigitalResourcesforScienceandEngineeringTheLonghornprojectwasproposedasanextgenerationresponsetoTeraGridsgrowingvisualizationanddataanalysisneeds,Spur-VisualizationSystem,128cores,1TBdistributedmemory,32GPUloginnode,noGPUsdontrunappshere!ivisbig.rangerSunFireX4600server8AMDOpterondual-coreCPUs3GHz256GBmemory4NVIDIAFX5600GPUsivis1-7.rangerSunFireX4440server4AMDOpteronquad-coreCPUs2.3GHz128GBmemory4NVIDIAFX5600GPUs,Spur/Rangertopology,LoginNodes,ComputeNodes,visqueue,normaldevelopmentqueues,FileSystem,ConnectingtoSpur,spur,laptoporworkstation,,qsub/share/sge6.2/default/pe_scripts/job.vnctouch/vncserver.outtailf/vncserver.out,spur,laptoporworkstation,sshL::,spur,laptoporworkstation,vncviewerlocalhost:,automaticportforwardingtovisnode,establishessecuretunneltospurvncport,localhostconnectionforwardedtospurviasshtunnel,containsvncportinfoafterjoblaunches,LonghornConfiguration,(256Nodes,2048Cores,512GPUs,14.5TGAggregateMemory)256DellQuadCoreIntelNehalemNodes240NodesDualsocket,quadcorepersocket:8cores/node48GBsharedmemory/node(6GB/core)73GBLocalDisk2NvidiaGPUs/node(FX5800-4GBRAM)16NodesDualsocket,quadcorepersocket:8cores/node144GBsharedmemory/node(18GB/core)73GBLocalDisk2NvidiaGPUs/node(FX58004GBRAM)14.5TBaggregatememoryQDRInfiniBandInterconnectDirectConnectiontoRangersLustreParallelFileSystem10GConnectionto210TBLocalLustreParallelFileSystemJobslaunchedthroughSGE,LonghornUsageModalities:,Remote/InteractiveVisualizationHighestpriorityjobsRemote/InteractivecapabilitiesfacilitatedthroughVNCRunon4hourtimelimitGPGPUjobsRunonalowerprioritythantheremote/interactivejobsRunon12hourtimelimitCPUjobswithhighermemoryrequirementsRunonlowestprioritywhenneitherremote/interactivenorGPGPUjobsarewaitinginthequeueRun12hourtimelimit,LonghornVisualizationPortal,LonghornQueueStructure,qsub-qnormal-Pvis,SamplingofCurrentProjects,ComputationalStudyofEarthandPlanetaryMaterialsSimulationofQuantumSystemsVisualizationandAnalysisofTurbulentFlowAprobabilisticMolecularDynamicsOptimizedfortheGPUVisualizationofNano-MicroscopyMURIonBiologically-InspiredAutonomousSeaVehicles:TowardsaMissionConfigurableStealthUnderwaterBatoidAdaptiveMultiscaleSimulations,OverviewofComputerGraphicsandVisualization,VisualizationAllowsUsto“See”theScience,Application,Render,GeometricPrimitives,Pixels,RawData,0100110101100111001010010101001010101001101110110101101100110010111010,GettingfromDatatoInsight,DataRepresentation,VisualizationPrimitives,GraphicsPrimitives,Display,IterationandRefinement,“I,We,They”DevelopmentPath,SimulationData,“I”DataExploration,“We”Collaboration,“They”Communication,IterationandRefinement,VisualizationProcessSummary,TheprimarygoalofvisualizationisinsightApictureisworthnotjust1000words,butpotentiallytera-orpeta-bytesofdataLargerdatasetsdemandnotjustvisualization,butadvancedvisualizationresourcesandtechniquesVisualizationsystemtechnologyimproveswithadvancesinGPUsandLCDtechnologyVisualizationsoftwareslowertoadapt,TypesofInputData,Point/ParticleN-bodysimulationRegulargridMedicalscanCurvilineargridEngineeringmodelUnstructuredgridExtractedsurface,Pointscatteredvalueswithnodefinedstructure,TypesofInputData,Gridregularstructure,allvoxels(cells)arethesamesizeandshape,TypesofInputData,Curvilinearregularlygridedmeshshapingfunctionapplied,TypesofInputData,Unstructuredgridirregularmeshtypicallycomposedoftetrahedra,prisms,pyramids,orhexahedra.,TypesofInputData,VisualizationOperations,SurfaceShading(Pseudocolor)Isosufacing(Contours)VolumeRenderingClippingPlanesStreamlines,SurfaceShading(Pseudocolor),Givenascalarvalueatapointonthesurfaceandacolormap,findthecorrespondingcolor(andopacity)andapplyittothesurfacepoint.Mostcommonoperation,oftencombinedwithotherops,Isosurfaces(Contours),Plotthesurfaceforagivenscalarvalue.GoodforshowingknownvaluesofinterestGoodforsamplingthroughadatarange,VolumeRendering,ExpresseshowlighttravelsthroughavolumeColorandopacitycontrolledbytransferfunctionSmoothertransitionsthanisosurfaces,Clipping/SlicingPlanes,ExtractaplanefromthedatatoshowfeaturesHidepartofdatasettoexposefeatures,ParticleTraces(Streamlines),Givenavectorfield,extractatracethatfollowsthattrajectorydefinedbythevector.Pnew=Pcurrent+VPDtStreamlinestraceinspacePathlinestraceintime,VisualizationResources,PersonalmachinesMostaccessible,leastpowerfulProjectionsystemsSeamlessimage,highpurchaseandmaintenancecostsTiled-LCDdisplaysLowestper-pixelcosts,bezelsdivideimageRemotevisualizationAccesstohigh-performancesystem,latencycanaffectuserexperience,VisualizationChallenges,VisualizationAllowsUsto“See”theScience,Application,Render,GeometricPrimitives,Pixels,RawData,0100110101100111001010010101001010101001101110110101101100110010111010,Butwhataboutlarge,distributeddata?,Ordistributedrendering?,0100110101100111001010010101001010101001101110110101101100110010111010,Ordistributeddisplays?,0100110101100111001010010101001010101001101110110101101100110010111010,Orallthree?,VisualizationScalingChallenges,MovingdatatothevisualizationmachineMostapplicationsbuiltforsharedmemorymachines,notdistributedclustersImageresolutionlimitsinsomesoftwarecannotcapturefeaturedetailsDisplayscannotshowentirehigh-resolutionimagesattheirnativeresolution,VisualizationscaleswithHPC,Largedataproducedbylargesimulationsrequirelargevisualizationmachinesandproducelargevisualizationresults,TerabytesofData,ATLEASTTerabytesofVis,GigapixelImages,Resampling,Application,ResolutiontoCaptureFeatureDetail,MovingData,Howmuchtimedoyouhave?,AnalyzingData,Visualizationprogramsonlybeginningtoefficientlyhandleultrascaledata650GBdataset-3TBmemoryfootprintAllocateHPCnodesforRAMnotcoresN-1idleprocessorspernode!StabilityacrossmanydistributednodesRenderingclusterstypicallynumberN=64DatamustbedividableontoNcoresRememberthiswhenresampling!,ImagingData,Hypotheticalfly-aroundmovie4096x2160PNG10MBx360degrees3.6GBx30days108GBx12months1.3TB10fps3.6hours60fps36min,Image:NASABlueMarbleProject,DisplayingData,Dell30”flat-panelLCD4Megapixeldisplay2560 x1600resolution,DisplayingData,Stallioncurrentlyworldshighest-resolutiontileddisplay307Megapixels38400 x8000pixelresolution,Dell30”LCD,DisplayingData,Dell30”LCD4Mpixel(2560 x1600),Stallion307Mpixel(38400 x8000),NASABlueMarble0.5km2perpixel3732Mpixel(86400 x43200),Whatsthesolution?,SolutionbyPartialSums,Movingdataintegratevismachineintosimulationmachine.Movethemachinetodata!Ranger+Spur:sharedfilesystemandinterconnectAnalyzingdatacreatelargervismachinesanddevelopmoreefficientvisappsSmallermemoryfootprintMorestableacrossmanydistributednodesUntilthen,thesimulationmachineisthevismachine!,SolutionbyPartialSums,ImagingdatafocusviseffortoninterestingfeaturesparallelizeimagecreationFeaturedetectiontodeterminevisualizationtargetsbutcanmiss“unknownunknowns”DistributeimagerenderingacrossclusterDisplayingdatahighresolutiondisplaysmulti-resolutionimagenavigationLargedisplaysneedlargespacesPhysicalnavigationofdisplayprovidesbetterinsights,OldModel(NoRemoteCapability),LocalVisualizationResource,HPCSystem,DataArchive,Pixels,Mouse,Display,RemoteSite,Wide-AreaNetwork,LocalSite,NewModelRemoteCapability,Large-ScaleVisualizationResource,HPCSystem,DataArchive,Display,RemoteSite,Wide-AreaNetwork,LocalSite,Pixels,Mouse,ParallelVisualization,Taskparallelismpassingresultsto1processforrendering,Timesteps,Processes,ParallelVisualization,PipelineparallelismUsefulwhenprocesseshaveaccesstoseparateresourcesorwhenanoperationrequiresmanysteps.,Timesteps,Processes,ParallelVisualization,DataparallelismDatasetispartitionedamongtheprocessesandallprocessesexecutesameoperationsonthedata.Scaleswellaslongasthedataandoperationscanbedecomposed.,Timesteps,Processes,ParallelVisualizationLibraries,ChromiumSitsbetweenapplicationandnativeOpenGLInterceptsOpenGLcalls,distributeacrossclusterCandoeithersort-firstorsort-last(sort-firstissimpler,sort-lastcanbebetterforlargedata)Lastupdate31Aug2006,nonewGLgoodiesIceT/kmorel/IceT/SAGE/cavern/sage/CGLX/cglx/specificallyforlargetileddisplaysMustuseIceT/SAGE/CGLXAPIincodeMesa/SoftwarerenderinglibraryEnablesOpenGLrenderingonmachineswithoutGPUs,Open-SourceParallelVisApps,VisIt/codes/visit/GoodscalingtohundredsofcoresIntegratedjoblaunchingmechanismforrenderingenginesGooddocumentationandusercommunityGUInotaspolishedParaView/PolishedGUI,easiertonavigateLessstableacrosshundredsofcoresOfficialdocumentationmustbepurchased,thoughrichknowledgebaseonweb(viaGoogle),RealExample-NVIDIAGeForceGTX580,16Cores(“StreamingMultiprocessors(SM)”)32SIMDFunctionalUnitsperCore(“CUDACores”)EachFUhas1fusedmultiply-add(SPandDP)Peak1024SPfloatingpointopsperclock2warpschedulersand2instructiondispatchunitsUpto32threadsconcurrentlyexecuting(calleda“WARP”)Coarse-grained:Upto48WARPSinterleavedpercoretomasklatencytomemory,RealExample-AMDRadeonHD6970,24Cores(“SIMDEngines/Processors”)64SIMDFunctionalUnitsperCore(“StreamCores”)1fusedmaddperFUPeak3072SPopsperclock2levelmultithreadingFine-grained:8threadsinterleavedintopipelinedFUsUpto512concurrentthreads(notcal