数字视频特效处理lec01-概述

CourseoverviewDigitalVisualEffectsYung-YuChuangLogisticsMeetingtime:2:20pm-5:20pm,TuesdayClassroom:CSIERoom102Instructor:Yung-YuChuang(cyy@.tw)Teachingassistants:TBATextbook:Readingsfrombooks,journalsandproceedings.RichardSzeliski’sComputerVision:AlgorithmsandApplications.RichardRadke’sComputerVisionforVisualEffects.Webpage:(username/password).tw/~cyy/vfxMailinglist:vfx@.twsubscribevia.tw/mailman/listinfo/vfx/ThiscourseisNOTabout…Itisn’taboutphotographyItisn’tabout3DanimationsItisn’taboutwatchingmoviesItisn’taboutphysicaleffectsIt’snotaboutindustrialtrickscomputervisioncomputergraphicsimageprocessingYouwilllearnmoreaboutTaylorandPoissonthanLucasandSpielberginthiscourse.IfyouhearLucasintheclass,itismorelikelytorefertoBruceLucas,notGeorgeLucas.PrerequisitesItisamustthatyouhaveprogrammingexperiences.Itisamustthatyouhavebasicknowledgeonlinearalgebraandprobability.Itisaplusifyouhavebackgroundknowledgeoncomputervision,imageprocessingandcomputergraphics.Itisaplusifyouhaveaccesstodigitalcamerasandcamcorders.ThevfxcoursewhatyouactuallydowhatyouthoughtyouwilldowhatotherstudentsthinkyoudowhatotherprofessorsthinkyoudoBecautious!Warningfrompreviousstudents請學期初老師要多提醒這門課的困難度請興趣或實力不足的同學勿修，否則就會像我一樣停修XD

Thiscourseisabout…DigitalVisualEffectsLifeofPiLifeofPi獨自一人拍和十三人的戲要把身材高大的甘道夫和小矮人們拍攝在一起，我們是沒法在同一個片場的。和我一起拍攝的只有柱子上貼著的13張他們的照片，後面還有一個小燈，哪個角色說話了燈就亮起來。想像一下你在拍一場和13個人一起演的戲，但你卻只有獨自一人。這真的會把你的演技推到極限。我哭了，真的，我當時真的哭了。然後我還說出了聲：我認真演了一輩子不是為了跟這些照片對戲啊！Reality?RetouchingRetouchingRetouchingIraqWar,LATimes,April2003DigitalphotomontageBushcampaign’sTVAD,2004TexturesynthesisandinpaintingDomesticexampleTheLibertyTimes2007.12.17SpecialeffectsStopactionTheexecutionofMary,1895GlassshotRearprojectionKingKong,1933stopmotionSpecialeffects(make-up)Specialeffects(physicaleffects)Specialeffects(miniature)Specialeffects(mattepainting)LordoftheRingsIllusion-forcedperspectiveComputer-generatedmodelTheAvengers(1978vs2012)Visualeffects100YearsProductionpipelineProductionpipelinePreproductionProductionPost-productionArtworkReferenceStillsPlatesStoryboardEditingVFXMusicSoundFilmEffectsPreproductionStoryboardPreproductionArtworkPreproductionReference&ResearchProductionShootingPost-productionVisualeffectsproductionPreproductionProductionPost-productionArtworkReferenceStillsPlatesModelGeometrySkinningEffectsAnimationCharacterAnimationLightingandRenderingCompositingMatchmoveandMatchmodelAssetsShotsSkeletonScanningFilmRecordingTexturesMaterialsStoryboardEffectsVisualeffectspost-productionAcasestudy405:TheMovieThismoviewerecreatedsolelybytwovisualeffectsartistsintheyearof2000.Itwasaprocessthattookoverthreemonthsofnights,weekendsandanysparemomentsthattheycouldfind./405:TheMovieMakingof405Step0:scriptandshootingplanMakingof405Step1:shootingtwodayswithaCanonOpturaDVcamerawithprogressivemode.a70-minuterawfootageinitialediting

pickupshotsMakingof405Step2:buildingCGworldtotal62shots,42enhancedwithdigitalVFX.19shotsareentirelydigitalcreations.plane,twocars,freewaybackgroundaredigitalphoto-based3DenvironmentMakingof405Realcarswereusedforclose-upandinteriorshotsAlow-resolutionmeshscannedbyacyberscanner.Mappedwithphotographs.

Makingof405DC-10planetookamonthtomodelindetailsfortheneedsofclose-upshots.59objects,142,439polygonsreferencemodelingmaterialpainting

Makingof405close-upshots

Step3:trafficclearing

inpaintingcleanplate

Makingof405shotwiththevehiclestandingstillinabackyardStep4:compositing

Makingof405Makingof405Step5:finetouchup

3DhatcompositingandinpaintingMakingof405Step6:musicanddelivery

BloodyOmahaBreakdown(WolfofWallStreet)Topicsweplantocover

CameraCanon10DHighdynamicrangeimaging/displayImagewarping/morphingvideosomeoneveryfamoussomeonenotthatfamousImagewarping/morphingTrackingFeaturetrackingImagestitchingMatchMoveMovematchingusingsceneplanes

MatchmoveMovematchingusingsceneplanes

MatchmoveMovematchingusingsceneplanes

PhototourismVideomatchingMOCO(Motioncontrolcamera)MatrixVideomatchingVideomatchingStopmotionStopmotionMattingandcompositingTitanicMattingObjectselectionLazySnappingImage-basedmodelingphotogrammetricmodelingandprojectivetexture-mappingImage-basedmodelingphotogrammetricmodelingandprojectivetexture-mappingImage-basedmodelingphotogrammetricmodelingandprojectivetexture-mappingImage-basedmodelingTourintoapictureImage-basedmodelingTourintoapicture3Dphotography(active)Cyberwarewholebodyscanner3Dphotography(active)Photometricstereo3Dphotography(passive)StereoleftrightdepthImage-basedrenderingSurfacelightfieldViewinterpolationBullettimevideoViewinterpolationHigh-QualityVideoViewInterpolationImagemanipulationGraphCutTextureImagemanipulationPoissonblendingStereoscopicfilmsMakingfaceSpacetimefaceGollumVirtualhumanVideorewriteTrainablevideorealisticspeechanimation

Inpainting(wireremoval)InpaintingTexturesynthesis/replacementTexturereplacementSemi-automaticmattepaintingImageanalogiesVideoeditingFlow-basedvideoeditingGrading(subjecttochange)3programmingassignments(60%)HDRImaging

(18%)AutoStitch(24%)MatchMove(18%)Classparticipation(5%)Finalproject(35%)ResearchSystemFilmHigh