机器视觉技术与应用

,数字视频技术-机器视觉技术与应用,数字视频技术,视频与图像信息无处不在,Personalphotoalbums,Surveillanceandsecurity,Movies,news,sports,Medicalandscientificimages,计算机视觉与相关学科,ComputerVision,ImageProcessing,MachineLearning,ArtificialIntelligence,Robotics,PsychologyNeuroscience,ComputerGraphics,Applicationsofcomputervision,Driverassistance(collisionwarning,lanedeparturewarning,rearobjectdetection),Factoryinspection,Monitoringforsafety(Poseidon),Readinglicenseplates,checks,ZIPcodes,Surveillance,Autonomousdriving,robotnavigation,Applicationsofcomputervision,Assistivetechnologies,Entertainment(SonyEyeToy),Moviespecialeffects,Digitalcameras(facedetectionforsettingfocus,exposure),1531561481521491471391461421501461441371251201191361461511641721751831881962002052082142142192171591511501481401381391291191048682899710711511813012813212814416016817918820020821322021221414914615314714714613299737887961051201381511451571631711651611461261571841902012152122142141451501541489691736886148126936772789610711712713113412715416616718319420019514314017515115315114712085677584839492817878918311712614417820020120320817512715918519619520614614413912379667483796964625850465454666080861081411911842001871231441751981991351301158764779079788581635557565370626168595884105168194196183131151185197128116927182941031018310188667090804239538873768211687971441881951901661712031351208483108127135115100927949857459000506952791571411008413618720620418920014410391115139147127918780724461842500050181456914216416711393130193199208203,Worldbehindthepicture,Visionasasourceofsemanticinformation,slidecredit:Fei-Fei,Fergus&Torralba,Objectcategorization,sky,building,flag,wall,banner,bus,cars,bus,face,streetlamp,slidecredit:Fei-Fei,Fergus&Torralba,Sceneandcontextcategorization,outdoorcitytraffic,slidecredit:Fei-Fei,Fergus&Torralba,Qualitativespatialinformation,slanted,rigidmovingobject,horizontal,vertical,slidecredit:Fei-Fei,Fergus&Torralba,rigidmovingobject,non-rigidmovingobject,Challenges:viewpointvariation,Challenges:illumination,Challenges:scale,Challenges:deformation,Challenges:occlusion,Challenges:backgroundclutter,Challenges:objectintra-classvariation,I.Earlyvision,CamerasandsensorsLightandcolor,Featureextraction:cornerandblobdetection,Basicimageformationandprocessing,slidecredit:Fei-Fei,Fergus&Torralba,II.“Mid-levelvision”,Fitting:LeastsquaresHoughtransformRANSAC,Alignment,Fittingandgrouping,III.Multi-viewgeometry,Projectivestructurefrommotion:Herebedragons!,Epipolargeometry,IV.Recognition,Clusteringandvisualvocabularies,Classification,V.AdvancedTopics,Timepermitting,Segmentation,Facedetection,Motionandtracking,ExtractfeaturesLearn“visualvocabulary”QuantizefeaturesusingvisualvocabularyRepresentimagesbyfrequenciesof“visualwords”,解读视觉世界的过程,Normalizepatch,DetectpatchesMikojaczykandSchmid02Mata,Chum,Urban&Pajdla,02Sivic&Zisserman,03,ComputeSIFTdescriptorLowe99,Slidecredit:JosefSivic,Featureextraction,Learningthevisualvocabulary,Clustering,Imagerepresentation,.,frequency,codewords,Edgedetection,Goal:Identifysuddenchanges(discontinuities)inanimageIntuitively,mostsemanticandshapeinformationfromtheimagecanbeencodedintheedgesMorecompactthanpixelsIdeal:artistslinedrawing(butartistisalsousingobject-levelknowledge),Featureextraction:Cornersandblobs,Imagealignment,Application:ViewInterpolation,/comanici/MSPAMI/msPamiResults.html,Meanshiftsegmentation,Anadvancedandversatiletechniqueforclustering-basedsegmentation,D.ComaniciuandP.Meer,MeanShift:ARobustApproachtowardFeatureSpaceAnalysis,PAMI2002.,ThemeanshiftalgorithmseeksamodeorlocalmaximumofdensityofagivendistributionChooseasearchwindow(widthandlocation)ComputethemeanofthedatainthesearchwindowCenterthesearchwindowatthenewmeanlocationRepeatuntilconvergence,Meanshiftalgorithm,Regionofinterest,Centerofmass,MeanShiftvector,Meanshift,SlidebyY.Ukrainitz&B.Sarel,Regionofinterest,Centerofmass,MeanShiftvector,Meanshift,SlidebyY.Ukrainitz&B.Sarel,Regionofinterest,Centerofmass,MeanShiftvector,Meanshift,SlidebyY.Ukrainitz&B.Sarel,Regionofinterest,Centerofmass,MeanShiftvector,Meanshift,SlidebyY.Ukrainitz&B.Sarel,Regionofinterest,Centerofmass,MeanShiftvector,Meanshift,SlidebyY.Ukrainitz&B.Sarel,Regionofinterest,Centerofmass,MeanShiftvector,Meanshift,SlidebyY.Ukrainitz&B.Sarel,/comanici/MSPAMI/msPamiResults.html,Meanshiftsegmentationresults,混合高斯背景重建算法,Applicationsofsegmentationtovideo,BackgroundsubtractionAstaticcameraisobservingasceneGoal:separatethestaticbackgroundfromthemovingforeground,Usesofmotion,Estimating3DstructureSegmentingobjectsbasedonmotioncuesLearningdynamicalmodelsRecognizingeventsandactivitiesImprovingvideoquality(motionstabilization),Motionfield,Themotionfieldistheprojectionofthe3Dscenemotionintotheimage,Opticalflow,Definition:opticalflowistheapparentmotionofbrightnesspatternsintheimageIdeally,opticalflowwouldbethesameasthemotionfieldHavetobecareful:apparentmotioncanbecausedbylightingchangeswithoutanyactualmotionThinkofauniformrotatingsphereunderfixe