《机器视觉与机器学习应用》课件-走进机器视觉

机器视觉与机器学习应用ApplicationsofMachineVisionandMachineLearning走进机器视觉Machinevision走进机器视觉Machinevision陈雨ChenYu主讲教师Teacher课程导入CourseIntroduction课程导入CourseIntroduction走进机器视觉Machinevision陈雨ChenYu主讲教师Teacher二维码是如何被瞬间识别的？ThisQRcodeisinstantlyrecognized?课程导入CourseIntroduction走进机器视觉Machinevision它又是如何“看见”目标的？howdoesit'see'thetarget?课程导入CourseIntroduction走进机器视觉MachinevisionMachinevision机器视觉???走进机器视觉Machinevision知识目标Knowledgegoals技能目标Skillgoals素养目标Accomplishmentgoals学习目标Learningobjectives案例导入Caseintroduction案例导入Caseintroduction在汽车制造车间，一台装配机器人正在快速安装零件。Intheautomobilemanufacturingworkshop,anassemblyrobotisquicklyinstallingparts.它通过摄像头捕捉零件位置，精准完成组装，误差不超过0.1毫米。Itcapturesthepositionofpartsthroughacameraandaccuratelycompletestheassemblywithanerrorofnomorethan0.1mm.智能工厂的“火眼金睛”The"sharpeyes"ofsmartfactories收银台前，顾客将商品二维码对准扫描仪，“嘀”一声完成支付。Infrontofthecheckoutcounter,theQRcodeoftheproductispointedatthescannerandthepaymentiscompletedwithasoundof"beep".这是机器视觉的识别应用，通过解码二维码信息实现快速交易。Thisistherecognitionapplicationofmachinevision,whichenablesfasttransactionsbydecodingQRcodeinformation.案例导入Caseintroduction超市扫码的“秒识别”"Quickrecognition"codeinsupermarket相关知识Relevantknowledge相关知识Relevantknowledge机器视觉是利用相机等传感器，配合机器视觉算法赋予智能设备人眼的功能，从而进行物体的识别、定位、测量、检测等功能。Machinevisionusescamerasandothersensors,inconjunctionwithfunctionsofhumaneyesofsmartdevicesgivenbymachinevisionalgorithms,soastoperformobjectrecognition,positioning,measurementanddetection.机器视觉的定义

Definitionofmachinevision相关知识Relevantknowledge机器视觉的特点

Characteristicsofmachinevision特点

Characteristics

安全可靠Safeandreliable客观性Objectivity重复性Repeatability成本较低Lessexpensive效率高Highefficiency精准性Precision20世纪50年代

1950s1965年

196520世纪70年代中期

Mid-1970s1977年

1977机器视觉的发展过程

Developmentprocessofmachinevision国外

Overseas相关知识RelevantknowledgeResearchonstatisticalpatternrecognitionof2Dimages开展二维图像的统计模式识别研究Researchofthree-dimensionalvision开创了三维视觉研究MITartificialintelligencelaboratoryofficiallyopenedthe"MachineVision"course.MIT人工智能实验室正式开设“机器视觉”课程DavidMarrproposedthefamousMarrvisiontheoryDavid·Marr提出了著名的Marr视觉理论1998-2002年

1998-20021990-1998年

1990-1998相关知识Relevantknowledge机器视觉的发展过程

Developmentprocessofmachinevision国内DomesticBegantodevelopgradually开始逐步发展起来Chinaalsobegantodevelopmachinevisionequipment中国也开始了研发机器视觉设备光源、镜头（定焦镜头、变倍镜头、远心镜头、显微镜头）、相机（包括CCD相机和COMS相机）、图像处理软件、系统集成等几个部分。Lightsource,lens(fixedfocuslens,zoomlens,telecentriclens,microscopehead),camera(includingCCDcameraandCOMScamera),imageprocessingsoftware,systemintegrationandotherparts.机器视觉系统组成Compositionofmachinevisionsystem相关知识Relevantknowledge相机Camera镜头Lens光源Lightsource主要目的是使重要特征和非必要特征产生最大的对比度。InThemainpurposeistomaximizethecontrastbetweenimportantfeaturesandunnecessaryfeatures.即将目标的重要特征显现出来，而同时将不需要的特征抑制掉，最终形成对处理过程最佳的图像效果。Thatis,toshowtheimportantfeaturesofthetarget,whilesuppressingunnecessaryfeatures,finallyformingthebestimageeffectfortheprocessingprocess.相关知识Relevantknowledge光源TheLightsource用于聚集光线使目标能够在相机CCD或者COMS上呈现出清晰的图像。UsedtogatherlightsothatthetargetcanpresentaclearimageonthecameraCCDorCOMS.Asanimagingdevice.相关知识Relevantknowledge镜头Lens作为成像器件，通常要与相机、光源配合使用。Itisusuallyusedtogetherwithcameraandlightsource.属于图像采集单元。Itisanimageacquisitionunit.相关知识Relevantknowledge工业相机Industrialcamera它将光学图像转化为模拟/数字图像，再将相应的信号传输给图像处理系统。Itcapturesconvertstheopticalimageintoanalog/digitalimage,andthentransmitsthecorrespondingsignaltotheimageprocessingsystem.根据实际需求所设计的一套处理被测物体图像的算法。InAsetofalgorithmsforprocessingtheimageofthemeasuredobjectdesignedaccordingtotheactualneeds.相关知识Relevantknowledge图像处理系统Imageprocessingsystem这是并输出相关的系统逻辑运动控制信号，属于机器视觉的核心。Andtherelatedsystemlogicmotioncontrolsignalsareoutput;theyarethecoreofmachinevision.相关知识Relevantknowledge机器视觉的应用领域Applicationfieldsofmachinevision机器视觉应用领域

Applicationfieldsofmachinevision自动驾驶

Autonomousdriving工业视觉

Industrialvision智能安防

Intelligentsecurity人机交互

Man-machineinteraction虚拟现实

VirtualReality物体自动识别

Automaticobjectrecognition医学领域

Medicalfield图像自动解释

Automaticimageinterpretation相关知识Relevantknowledge定位应用就是机器视觉系统能够快速准确地找到被测零件并确认其位置，确保元件的正确装配。Thepositioningapplicationisthatthemachinevisionsystemcanquicklyandaccuratelyfindthepartundertestandconfirmitspositiontoensurethecorrectassemblyofthecomponents.定位应用Positioningapplication相关知识Relevantknowledge将元件放入货盘中或从货盘中拾取元件；Placecomponentsintoorpickupcomponentsfrompallets;定位应用Positioningapplication对输送带上的元件进行包装；Packagetheelementsontheconveyorbelt;相关知识Relevantknowledge对元件进行定位和对位，以便将其与其他部件装配在一起；Positionandaligntheelementstofitthemwithothercomponents;定位应用Positioningapplication将元件放置到工作架上；Placetheelementsontotheworkframe;或者将元件从箱子中移走等。Orremovetheelementsfrombox,etc.相关知识Relevantknowledge识别应用Recognitionapplication一维码、二维码的解码Decodingofone-dimensionalandtwo-dimensionalcodes直接部件标识（DPM）Directpartmarking(DPM)光学字符识别（OCR）Opticalcharacterrecognition(OCR)光学字符验证（OCV）Opticalcharacterverification(OCV）相关知识Relevantknowledge识别应用Recognitionapplication获取信息：制造商名称、产品标识、批号、几乎任何成品都使用的唯一序列号。Getinformation:manufacturername,productidentification,lotnumber,uniqueserialnumberusedinanyfinishedproduct.二维码的识别RecognitionofQRcodes相关知识Relevantknowledge测量应用Measurementapplication常见的测量应用

Commonmeasurementapplications尺寸检测Dimensionaldetection容量检测Capacitydetection预设标记的测量Measurementofpresetmarkers相关知识Relevantknowledge测量应用Measurementapplication在测量应用中，机器视觉系统通过计算物品上两个或以上的点或几何位置之间的距离来进行测量，然后确定这些测量结果是否符合规格。Inmeasurementapplications,machinevisionsystemtakesmeasurementsbycalculatingthedistancebetweentwoormorepointsorgeometriclocationsonanitem,andthendeterminewhetherthosemeasurementsmeetspecifications.相关知识Relevantknowledge测量应用Measurementapplication如果不符合，视觉系统将向机器控制器发送一个未通过信号，进而触发生产线上的不合格产品剔除装置，将该物品从生产线上剔除。Ifitdoesnotconform,thevisionsystemwillsendafailsignaltothemachinecontroller,whichinturntriggersthenon-conformingproductrejectiondeviceonthelineandremovestheitemfromtheline.相关知识Relevantknowledge检测应用Detectionapplication颜色和缺陷检测，零件或组件的有无检测，目标位置和方向检测等。Coloranddefectdetection,presenceorabsencedetectionofpartsorcomponents,targetpositionanddirectiondetection,etc.检测Detection相关知识Relevantknowledge检测应用Detectionapplication检测液体制剂的灌装液位Detectthefillinglevelofliquidpreparations应用：在医药行业Application:Inthepharmaceuticalindustry瓶体内杂质及封盖质量Impuritiesinthebottleandcappingquality尺寸不合格的胶囊Capsuleswithunqualifiedsizes相关知识Relevantknowledge检测应用Detectionapplication疫苗瓶口缺陷Vaccinebottlemouthdefects应用：在医药行业Application:Inthepharmaceuticalindustry医药产品的外包装打码效果Codingeffectofouterpackagingofpharm