《机器视觉与机器学习应用》课件-字符识别应用

机器视觉与机器学习应用ApplicationsofMachineVisionandMachineLearning字符识别应用ApplicationsofCharacterRecognition字符识别应用ApplicationsofCharacterRecognition陈雨ChenYu主讲教师Teacher课程导入CourseIntroduction字符识别应用ApplicationsofCharacterRecognition陈雨ChenYu主讲教师Teacher课程导入CourseIntroduction字符识别应用ApplicationsofCharacterRecognition陈雨ChenYu主讲教师Teacher课程导入CourseIntroduction字符识别应用ApplicationsofCharacterRecognition原理与实现方法Principlesandimplementationmethods案例导入Caseintroduction案例导入Caseintroduction快递分拣系统

Expresssortingsystem停车场快速识别

Parkinglotquickidentification案例导入Caseintroduction那么，如何让机器像人眼一样，灵活识别任意摆放的字符呢？So,howcanmachinesbemadetoflexiblyrecognizearbitrarilyplacedcharacters,justlikethehumaneye?案例导入Caseintroduction利用视觉套件采集图像，使用字符识别模块完成“Detection”字符的识别。Usethevisionkittocaptureimagesandusethe

characterrecognitionmoduletocompletetherecognitionofthe"Detection"character.检测对象DetectionobjectRequirements:Thecharacterblockcanbeaccuratelyidentifiedregardlessofitsplacement.要求：字符块无论位置如何摆放，都能够准确的识别出来。字符识别CharacterRecognition字符识别CharacterRecognition字符识别是指通过电子设备如相机、扫描仪等获取字符图像，采用光学技术和字符识别方法相结合，将图像中的字符转换成计算机可以识别的文字的过程。Characterrecognitionreferstotheprocessofobtainingcharacterimagesthroughelectronicdevicessuchascamerasandscanners,andconvertingthecharactersintheimageintotextthatcanberecognizedbycomputersbycombiningopticaltechnologyandcharacterrecognitionmethods.字符识别CharacterRecognition字符识别技术

Characterrecognitiontechnology数字信息

DigitalInformation物理世界

PhysicalWorld字符识别CharacterRecognition字符识别的应用

Applicationofcharacter证件识别

Licenserecognition银行卡识别

Bankcardrecognition车牌识别

LicensePlateRecognition名片识别

Businesscardrecognition营业执照识别

Businesslicenseidentification汽车VIN码识别

CarVINcoderecognition票据识别

Billrecognition文档文字识别

Documenttextrecognition字符识别CharacterRecognition字符识别系统

CharacterRecognitionSystem字符识别系统由硬件系统和软件系统组成，其中硬件系统包括工业相机、镜头、光源以及其他结构组成，软件系统包括图像采集、图像处理、图像分割和字符识别等模块。Thecharacterrecognitionsystemconsistsofahardwaresystemandasoftwaresystem.Thehardwaresystemincludesindustrialcameras,lenses,lightsourcesandotherstructures,andthesoftwaresystemincludesmodulessuchasimageacquisition,imageprocessing,imagesegmentationandcharacterrecognition.字符识别系统

Characterrecognitionsystem硬件系统

Hardwaresystem软件系统

Softwaresystem工业相机

Industrialcameras镜头

Lenses光源

Lightsource其他机构

Otherinstitutions字符识别CharacterRecognition字符识别系统

CharacterRecognitionSystem字符识别过程一般分以下几个步骤：Thecharacterrecognitionprocessisgenerallydividedintothefollowingsteps:开始

Start获取图像

Imageacquisition图像预处理

ImagepreprocessingROI分割

ROIsegmentation训练Or识别

TrainingorRecognition训练结束

Endoftraining样本数据

Sampledata训练

Training训练学习过程，分成图像生成，预处理，ROI分割三个步骤。Trainingandlearningprocess:imagegeneration,preprocessing,andROIsegmentation.字符识别CharacterRecognition字符识别系统

CharacterRecognitionSystem开始

Start获取图像

Imageacquisition图像预处理

ImagepreprocessingROI分割

ROIsegmentation训练Or识别

TrainingorRecognition训练结束

Endoftraining样本数据

Sampledata训练

Training识别结束

Endofrecognition比对结果

Comparisonresults识别

Recognition识别过程，识别前3个步骤和训练学习是一致的，而且各个步骤处理的参数必须和训练完全一样，否则获取的单字符图片完全没有可比性，识别步骤是把单字符图片和样本数据一一比较，获得最为接近的作为结果。Therecognitionprocess,thefirstthreestepsofrecognitionareconsistentwithtrainingandlearning,andtheparametersprocessedineachstepmustbeexactlythesameasthoseintraining,otherwisetheobtainedsingle-characterimageswillbecompletelyincomparable.Therecognitionstepistocomparethesingle-characterimagewiththesampledataonebyonetoobtaintheclosestresult.字符识别过程一般分以下几个步骤：Thecharacterrecognitionprocessisgenerallydividedintothefollowingsteps:字符识别CharacterRecognition字符识别流程

CharacterRecognitionProcess图像预处理一般采取的操作有：灰度变换、二值化、滤波去噪等。Theoperationsgenerallytakenforimagepreprocessinginclude:grayscaletransformation,binarization,filteringanddenoising,etc.图像预处理Imagepreprocessing节省图像处理的计算量

Saveimageprocessingcomputation图像亮度不均

Unevenimagebrightness消除图像中的微小噪声干扰

Eliminateminornoiseinterferenceinimages灰度变换

Grayscaletransformation二值化处理

Binarization滤波降噪处理

Filteringanddenoising字符识别CharacterRecognition字符识别流程

CharacterRecognitionProcessROI分割ROIsegmentationImageanalysismainlyinvolvesROIsegmentation.Afterpreprocessing,theimageisobtained,includingcharacterareasandnon-characterareas.图像分析主要是进行ROI分割。经过预处理后得到图像，包括字符区域与非字符区域。由于图像中包含大量无效信息，所以要筛选出要处理的对象，需要将字符区域分离与提取。为了识别出单个字符，需要将每个字符切分出来。Sinceimagescontainalotofinvalidinformation,inordertofilterouttheobjectstobeprocessed,itisnecessarytoseparateandextractthecharacterareas.Inordertorecognizeindividualcharacters,eachcharacterneedstobesegmented.字符识别CharacterRecognition字符识别流程

CharacterRecognitionProcess字符训练Charactertraining依据项目字符文本制作待训练文本数据集，再对训练文本数据集进行字符训练。Createatextdatasettobetrainedbasedontheprojectcharactertext,andthenperformcharactertrainingonthetrainingtextdataset.字符识别CharacterRecognition字符识别流程

CharacterRecognitionProcess字符识别Characterrecognition在对图像进行处理后，然后对字符进行识别操作，可采用模板匹配等识别法。Afterprocessingtheimage,thecharactersarethenrecognized,andrecognitionmethodssuchastemplatematchingcanbeused.字符识别CharacterRecognition字符识别流程

CharacterRecognitionProcess字符识别Characterrecognition特征提取是从单个字符图像上提取统计特征或结构特征的过程。Featureextractionistheprocessofextractingstatisticalorstructuralfeaturesfromasinglecharacterimage.特征匹配是从已有的特征库中找到与待识别文字相似度最高的文字的过程。Featurematchingistheprocessoffindingthecharacterwiththehighestsimilaritytothecharactertoberecognizedfromanexistingfeaturelibrary.Featurematchingisthecoreoftemplatematching.特征匹配是模板匹配的核心。模板匹配识别法TemplateMatchingRecognitionMethod打开DobotVisionStudio1.4.2，选择通用方案。OpenDobotVisionStudio1.4.2andselecttheGeneralOption.任务实施TaskImplementation步骤1Step1在工具箱的“采集”模块选择“相机图像”，拖拽到流程编辑区。Select"CameraImage"inthe"Acquisition"moduleofthetoolboxanddragittotheprocesseditingarea.步骤2Step2相机图像CameraImage双击“相机图像”模块，进行参数设置。Double-clickthe"CameraImage"moduletosettheparameters.任务实施TaskImplementation步骤2Step2相机图像基本参数设置Cameraimagebasicparametersettings相机图像触发参数设置Cameraimagetriggerparametersettings点击“单次执行”，查看结果。Click"SingleExecution"toviewtheresults.任务实施TaskImplementation步骤2Step2相机采集到的图像Imagescapturedbythecamera在工具栏的定位模块，将“快速特征匹配”拖拽到流程编辑区，并与“相机图像”相连。Inthepositioningmoduleofthetoolbar,drag"QuickFeatureMatching"totheprocesseditingareaandconnectitto"CameraImage".任务实施TaskImplementation步骤3Step3方案流程Programprocess任务实施TaskImplementation步骤3Step3创建特征模板。Createafeaturetemplate.特征模板Featuretemplate创建模板Createatemplate完成模板创建Completetemplatecreation将工具栏图像处理模块的“放射变换”拖拽到流程编辑区，并与“1快速特征匹配”相连。Dragthe"AffineTransformation"oftheimageprocessingmoduleinthetoolbartotheprocesseditingareaandconnectitwith"1"QuickFeatureMatching".任务实施TaskImplementation步骤4Step4方案流程Programprocess双击“2仿射变换”进行参数设置。Double-click"2AffineTransformation"tosettheparameters.任务实施TaskImplementation步骤4Step4基本参数设置Basicparametersettings双击“2仿射变换”进行参数设置。Double-click"2AffineTransformation"tosettheparameters.任务实施TaskImplementation步骤4Step4点击“单次执行”，查看结果。Click"SingleExecution"toviewtheresults.仿射变换运行结果Affinetransformationoperationresults将识别模块的“字符识别”模块拖拽到流程编辑区，并与图像修正相连。Dragthe"CharacterRecognition"moduleoftherecognitionmoduletotheprocesseditingarea,andconnectitwithimagecorrection.任务实施TaskImplementation步骤5Step5方案流程Programprocess任务实施TaskImplementation步骤5Step5双击“4字符识别”进行参数设置。Double-click"4CharacterRecognition"tosetparameters.基本参数设置Basicparametersettings任务实施TaskImplementation步骤5Step5运行参数设置：字符识别工具用于读取标签上的字符文本，需要进行字库训练。单击运行参数的“字库训练”，然后按图顺序进行字符训练，即选取字符→提取字符→训练字符→输入对应的字符→添加到字符库的训练进行字符训练，所有的字符训练完成之后，点击“确定”。Thecharacterrecognitiontoolisusedtoreadthecharactertextonthelabelandrequiresfonttraining.Click"FontTraining"intheoperatingparameters,andperformcharactertrainingintheorderofthepictures:selectcharacters→extractcharacters→traincharacters→enterthecorrespondingcharacters→addittothecharacterlibraryforcharactertraining.Afterallcharactertrainingiscompleted,click“OK”.运行参数Operatingparameters任务实施TaskImplementation步骤5Step5运行参数设置：字符识别工具用于读取标签上的字符文本，需要进行字库训练。单击运行参数的“字库训练”，然后按图顺序进行字符训练，即选取字符→提取字符→训练字符→输入对应的字符→添加到字符库的训练进行字符训练，所有的字符训练完成之后，点击“确定”。Thecharacterrecognitiontoolisusedtoreadthecharactertextonthelabelandrequiresfonttraining.Click"FontTraining"intheoperatingparameters,andperformcharactertrainingintheorderofthepictures:selectcharacters→extractcharacters→traincharacters→enterthecorrespondingcharacters→addittothecharacterlibraryforcharactertraining.Afterallcharactertrainingiscompleted,click“OK”.字库训练Fonttraining任务实施TaskImplementation步骤5Step5单击“单次执行”，查看字符识别结果。Click“SingleExecution”toviewthecharacterrecognitionresults.图像显示区域的结果Resultsoftheimagedisplayarea结果显示区域的结果Resultsoftheresultdisplayarea课程小结CourseSummary字符识别应用ApplicationsofCharacterRecognition图像预处理Imagepreprocessing定位