《机器视觉与机器学习应用》课件-字符识别应用

机器视觉与机器学习应用ApplicationsofMachineVisionandMachineLearning字符识别应用Applications

of

Character

Recognition课

程

导

入CourseIntroduction主讲教师

Teacher陈

雨ChenYu字符识别应用Applications

of

Character

Recognition主讲教师

Teacher课

程

导

入陈

雨Chen

YuCourse

Introduction字符识别应用Applications

of

Character

Recognition课

程

导

入Course

introduction字符识别应用ApplicationsofCharacterRecognition原理与实现方法Principlesand

implementationmethods陈

雨Chen

Yu主讲教师

Teacher案例导入Case

inroduction案例导入Case

introduction停车场快速识别Parking

lotquick

identification快递分拣系统Expresssortingsystem*

那么,如何让机器像人眼一样，灵活

识别任意摆放的字

符呢?So,howcan

machines

bemade

to

flexiblyrecognizearbitrarilyplaced

characters,justlike

the

human

eye?案例导入Caseintroduction检测对象Detectionobject要求：字符块无论位置如何摆放，都能够准确的识别出来。Requirements:Thecharacterblockcanbeaccuratelyidentifiedregardlessofitsplacement.*利用视觉套件采集图像，使用字符识别模块完

成“Detection”字

符

的

识

别

。Usethevisionkittocapture

images

and

usethecharacterrecognitionmoduletocomplete

therecognition

ofthe

"Detection"character.案例导入Case

introduction字符识别CharacterRecognition字符识别是指通过电子设备如相机、扫描仪等获取字符图像，采用光学技术和字符

识别方法相结合，将图像中的字符转换成

计算机可以识别的文字的过程。Character

recognition

refers

to

the

process

ofobtaining

character

images

through

electronicdevices

such

as

cameras

and

scanners,andconverting

the

characters

in

the

image

into

textthat

can

be

recognized

by

computers

by

combiningoptical

technology

and

character

recognitionmethods.字符识别Character

Recognition字符识别Character

Recognition物理世界PhysicalWorld数字信息·

Digital

Information字符识别技术Characterrecognition

technology字符识别Character

Recognition字符识别的应用Applicationofcharacter营业执照识别Businesslicenseidentification文档文字识别Documenttext

recognition名片识别Business

card

recognition汽车VIN

码识别CarVINcoderecognition车牌识别License

Plate

Recognition银行卡识别Bank

card

recognition证件识别License

recognition票据识别

Billrecognition字符识别系统由硬件系统和软件系

统组成，其中硬件系统包括工业相

机、镜头、光源以及其他结构组成，

软件系统包括图像采集、图像处理、

图像分割和字符识别等模块。The

character

recognition

system

consists

of

a

hardwaresystemand

a

software

system.

The

hardware

system

includes

industrialcameras,lenses,light

sources

and

otherstructures,and

the

software

system

includes

modulessuchas

imageacquisition,imageprocessing,image

segmentation

and

character

recognition.字符识别CharacterRecognition字符识别系统CharacterRecognitionSystem光源Light

source其他机构

Other

institutions字符识别系统Character

recognitionsystem工业相机Industrial

cameras硬件系统Hardware

system软件系统Software

system镜头Lenses*

字符识别过程一般分以下几个步骤：Thecharacter

recognition

process

is

generally

divided

intothefollowing

steps:开始Start获取图像Imageacquisition训练学习过程，分成图像生成，预处理，

RO

I分割三个步骤。Training

and

learning

process:image

generation,

preprocessing,and

ROI

segmentation.字符识别CharacterRecognition图像预处理

ImagepreprocessingROI

分割ROlsegmentation训练Or

识别Trainingor

Recognition字符识别系统CharacterRecognitionSystem训练结束

End

of

training样本数据

Sampledata训练Training*

字符识别过程一般分以下几个步骤：The

character

recognitionprocessis

generally

dividedintothe

following

steps:开始Start获取图像Imageacquisition训练结束End

of

training样本数据Sampledata训练Training识别过程，识别前3个步骤和训练学习是一

致的，而且各个步骤处理的参数必须和训练完全一样，否则获取的单字符图片完全没有

可比性，识别步骤是把单字符图片和样本数

据一—比较，获得最为接近的作为结果。Therecognitionprocess,thefirst

three

steps

ofrecognitionareconsistentwithtraining

andlearning,and

theparametersprocessedineachstep

must

be

exactly

the

same

as

those

in

training,otherwisethe

obtained

single-character

images

will

becompletelyincomparable.The

recognition

stepis

to

compare

the

single-character

imagewith

the

sample

data

one

by

one

to

obtain

the

closestresult.字符识别CharacterRecognition字符识别系统Character

Recognition

System图像预处理

ImagepreprocessingROI分割ROlsegmentation识别结束End

of

recognition比对结果Comparisonresults训练Or识别Trainingor

Recognition识别Recognition图像预处理Imagepreprocessing*

图像预处理一般采取的操作有：灰度变换、二值化、滤波去噪等。Theoperationsgenerallytakenforimagepreprocessinginclude:grayscale

transformation,binarization,Filteringanddenoising,etc.字符识别CharacterRecognition字符识别流程CharacterRecognition

Process消除图像中的微小噪声干扰

Eliminate

minornoise

interference

in

images节省图像处理的计算量Saveimageprocessing

computation灰度变换Grayscale

transformation图像亮度不均Unevenimage

brightness滤波降噪处理

Filteringanddenoising二值化处理Binarization*

由于图像中包含大量无效信息，所以要筛选出要处理的对象，需要将字符区域分离与提

取。为了识别出单个字符，需要将每个字符切分出来。Since

imagescontainalotofinvalid

information,inorderto

filter

out

the

objects

to

be

processed,it

is

necessarytoseparateandextractthecharacterareas.Inorderto

recognize

individual

characters,each

character

needstobesegmented.图像分析主要是进行ROI

分割。经过预处理后得到图像，

包括字符区域与非字符区域。Imageanalysismainlyinvolves

ROlsegmentation.AFterpreprocessing,theimageisobtained,includingcharacterareas

and字符识别CharacterRecognition字符识别流程Character

Recognition

ProcessROI分割ROIsegmentationnon-characterareas.字符训练Character

training*依据项目字符文本制作待训练文本数据集，再对训练文本数

据集进行字符训练。Createatextdataset

to

be

trained

basedontheproject

charactertext,andthen

perform

charactertrainingonthetrainingtextdataset.字符库生产日期请输入对应的字符字符识别CharacterRecognition字符识别流程CharacterRecognitionProcess训练

字符白底黑字字符高度间隙合并字符宽度距离阈值最小间隙(x,y):(一.一)灰度值：0添加至字符库*在对图像进行处理后，然后对字符进行识别操

作，可采用模板匹配等识别法。After

processing

the

image,the

characters

are

thenrecognized,and

recognition

methods

such

as

templatematching

can

be

used.字符识别CharacterRecognition字符识别流程Character

Recognition

Process字符识别Characterrecognition*特征提取是从单个字符图像上提取练流计特征或结构特征的过程。Feature

extraction

is

the

process

ofextracting

statistical

or

structural

Features

fromasingle

characterimage.*特征匹配是从已有的特征库中找到与待识别文字相似度最高的文字的过程。Featurematching

istheprocess

of

Findingthe

characterwiththe

highest

similarity

to

the

character

to

berecognizedfromanexistingFeature

library.特征匹配是模板匹配的核心。Feature

matching

is

the

core

of

template

matching.字符识别Character

Recognition字符识别Characterrecognition字符识别流程Character

RecognitionProcess模板匹配识别法Template

Matching

Recognition

Method*

在工具箱的“采集”模块选择“相机图像”,拖拽到流程编辑区。Select"Camera

Image"in

the"Acquisition"module

of

thetoolboxand

drag

it

to

theprocess

editing

area.*打开DobotVisionStudio1.4.2,选择通用方案，Open

DobotVisionStudio1.4.2

and

select

the

General

Option.任务实施Task

Implementation本地图像

相机图像

存储图像0相机图像相机图像Camera

Image流程0步骤2Step2步骤1Step1常用参数

触发设置相机连接选择相机

U3V

MV-CE050-30UC(C断线重连时间0图像参数图像宽度图像高度像素格式帧率实际帧率*

双击“相机图

行参数设置。Double-click

the

"Camera

Image"moduleto

set

the

parameters.

mentationple施Im实sk务Ta任相机图像触发参数设置Camera

imagetriggerparametersettings相机图像基本参数设置Camera

imagebasic

parametersettings触发字符串字符触发过滤IO

控制IO选择项IO

模式步骤2Step2常用参数

触发设置触发设置MONO831.00012.156SOFTWARE0.000触发源触发延迟LINEOInput25921944*

点击“单次执行”,

查看结果。Click

"Single

Execution"to

view

the

results.mentationple施相机采集到的图像Imagescapturedbythe

camera步骤2Step

2X1011A009716019001任务实施TaskImplementation步骤3Step

3位模块，将“快速特征匹配”拖拽到流程编辑区，并与“相机In

the

positioning

module

of

the

toolbar,drag"Quick

FeatureMatching"tothe

processeditingareaandconnectitto

"CameraImage".方案流程Programprocess0相机图像1快速特征

.

.1

军

焊

*基本参数

特征模板xλ(S55

11)

:11选择当前图像选择其他图像配置参数粗糙尺度基本参数

结果显示编辑模板执

行完成模板创建Complete

template

creation1快速特征匹配运行参数

结果显示+

创

建

载

入新建模板1Detection编损模板执

行

确

定.步骤3

*

创建特征模板。Step

3

Createa

featuretemplate特征模板

创建模板Feature

template

Create

a

template任务实施Task

Implementation(x,y):(2224,1141)

灰度值：11

mentation步

骤

4Step

4Dragthe"AFFine

Transformation"oftheimageMatching".ple施方案流程Programprocess0相机图像1快速特征….processingmoduleinthetoolbarto

theprocess

editing

area

and

connect

it

with

"1"Quick

Feature2仿射变换D

叫益增基本参数设置Basicparametersettings2仿射变换基本参数

运行参数

结果显示图像输入输入源

0相机图像.图像数据ROI

区域ROI创建继承继承方式

按区域○

按

参

数区域

1快速特征匹配.匹配框[]执行

确定*

双击“2仿射变换”进行参数设置。Double-click"2AFFineTransformation"to

settheparameters.任务实施Task

Implementation步骤4Step

4仿射变换运行结果AFfinetransformationoperationresultsDetection*

双击“2仿射变换”进行参数设置。Double-click"2AFFine

Transformation"to

set

theparameters.*

点击“单次执行”,

查看结果。Click"Single

Execution"to

view

the

results.mentationple施步

骤

4Step

4mentation步骤5Step

5*

将识别模块的“字符识别”模块拖拽到流程编辑区，并与图像修正相连。Dragthe

"CharacterRecognition"moduleof

therecognition

module

to

the

process

editing

area,andconnect

it

with

image

correction.ple施方案流程Program

process0相机图像1快速特征

…2仿射变换3字符识别3

指基本参数设置BasicparametersettingsDetection*

双击“4字符识别”进行参数设Double-click"4CharacterRecognition"

to

set

parameters.任务实施Task

Implementation步骤5Step

5参数设置：字符识别工具用于读取

标签上的字符文本，需要进行字库训练

。

单击运行参数的“字库训练”,然后按图

顺序进行字符训练，即选取字符

→提取

字符→训练字符

→

输入对应的字符

→添

加到字符库的训练进行字符训练，所有

的字符训练完成之后，点击“确定”。Thecharacterrecognitiontoolis

used

to

read

thecharactertextonthelabelandrequiresFonttraining.Click

"FontTraining"intheoperating

parameters,andperform

character

training

in

the

order

of

the

pictures:

select

characters→extract

characters→traincharacters→enterthecorrespondingcharacters→additto

the

character

library

for

character

training.After

allcharactertrainingis

completed,click“OK”.字库训练白底黑字128可变类型1285015

5000050执行

确定任务实施Task

Implementation字库训练字符极性字符宽度范围宽度类型字符高度范围二值化系数片段面积范围合格阈值3字符识别步骤5Step

5基本参数

运行参数运行参数运行参数OperatingparametersrL参数设置：

字符识别工具用于读取标签上的字符文本，需要进行字库训练

。单击运行参数的“字库训练”,然后按图

顺序进行字符训练，即选取字符

→提取

字符→训练字符→输入对应的字符

→添

加到字符库的训练进行字符训练，所有

的字符训练完成之后，点击“确定”。Thecharacterrecognitiontoolis

used

to

read

thecharactertextonthelabelandrequiresFonttraining.Click

"FontTraining"intheoperating

parameters,andperform

character

training

in

the

order

ofthe

pictures:select

characters→extract

characters→traincharacters→enter

the

corresponding

characters→addittothecharacter

libraryforcharactertraining.AFterallcharactertrainingiscompleted,click“OK”.Detection提取字符

训练字符距离阖值间隙合并

最小间隙

mentationple施Im实sk务Ta任步骤5Step

5字库训练Fonttrainingnott图像显示区域的结果Resultsofthe

imagedisplayarea模块状态1字符信息：DetectionDetection序号字符个数字符信息09Detection*

单击“单次执行”,查看字符

识别结果。Click“SingleExecution”toviewthecharacter

recognition

results.任务实施Task

Implementationx0008Y,0175

|R:016G:016B:016历史结果帮助字符个数李字符信息Detection结果显示区域的结果R