《机器视觉与机器学习应用》课件-字符缺陷检测应用

机器视觉与机器学习应用ApplicationsofMachineVisionandMachineLearning漏印Missing

prints模糊

Blurring污点

Stains字符缺陷检测Character

Defect

Detection课

程

导

入Course

Introduction主讲教师

Teacher陈

雨Chen

Yu课

程

导

入CourseIntroduction如何高效准确地检测这些缺陷呢?Howto

detectthese

defects字符缺陷检测Character

Defect

DetectionefFicientlyandaccurately?字符缺陷检测CharacterDefect

Detection课程导入

CourseIntroduction字符缺陷检测Characterdefectdetection*技术原理Technicalprinciples*实际操作Practicaloperations案例导入Case

introduction生产日期Production

date*批次号Batch

number案例导入Case

introduction*

模糊或漏印Blurred

or

missing

prints*无法识别产品信息

引发质量问题Unable

to

identifyproduct

informationCause

quality

issues发现并剔除有问题的产品Detect

and

eliminate

problematic

products*

确保出厂产品的质量Ensure

the

quality

of

products

leaving

the

factory使用视觉套件完成字符缺陷检测的全过程Completetheentireprocessofcharacterdefectdetectionusingthevision

kit任务描述Task

Description无缺陷的字符Characterswithoutdefects带有缺陷的字符Characterswithdefects字符缺陷检测CharacterdefectdetectionDetection字符缺陷检测CharacterDefectDetection*将目标图像与标准图像进行验证对比，检测印刷字符，图案是否存在缺失、

冗余等非一致性外观缺陷。To

verify

and

compare

the

target

image

with

the

standard

image

to

detect

whether

the

printedcharactersand

patterns

have

inconsistentappearancedefects

such

as

missing

or

redundant

ones.字箍缺陷检

Detection*

工业生产中，字符有机器印刷，由于产品漏放，偏放或机器误操

作，都会导致产品字符缺陷。In

industrial

production,characters

areprinted

by

machines.Omission,misplacement

or

machine

misoperation

of

the

product

may

cause

character

defects

on

the

product.产品的字符检测尤为重要Product

character

detection

is

particularlyimportant.字体缺失Missing

font字体缺失Missing

font字体缺失Missing

Font字符缺陷类型CharacterDefect

Types字符缺陷示例Characterdefect

examplesHW1HO385GEMINIP.N:1AOQ58[OO5]200046659271H0385污点

Stain污点

Stain污点Stain字符缺陷：字符模糊、漏印、污点、

位置偏移Character

defects:blurred

characters,missingcharacters,stains,andpositionshifts.字符缺陷类型Character

Defect

Types1HO385污点

StainHW1HO385GEMINIP.N:1AOQ58[OO5]20004665927字符缺陷示例Characterdefect

examples1H0385字体缺失Missing

font字体缺失Missing

font字体缺失Missing

Font污点

Stain污点Stain开始Start获取图像Imageacquisition缺陷检测结束Defectdetectioncompleted比对样本Samplescomparison训练Or检测Training

or

Detection字符缺陷检测分为两个过程：Character

defect

detection

is

divided

into

two

processes:字符训练字符缺陷检测Charactertraining

Character

defect

detection字符训练：主要是完成标准字符

的训练Character

training:mainly

to

complete

the

training

of

standard

characters字符缺陷检测：就是与标准字符

进行对比，分析出字符的缺陷Characterdefectdetection:comparewith

standard

characters

to

analyze

characterdefects字符缺陷检测流程Characterdefectdetectionprocess字箍缺降检测过程ctionProcess图像预处理ImagepreprocessingROI分割ROIsegmentation缺陷检测Defectdetection训练结束End

of

training样本数据

Sampledata训练

Training*

字符模板参数Charactertemplateparameters*

训练模板参数Trainingtemplateparameters*

统计训练参数Statisticaltrainingparameters*

运行参数OperatingparametersDobotVisionStudio字符缺陷检测介绍Do

botVisionStudio

Character

Defect

Detection

Introduction字符模板——字符模板参数Charactertemplates-charactertemplateparameters字符分割阈值：字符分割的临界值，太小了容易提取到多余的特征图形，太大了容易丢失目标图形，建议一般设置成128左右。Character

segmentation

threshold:The

critical

value

for

character

segmentation.If

itis

too

small,it

is

easy

to

extract

redundant

feature

graphics,and

if

it

is

too

large,it

is

easy

to

lose

the

target

graphics.It

is

generally

recommended

to

set

it

to

around

128.*

显示二值图：开启以后会进行图像二值化，背景图像和字符灰度差更明显。Display

binary

image:After

turning

it

on,the

image

will

be

binarized,and

the

grayscaledifFerence

between

the

background

image

and

the

characters

will

be

more

obvious.*

字符极性：有黑底白字，白底黑字两种。Character

polarity:There

are

two

types:white

characters

on

a

black

background

and

blackcharacters

on

a

white

background.*

字符高度/宽度范围：可以设置目标字符的高度和宽度值范围。Character

height/width

range:You

can

set

the

height

and

width

value

range

of

the

targetcharacters.*

高度/宽度增加值：目标字符区域高度和宽度的单次增加值。Height/width

increase

value:The

single

increase

value

of

the

height

and

width

of

thetarget

character

area.DobotVisionStudio字符缺陷检测介绍DobotVisionStudioCharacterDefect

DetectionIntroduction分割提取字符分割

字符提取

字符分割阈值|128显示二值图字符极性

白底黑字字符宽度范围

512字符高度范围10

512字符模板——字符模板参数Charactertemplates-charactertemplateparameters字符分割Charactersegmentation缩放模式：可选取手动和自动两种模式，推荐使用自动模式Scalingmode:Manualandautomaticmodesare

available,automatic

mode

isrecommended

精细颗粒度：精细颗粒度参数，表示提取特征颗粒的精细程度，当精细尺度取值为1时精

细程度最大，取边缘点数量最多，精度最高。Finegranularity:Thefinegranularityparameterindicatesthedegree

of

Fineness

oftheextractedfeatureparticles.Whenthefinescalevalueis1,thedegree

offineness

isthe

largest,thenumberofedgepointsisthe

largest,andthe

accuracy

is

the

highest.粗糙颗粒度：粗糙颗粒度参数，数值越大抽取边缘点就越稀疏，但会加快匹配速度，默认

范围是1~20。Coarsegranularity:Coarsegranularityparameter.Thelargerthevalue,thesparserthe

edge

pointswillbe,butitwillspeedupthe

matching

process.The

default

range

is

1~20.阈值模式：可选自动以及手动两种模式Thresholdmode:Automaticandmanualmodes

are

available自动，根据目标字符自动决定阈值参数，自动适应。Automatic:Automaticallydeterminesthethresholdparametersbasedonthetarget

character

andautomaticallyadapts.手动，以用户设定的阈值作为查找的阈值参数。Manual:Usingtheuser-definedthresholdasthesearchthresholdparameter.模型低阈值：阈值模式选取手动时生效，查找的最低阈值参数。Modellowthreshold:EFfectivewhenmanualthresholdmode

isselected,the

lowest

thresholdparametertobesearched.DobotVisionStudio字符缺陷检测介绍DobotVisionStudio

Character

Defect

Detection

Introduction字符模板——字符模板参数Charactertemplates-charactertemplateparameters训练模板自

动1.0003.000自

动训练参数Trainingparameters训练参数缩放模式精细颗粒度粗糙颗粒度阈值模式模型低阈值****均值标准差法：通过多张图片得到均值图像与标准差图像，

再与高低比例偏移系数计算得到正常高低阈值图像，检测

输入图像通过与高低阈值图像进行像素灰度比对来判断图

像中是否存在缺陷。Meanstandarddeviation

method:The

mean

imageandstandarddeviationimageareobtainedfrom

multiple

images,andthenthe

highandlow

proportionaloffsetcoefficientsarecalculatedtoobtainnormal

high

and

low

thresholdimages.The

input

image

isdetected

bycomparingthe

pixelgrayscalewiththehighandlowthreshold

imagestodeterminewhetherthereare

defects

intheimage.相关法：通过计算均值图像与输入检测图像的灰度相关性

来进行缺陷判断。Correlation

method:Defectjudgment

is

performedbycalculatingthegrayscale

correlation

betweenthe

mean

imageandthe

inputdetection

image.DobotVisionStudio字符缺陷检测介绍DobotVisionStudioCharacterDefectDetection

Introduction字符模板——统计训练参数Charactertemplates-statisticaltrainingparameters字符统计Characterstatistics*

归一化类型：有不处理、直方图均衡化、直方图归一

化、均值标准差归一化4种归一化模式。Normalizationmodes:Noprocessing,histogramequalization,

histogram

normalization,and

mean

standard

deviationnormalization.相关分数阈值：低于评分阈值的目标认定为含缺陷。

Correlation

score

threshold:Targets

below

the

score

threshold

are

considered

to

contain

defects.*

宽度/高度方向分块：对字符进行分块相关评分，都设

为1为不分块。Width/height

direction

blocking:The

characters

are

scored

forblocking,and

all

are

set

to

1for

no

blocking.3字符缺陷检测基本参数字符模板

运行参数结果显示归一化处理归一化类型

均值标准差归一化字符检测相关分数阈值高度方向区块宽度方向区块3.50050.000执行

确定DobotVisionStudio字符缺陷检测介绍DobotVisionStudio

Character

Defect

Detection

Introduction运行参数Operatingparameters运行参数Qperating

parameters高阈值比例高阈值容忍任务实施Task

Implementation流程0本地图像相机图像存储图像0相机图像相机图像Camera

image步骤1Step1打开DobotVisionStudio1.4.2,选择通用方案。

Open

DobotVisionStudio1.4.2and

select

the

GeneralOption.*在工具箱的“采集”模块选择“相机图像”,拖拽到流程编辑区。Select"Camera

Image"in

the

"Acquisition"module

ofthe

toolbox

and

drag

it

to

the

process

editing

area.任务实施Task

Implementation步

骤

2SER²Detection相机采集到的图形Graphics

captured

by

the

camera双击“相机图像”模块，进行参数设置。R8ukle-clickthe"Camera

Image"moduletosetthe

parameters,任务实施Task

Implementation0

相

机

图

像触发设置相机连接选择相机

U3VMV-CE050-30UC(C图像参数图像宽度图像高度像素格式帧率实际帧率25921944MONO831.00012.156触发设置SOFTWARE触发延迟0.000触发字符串字符触发过滤相机图像基本参数设置Camera

imagebasicparametersettings相机图像触发参数设置Camera

imagetriggerparametersettingsIO控制IO选择项IO

模

式LINEOInput*在工具箱的定位模块，将“快速特征匹配”拖拽

到流程编辑区，并与“O相机图像”相连。In

the

positioning

module

of

the

toolbox,drag

"QuickFeatureMatching"totheprocesseditingarea,and

connect

itwith

"O

Camera

Image".1快速特征..方案流程

Program

process任务实施Task

Implementation步骤3Step3任务实施TaskImplementation*

双击“1快速特征匹配”进行参数设置。

Double-click

"1Fast

Feature

Matching"to

setparameters.创建特征模板Creatingafeaturetemplate特征模板Featuretemplate运行参数结果显示Detectlon编辑模板执行确定1快速特征匹配基本参数

特征模板+

创

建新建模板1任务实施Task

Implementation0相机图像1快速特征

….*

将“字符缺陷检测”拖拽到流程编辑区，与“1快

速特征匹配”连接。Drag"CharacterDefect

Detection"tothe

process

editingarea,andconnectitwith

"1

Fast

Feature

Matching".3字符缺陷…方案流程界面Solutionprocess

interface步骤

4Step4任务实施Double

click

"Character

Defect

Detection",andTask

Implementation*双击“字符缺陷检测”,进行参数设置。-

perform

parameter

settings.运行参数

结果显示0相机图像.图像数据继承按参数1快速特征匹配.匹配框口执行

确定基本参数界面parameter

interface输入源ROI

区域RO

创

建继承方式区域Basic任务实施Task

Implementation过程1:标准字符的训练Process1:Standard

character

training字符模板Charactertemplate空白字符模板Blankcharactertemplate*

创建字符模板。Create

character

templates.Detection2字特缺陷检测执行字符模板基本参数*

创建字符模板。Createcharactertemplates.均值标准差法任务实施Task

Implementation过程1:标准字符的训练Process

1:Standardcharactertraining字符模板Charactertemplate字符模板结果CharactertemplateresultsDetection

统计训练结果2字符缺陷检测字符模板执行

确定字符模板*将字符块换成带有缺陷的字符块。点击“执行”,图像区会显示检测结果。

Replace

the

character

blockwith

a

character

blockwith

defects.Click

"Execute",theimage

area

will

display

the

detection

results任务实施Task

Implementation过程2:字符缺陷检测Process2:Cha