




版权说明:本文档由用户提供并上传,收益归属内容提供方,若内容存在侵权,请进行举报或认领
文档简介
附录英文原文SeenerecognitionforminerescuerobotocalizationbasedonvisionAbstract:AnewscenerecognitionsystemwaspresentedbasedonfuzzylogicandhiddenMarkovmode1(HMM)thatcanbeapp1iedinminerescuerobotlocalizationduringemergencies.Thesystemusesmonocu1arcameratoacquireomni—directionalimagesofthemineenvironmentwheretherobotlocates.Byadoptingcenter-surrounddifferencemethod,thesalientloca1imageregionsareextractedfromtheimagesasnaturallandmarks.TheselandmarksareorganizedbyusingHMMtorepresentthescenewheretherobotis,andfuzzylogicstrategyisusedtomatchthesceneand1andmark.Bythisway,theloca1izationproblem,whichisthescenerecognitionprob1eminthesystem,canbeconvertedintotheevaluationproblemofHMM.Thecontributionsoftheseski1lsmakethesystemhavetheabilitytodealwithchangesinscale,2Drotationandviewpoint.Theresultsofexperimentsa1soprovethatthesystemhashigherratioofrecognitionandloca1izationinbothstaticanddynamicmineenvironments.Keywords:robotlocation;scenerecognition;salientimage;matchingstrategy;fuzzy1ogic;hiddenMarkovmode11IntroductionSearchandrescueindisasterareainthedomainofrobotisaburgeoningandcha11engingsubject[1].Minerescuerobotwasdevelopedtoenterminesduringemergenciestolocatepossibleescaperoutesforthosetrappedinsideanddeterminewhetheritissafeforhumantoenterornot.Localizationisafundamentalprobleminthisfield.Localizationmethodsbasedoncameracanbemainlyclassifiedintogeometric,topologicalorhybridones[2].Withitsfeasibilityandeffectiveness,scenerecognitionbecomesoneoftheimportanttechnologiesoftopologicallocalization.Current1ymostscenerecognitionmethodsarebasedongloba1imagefeaturesandhavetwodistinctstages:trainingoff1ineandmatchingon1ine.Duringthetrainingstage,robotcollectstheimagesoftheenvironmentwhereitworksandprocessestheimagestoextractg1oba1featuresthatrepresentthescene.Someapproacheswereusedtoanalyzethedata-setofimagedirect1yandsomeprimaryfeatureswerefound,suchasthePCAmethod[3].However,thePCAmethodisnoteffectiveindistinguishingtheclassesoffeatures.Anothertypeofapproachusesappearancefeaturesincludingco1or,textureandedgedensitytorepresenttheimage.Forexample,ZHOUetal[4]usedmultidimensionalhistogramstodescribeg1obalappearancefeatures.Thismethodissimplebutsensitivetosca1eandi1luminationchanges.Infact,allkindsofglobalimagefeaturesaresufferedfromthechangeofenvironment.LOWE[5]presentedaSIFTmethodthatusessimilarityinvariantdescriptorsformedbycharacteristicsealeandorientationatinterestpointstoobtainthefeatures.Thefeaturesareinvarianttoimagescaling,translation,rotationandpartia1lyinvarianttoilluminationchanges.ButSIFTmaygenerate1000ormoreinterestpoints,whichmayslowdowntheprocessordramatically.Duringthematchingstage,nearestneighborstrategy(NN)iswide1yadoptedforitsfaci1ityandintel1igibility[6].Butitcannotcapturethecontributionofindividualfeatureforscenerecognition.Inexperiments,theNNisnotgoodenoughtoexpressthesimi1aritybetweentwopatterns.Furthermore,theselectedfeaturescannotrepresentthescenethoroughlyaccordingtothestate-of-artpatternrecognition,whichmakesrecognitionnotreliab1e[7].Sointhisworkanewrecognitionsystemispresented,whichismorereliableandeffectiveifitisusedinacomplexmineenvironment.Inthissystem,weimprovetheinvariancebyextractingsalientlocalimageregionsas1andmarkstoreplacethewholeimagetodealwithlargechangesinscale,2Drotationandviewpoint.Andthenumberofinterestpointsisreducedeffectively,whichmakestheprocessingeasier.FuzzyrecognitionstrategyisdesignedtorecognizethelandmarksinplaceofNN,whichcanstrengthenthecontributionofindividualfeatureforscenerecognition.Becauseofitspartialinformationresumingability,hiddenMarkovmodelisadoptedtoorganizethose1andmarks,whichcancapturethestructureorrelationshipamongthem.Soscenerecognitioncanbetransformedtotheevaluationprob1emofHMM,whichmakesrecognitionrobust.Salient1ocalimageregionsdetectionResearchesonbio1ogicalvisionsystemindicatethatorganism(likedrosophi1a)oftenpaysattentiontocertainspecialregionsinthescenefortheirbehavioralre1evanceorlocalimagecueswhileobservingsurroundings[8].Theseregionscanbetakenasnaturallandmarkstoeffectivelyrepresentanddistinguishdifferentenvironments.Inspiredbythose,weusecenter-surrounddifferencemethodtodetectsalientregionsinmulti—scaleimagespaces.Theopponenciesofcolorandtexturearecomputedtocreatethesaliencymap.Follow-up,sub-imagecenteredatthesalientpositioninSistakenasthelandmarkregion.Thesizeofthelandmarkregioncanbedecidedadaptivelyaccordingtothechangesofgradientorientationofthelocalimage[11].Mobilerobotnavigationrequiresthatnaturallandmarksshouldbedetectedstablywhenenvironmentschangetosomeextent.Tovalidatetherepeatabilityonlandmarkdetectionofourapproach,wehavedonesomeexperimentsonthecasesofscale,2Drotationandviewpointchangesetc.Fig.1showsthatthedoorisdetectedforitssaliencywhenviewpointchanges.Moredetailedanalysisandresultsaboutscaleandrotationcanbefoundinourpreviousworks[12].ScenerecognitionandlocalizationDifferentfromotherscenerecognitionsystems,oursystemdoesn'tneedtrainingoffline.Inotherwords,ourscenesarenotclassifiedinadvance.Whenrobotwanders,scenescapturedatintervalsoffixedtimeareusedtobuildthevertexofatopologicalmap,whichrepresentstheplacewhererobotlocates.Althoughthemap'sgeometriclayoutisignoredbythe1oca1izationsystem,itisusefulforvisualizationanddebugging[13]andbeneficialtopathplanning.Solocalizationmeanssearchingthebestmatchofcurrentsceneonthemap.InthispaperhiddenMarkovmodelisusedtoorganizetheextractedlandmarksfromcurrentsceneandcreatethevertexoftopologicalmapforitspartialinformationresumingabi1ity.Resembledbypanoramicvisionsystem,robotlooksaroundtogetomni-images.FromFig・1Experimentonviewpointchangeseachimage,salientlocalregionsaredetectedandformedtobeasequence,namedaslandmarksequencewhoseorderisthesameastheimagesequence.ThenahiddenMarkovmode1iscreatedbasedonthelandmarksequenceinvolvingksalientlocalimageregions,whichistakenasthedescriptionoftheplacewheretherobotlocates.InoursystemEVI-D70camerahasaviewfieldof±170°.Consideringtheoverlapeffect,wesample
environmentevery45°toget8images.Letthe8imagesashiddenstateSi(1<i<8),thecreatedHMMcanbeillustratedbyFig.2.TheparametersofHMM,aijandbjk,areachievedbylearning,usingBaulm-WelchaIgorithm[14].Thethresholdofconvergenceissetas0.001.Asfortheedgeoftopologicalmap,weassignitwithdistanceinformationbetweentwovertices.Thedistancescanbecomputedaccordingtoodometryreadings.Fig.2HMFig.2HMMofenvironmentTolocateitselfonthetopo1ogicalmap,robotmustrunits‘eye'onenvironmentandextractalandmarksequenceLI'—Lk',thensearchthemapforthebestmatchedvertex(seene).Differentfromtraditionalprobabilisticlocalization[15],inoursystemlocalizationproblemcanbeconvertedtotheeva1uationproblemofHMM.Thevertexwiththegreatesteva1uationva1ue,whichmustalsobegreaterthanathreshold,istakenasthebestmatchedvertex,whichindicatesthemostpossibleplacewheretherobotis.Matchstrategybasedonfuzzy1ogicOneofthekeyissuesinimagematchproblemistochoosethemosteffectivefeaturesordescriptorstorepresenttheoriginalimage.Duetorobotmovement,thoseextractedlandmarkregionswillchangeatpixelleve1.So,thedescriptorsorfeatureschosenshouldbeinvarianttosomeextentaccordingtothechangesofscale,rotationandviewpointetc.Inthispaper,weuse4featurescommonlyadoptedinthecommunitythatarebrieflydescribedasfollows.GO:Gradientorientation.Ithasbeenprovedthati1luminationandrotationchangesarelikelytohave1essinfluenceonit[5].ASMandENT:Angularsecondmomentandentropy,whicharetwotexturedescriptors.H:Hue,whichisusedtodescribethefundamentalinformationoftheimage.Anotherkeyissueinmatchproblemistochooseagoodmatchstrategyora1gorithm.Usuallynearestneighborstrategy(NN)isusedtomeasurethesimilaritybetweentwopatterns.ButwehavefoundintheexperimentsthatNNcan'tadequatelyexhibittheindividualdescriptororfeature'scontributiontosimilaritymeasurement.AsindicatedinFig.4,theinputimageFig.4(a)comesfromdifferentviewofFig.4(b).ButthedistancebetweenFigs.4(a)and(b)computedbyJeffereydivergenceislargerthanFig.4(c).Toso1vetheproblem,wedesignanewmatchalgorithmbasedonfuzzylogicforexhibitingthesubt1echangesofeachfeatures.Thealgorithmisdescribedasbelow.Andthelandmarkinthedatabasewhosefusedsimilaritydegreeishigherthananyothersistakenasthebestmatch.Thematchresu1tsofFigs.2(b)and(c)aredemonstratedbyFig.3.Asindicated,thismethodcanmeasurethesimilarityeffectivelybetweentwopatterns.Fig.3Similaritycomputedusingfuzzystrategy5ExperimentsandanalysisThe1ocalizationsystemhasbeenimplementedonamobilerobot,whichisbui1tbyourlaboratory.ThevisionsystemiscomposedofaCCDcameraandaframe-grabberIVC-4200.Thereso1utionofimageissettobe400x320andthesamplefrequencyissettobe10frames/s.Thecomputersystemiscomposedof1GHzprocessorand512Mmemory,whichiscarriedbytherobot.Presentlytherobotworksinindoorenvironments.BecauseHMMisadoptedtorepresentandrecognizethescene,oursystemhastheabilitytocapturethediscriminationaboutdistributionofsalientlocalimageregionsanddistinguishsimilarsceneseffectively.Table1showstherecognitionresultofstaticenvironmentsincluding51anewaysandasilo.10scenesareselectedfromeachenvironmentandHMMsarecreatedforeachscene.Then20scenesarecol1ectedwhentherobotenterseachenvironmentsubsequentlytomatchthe60HMMsabove.Inthetable,“truth”meansthatthescenetobelocalizedmateheswiththerightscene(theevaluationvalueofHMMis30%greaterthanthesecondhighevaluation).“Uncertainty”meansTOC\o"1-5"\h\zthattheevaluationvalueofHMMisgreaterthanthesecondhighevaluationunder10%.“Errormatch”meansthatthescenetobelocalizedmatcheswiththewrongscene.Inthetable,theratiooferrormatchis0.Butitispossiblethatthescenetobelocalizedcan'tmatchanyscenesandnewvertexesarecreated.Furthermore,the“ratiooftruth”aboutsi1oislowerbecausesalientcuesarefewerinthiskindofenvironment.Intheperiodofautomaticexploring,simi1arscenescanbecombined.Theprocesscanbesummarizedas:whenloca1izationsucceeds,thecurrentlandmarksequenceisaddedtotheaccompanyingobservationsequenceofthematchedvertexun-repeatedlyaccordingtotheirorientation(includingtheangleoftheimagefromwhichthesalientlocalregionandtheheadingoftherobotcome).TheparametersofHMMarelearnedagain.Comparedwiththeapproachesusingappearancefeaturesofthewho1eimage(Method2,M2),oursystem(M1)useslocalsalientregionstolocalizeandmap,whichmakesithavemoretoleranceofscale,viewpointchangescausedbyrobot'smovementandhigherratioofrecognitionandfeweramountofverticesonthetopologicalmap.So,oursystemhasbetterperformanceindynamicenvironment.ThesecanbeseeninTable2.Laneways1,2,4,5areinoperationwheresomeminersareworking,whichpuzzletherobot.6Conclusions1)Salientloca1imagefeaturesareextractedtoreplacethewhol・・・・・・q・q・*eimagetoparticipatemrecognition,whichimprovetheto1eranceofchangesinscale,2Drotationandviewpointofenvironmentimage.2)Fuzzylogicisusedtorecognizethelocalimage,andemphasizetheindividualfeature'contributiontorecognition,whichimprovesthereliabilityoflandmarks.HMMisusedtocapturethestructureorrelationshipofthoselocalimages,whichconvertsthescenerecognitionproblemintotheevaluationproblemofHMM.Theresultsfromtheaboveexperimentsde/r
温馨提示
- 1. 本站所有资源如无特殊说明,都需要本地电脑安装OFFICE2007和PDF阅读器。图纸软件为CAD,CAXA,PROE,UG,SolidWorks等.压缩文件请下载最新的WinRAR软件解压。
- 2. 本站的文档不包含任何第三方提供的附件图纸等,如果需要附件,请联系上传者。文件的所有权益归上传用户所有。
- 3. 本站RAR压缩包中若带图纸,网页内容里面会有图纸预览,若没有图纸预览就没有图纸。
- 4. 未经权益所有人同意不得将文件中的内容挪作商业或盈利用途。
- 5. 人人文库网仅提供信息存储空间,仅对用户上传内容的表现方式做保护处理,对用户上传分享的文档内容本身不做任何修改或编辑,并不能对任何下载内容负责。
- 6. 下载文件中如有侵权或不适当内容,请与我们联系,我们立即纠正。
- 7. 本站不保证下载资源的准确性、安全性和完整性, 同时也不承担用户因使用这些下载资源对自己和他人造成任何形式的伤害或损失。
最新文档
- 主题婚礼策划与流程
- 车辆维修报账合同协议
- 《金融投资机构介绍》课件
- 《临床诊断胆石症现象》课件
- 法院变卖协议书
- 品牌服务协议书合同
- 转运车辆协议书范本
- 车位协议书模板
- 公共交通行业乘客乘车协议
- 轻伤谅解协议书范本
- 物流园区发展模式-全面剖析
- XX公司事故隐患内部报告奖励制度1
- 附件6工贸高风险企业高危领域较大以上安全风险管控清单
- 国际贸易公司后勤管理岗位职责
- 中国矿业大学专职辅导员招聘真题2024
- 骨科手术切口感染的预防与控制
- 2025年保安证考试答题技巧与试题答案
- 透析营养不良相关知识
- 中级宏观经济学知到课后答案智慧树章节测试答案2025年春浙江大学
- 2025 ACC-AHA急性冠脉综合征患者管理指南解读课件
- 智慧树知到《形势与政策(北京大学)》2025春期末答案
评论
0/150
提交评论