中对照产品介绍浓缩和目标检索系统

CondensationandObjectRetrievalSystem SynopsisApplicationSystem)(浓缩应用系统介Withtherapiddevelopmentofdigital-mediatechniquesandwideutilizationofadvancedinformationprocessingtools,theproblemhowdoefficientlyprocessthehugeinformationobtainedisveryimportant.随着数字技术的快速发展和高级信息处理工具的广泛利用，怎样高效地处Inparticular,withgreatincreaseofcameras,thehugedatasetscapturedbydigitalcamerasandsaregrowingatanexplosivespeed.特别是随着机的大量增加，由数字机和机取得的大量视Toreviewmanuallylengthysforfindinginterestingobjects,itisverynon-efficientlyandtimeconsuming,alsodonotguaranteeaboutcorrectnessofretrieval.如果以手工方式冗长的以便找出感的目标，效率很低而且是很耗Asasolutionfortheseproblems,newadvancedresearchbrunchescalledassynopsisorcondensationaredeveloinrecentyears.Itproducecondensedrepresentationoflongsequences,makedatabaseofmovingobjects,sinceaccuracyandefficiencyofretrievalsgreatlyincreased.来，它被称为梗概或者浓缩。它能产生对于长的序列的浓缩表示，作出移动目标的数据库，因而检索的精度和效率大大地增加了。Wedevelopedcondensationandmovingobjectretrievalsystem我们开发了浓缩和移动目标检索系统(VCMOS)Thissystemisdevelopedbyadvancedtechnologysuchascomputervision,imageprocessing,visualobjectrecognitionandmachinelearningalgorithms.Thissystemisthepowerfulsecuritysupportsystem,inwhichmovingobjectsextractedfromrecordedsequencesasspace-timevolumeandextremelycondensedproducedfromextractedobjects,typesandfeaturesofmovingobjectsrecognized,allinformationsavedintodatabase,fromthatitmaysearchunknownobjects.这一系统是一个有力的安全支持系统，其中的移动目标是从记录成卷的序列中提取的，并且来自所提取目标产生的浓缩，可精确识别移动目标的类型和Thissystemhasadvantagesthattheaccuracyandtheefficiencyofretrievalsgreatlyincreasedandthestoragecapacityofinformationreducedatfullwidth.这一系统的优势是大幅提高了检索的精度和效率，而且信息的容Ifthissystemusedinsecurityorganizations,itwillhelptodoretrievalforinquiryandinvestigationofoffencesatshorttime,andwillguaranteeaccuracyofretrievalresults.Anduserswillobtainmucheconomyinlabor,equipmentandtime.对于进行查询和，而且将会保证检索结果的精度。用户将会节约人力、Ifyouwantrapidlyinvestigateallfactsthatwereoccurringinyourhome,usethissystem.Soyoumayfindalleventsnomorethanseveraltenminutes,如果您想要快速的了解在您的家中或者公司里发生的所有，那么您可以使用这一系统。这样您就能够神奇的在几十分钟以内找出所有的。Specialcharactersof2.VCMOS的特OurVCMOShasfollowingspecialVCMOSSupportoftwocondensationNon-chronologicalmodechronologicalmodeiscondensationmethodthatceobjectorbitstocondensationspaceasdenseaspossiblewithoutconsideringobject’sappearancetime,whencondensedis composedof movingobjects.Ifthewascondensedbythismode,thecondensationratewillbeveryincreased,butwillbenotguaranteedtheappearanceorderofobjects.支持两种浓缩方被浓缩的是由移动目标组成时，不考虑目标的出现时间。如果被以ChronologicalChronologicalmodeiscondensationmethodthatceobjectorbitstocondensationspaceasdenseaspossiblewithconsideringobject’sappearancetime,whencondensediscomposedofmovingobjects.Ifthewascondensedusingthismode,thecondensationratewillberelativelydecreased,butwillbeguaranteedappearanceorderofobjects.浓缩的是由移动目标组成时，考虑目标的出现时间。如果被以这种Highcondensation高浓缩Table1.CondensationratefortwocondensationCondensationGeneral1:1:Verycomplicated1:0.1~1:一般1:1:很复杂的1一般1:1:很复杂的1:0.1~1:Inthecaseofnon-chronologicalmode,thewithlengthabout10hoursshouldbereducedabout5~10minutesaftercondensation.Ifmovingobjectsisless,thewithlengthabout10hoursshouldbedecreasedlesstimelengththanone对于非流水方式而言，长度约为10小时的在浓缩后会被减少到5~10分钟。如果移动目标更少，那么长度约为10小时的会被减少到一分钟以Inthecaseofthatappearanceofobjectsisverymuchandcomplex,weconfirmedthatthetimelengthisdecreaseduntil1/3lengthoforiginallengthatleastinnon-chronologicalmode.1/3。Thesevaluesareinworld’sVCMOS在浓缩效率,可靠性等方面处于行业领先水平GoodqualityofcondensedThissystemextractrobustlyobjectsandexportcondensedswithgoodqualityunderconditionswithnoise,shadow,slowlyvariationofilluminationand offofswitch.Andweappliednewseveralalgorithmsfortrackingstoodobjects,compositionofbackgroundimageandnewmethodsnecessary forthecondensationwithgoodqualities.浓缩的优良质一系统可有效的提取目标并且输出质量优良的浓缩。我们应用了几种新的算法静止目标、背景截图的组成和新的技术。CorrectnessofobjetclassificationandretrievalCorrectnessofobjectThissystemisabletoclassifyobjectssuchas ,vehicle,bicycleandother.Alsothesystemisabletoclassifyobjectsbyitscolorcharacterandmovingcharacters(includinguniformvelocitymotion,accelerationvelocitymotionandmovingdirectionsetc).这一系统能够将目标分类为人、车辆、自行车和其它。系统也能按照目标的颜色特点和运动特性进行分类（等）。 orrectnessofobjectclassificationismorethan98%underenvironmentsinthatobjectsnoeachotherornosplitintopieces,andismorethan90%underarbitraryenvironments.如果环境中的目标互相不而且不分成碎片，那么目标分类的正确度98%90%。CorrectnessofspecialobjectCorrectnessofsearchingspecialobjectisdifferentialbynumberofcandidatepossibilityselectedamong32candidatesis100%.Possibilityselectedasfirstcandidateis90%andpossibilityselecteduptothirdcandidateis95%.含4575个目标的数据库进行检索时，目标出现在32个候选者内的概率为100%90%95%。Usingsearchfunction,youmayfindinterestingobjectsduringseveralsecondsorseveraltensecondswithoutsurveyinghugeamountofs.您可以用搜索功能在几秒或者几十秒内找出感的目标，而不需阅读大量的。SpeedofSpeedofcondensationisanimportantfactorforpracticalapplicationofthesystem.Speedofcondensationisdifferentfromtheresolutionandthecomplexityofhowmanyobjectexistwithinthe.浓缩的速度对于系统的实际应用是一个重要的因素。浓缩的速度取决于目标的分辨率与复杂度。Forspeedupcondensation,weoptimizedallalgorithmsofoursystemandappliedparalleloperatingprocessusingCUDA,thatareprogramminglanguageforparalleloperatingprocessusingGPU(progrblegraphicunit)inNVIDIAgraphicdevice.为了加速浓缩，我们优化了该系统的所有算法，并使用了CUDA并联运转，它是NVIDIA图形装置中以GPU（可编程图形单元）对于并联运转Table.2.condensationtimefordifferentialtime352x1280x1920x14~7表2对于不同分辨率的浓缩时 的时352x1280x1920x14~7分8~1515~25Valuesoftable.2evaluatedforwithgeneralcomplexity.Condensationtimeislongeraccordingtohighresolutionof,butthewithtimelengthofabouttenhoursmaycondensedduringlesstimethantwohoursforplex表2中的数值是对于复杂性中等的进行的评估。如果分辨率较高，那么浓缩时间也会相应增加，但是对于时长约为十小时并不复杂的，可Multichannel多信道浓Thissystemsupportmultichannel这一系统支持多信道浓缩Howmanytasksmayrunatsametime,itrelatetoperformanceofcomputer.InCPU:InCorei53.20GHz,RAM:16GB,GPU:NVIDIAGTX650Ti,64bitperatingsystem,thissystemcancondensatemorethaneightchannelsatsametimeforofsize352*288,fourchannelsforhighresolutionofsize1280*720andtwochannelsforhigherresolutionofsize1920*1080withoutspeeddown.可以同时运行的任务数目与计算机的性能有关。CPUIn内核i53.20GHz,RAM16GB,GPUNVIDIAGTX650Ti,64为352*288的，这一系统能够同时浓缩多于八个信道，对于尺寸为1280*720的高分辨率，它可以同时浓缩四个信道，而对于尺寸为1920*1080的更高分辨率，它可以同时浓缩两个信道而且速度不降PerformanceoffacedetectionandrecognitionThissystemsupportfacedetectionandrecognitionwithobjectclassificationandPerformanceofface人脸检测的FollowingtableshowstheperformanceofourfacedetectionRangeofExampleofOurfacedetectionenginemaydetectfacesexpertlyfromimagewithrelativelylowresolution.Performanceofface人脸识别的Performanceoffacerecognitionrelateswithenrolledsamplefaces.Ifuserenrolledsamplefacesat10degreeintervalsaboutvariousfaceposthenrecognitionrateofthisenginehasmorevaluesthan98%.人脸识别的性能与的样品人脸有关。如果用户以10度间隔对于各种人脸位置了样品人脸，那么这一引擎的识别率高于98%。Inoursystem,possibilityselectedamong32candidatesisabout100%.Butinthecaseofthatdifferentimagesaboutsame haslargevarianceinresolution,ithaslowrecognitionrate.在我们的系统中，检索目标出现在32个候选者中的概率约为100%。但是3.Functions condensationandobjectretrievalThissystemdividedintoserverand.Intheserver,activeobjectsextractedfromrecordedorreal-time,andtracked,condensed(orsynopsis)producedusingobtainedactiveobjects.Alsotheappearancetimeandcharactersofactiveobjectsevaluatedandinputtodatabase.在服务端中从所记录的或者实时中提取了活跃的目标，而且对其进，用所获得的活跃目标取得了浓缩(或者梗概)。也会对于出现时间和Usingresultsobtainedbyserver,theprovideusefulfunctionsforinquiryofcondensedandclassificationofobjects,retrievalforspecialobject.客户端用服务端所获得的结果为浓缩的查询和目标的分类提供检索特征 1)(1)SettingFirst,youmustsetdatabase.(Fig.1)InputdatabaseserverIPaddress,portnu “Connect”button.Thenthesystemconnectedtodatabase,ifsuccessful,openedinterfaceofserversuchasFig.2.首先您必须设定数据库(图1)。输入数据库服务器的IP地址、端码、用户ID和，然后点击“连接”按钮。之后系统被连接至数据库，并且2所示。Fig.1.Database1Fig.2showstheserver’s2Fig.2.Interfaceof2Explorerandlist浏览器和窗Twowindowscedintheleftsideofthescreenindefaultsetting.Thesetwowindowsusedtoselectswanttocondense.在屏幕的左侧有两个窗口为缺省设置。这两个窗口用于选择浓 Inexplorerorlistwindow,ifyoudoubleclicklistitemordraganddropvideoimageitem,selected yedinviewwindow. 在浏览器或者窗口中，如果您双击项目或者拖曳截图项目，将在窗口中所选择的。viewwindowThiswindowcedattopsideofscreencenter,itissimilarwith yer.Thiswindowusedtopreview,disythesizeofneglectedobjectsandsettheinterestingregionine.Alsoitusedtoobserveframeimagethatiscondensed这一窗口处于屏幕中心的顶部，它看起来类似于器。这一窗口用于进 Inthepicture,redregionistheinterestingregionandbluerectangleshowsthesizeofneglectedobjects.Thesizeofneglectedobjectsmaychangeinparametersettingwindow.中的红域为感的区域，而蓝色的四角形区域显示了被忽略的目标之尺Intaskmanagementwindow,ifyouclick“FrameViewStart”button,youcanviewframeimagesthatiscondensednow.在任务管理窗口中，如果您点击“开始帧”按钮，那么您能够当前被浓缩（1）ParametersettingwindowforThiswindowcedatleftsideofscreenindefaultsetting.Inthiswindow,condensationtaskwillsetbyvariouskindsofparametersindetail.（1）用于浓缩的参数设置窗这一窗口位于缺省设置的屏幕之左侧。在这一窗口中，将以各种类型的参数详细设置浓缩任务。 resolutionand Inputresolutionisthewidthandheightofselectedforcondensation,andoutputresolutionsetupthewidthandheightofcondensed.输入分辨率和输出分辨输入分辨率为用于浓缩而选择的的宽度和高度，而输出分辨率则建立了浓缩的宽度和高度。starttimestarttimeisstartingtimeof.开始时开始时间为的启动时间NeglectobjectThisparameterusedthesize(widthandheight)ofsuchsmallobjectastodonot忽略区域尺忽略区域一般尺寸较小。SettingofcondensationItthesettingofcondensationmode,itincludedtoselectofchronologicalmode/non-chronologicalmode,disy/nodisyappearancetimeofobjectsandcondensationdegree,facerecognitionandLP(licensete)recognition.浓缩方式的设Ifyouselectedthefacerecognitionforfromthatitisabletodetectandrecognizeface,applicationdetectfacesfromobjectsfromtheandstorageit'scharactersintodatabase.Usermaysearchinterestingfaceusingapplication.如果您在设置中启用人脸识别，那么就能够检测和识别人脸，对于来自目标中的人脸采用人脸识别检测，而且将其特点到数据库中。用户可以用客户端应用搜索Licenseterecognitioncan'trunincurrentversionbecauseeverycountryhasdifferenttypeoflicensete.LoadandsaveUsingthesefunctions,youmaysavecondensationparameterstodatabase,andmayuseagainthatsettingparameters.Generallycamerasstandinfixedpositions.Therefore,settingparametersforthecamerasinsameceisalmostinsamevalues.Inthiscase,withoutyoudonotsetparameterseverytime,youcanusetheparametersloadedfromdatabase.载入和参您可以用这些功能将浓缩参数至数据库，而且可以再次使用那些设置参数。摄像机一般处于固定位置。因而，对于处在相同地点的机的设置参数几乎是相同的数值。AddIfyouclickbutton“Addtask”,currentselectedaddedtotasklistwithcondensationp添加任如果您点击按钮“添加任务”，那么当前所选择的则随着浓缩参数被添加至任 TaskmanagementAddedtasksdisyedattasklistintaskmanagementwindow.Youcanchangerunorderfortasksofreadystateusingbuttonand.Butyoucan’tchangeorderfortaskofrunningstateorcompletedstate.Usingthreebuttons,youcanstartindividualtask,pauseitandstopit.Alsousingbutton,youcandeletetaskintasklist.（5）任务管理窗所添加的任务被显示于任务管理窗口的任务之中。您可以用和按钮改变处 Ifyouselectedcontinuousruncheckbutton,adeedtaskswillrunatomaticallyinIfyouclickedbutton“FrameViewStart”,theframeimagethatiscondensingfromdisyedinviewwindow.如果您点击了“开始帧”按钮，那么从被浓缩了的帧截图则被显示在观DeletingthepastcondensedDatathatstorageindatabaseandcondensedfilesthatstorageinmemoryincreasedcumulativelywithexecutingcondensationtasks.Itneedtodeletedataforthatcompletedobservationanddidnotneedtostorage.Thiscancarryoutusing“Deletingthepastcondenseddata”dialogwindowthatopenedfromiteminthe （6）过去的浓缩于数据库中的数据和于器中的浓缩文件会随着执行浓缩任务而累进。对于这些已经审阅过的，可以在菜单栏中的项目中打开“删除过去的浓缩数据”2)Viewingofcondensedresultsandobject客户(1)浓缩结果和目标分①LoadingcondensedresultsfromdataIfyouselect“LoadsynopsisresultsfromDB”inthefile orclickbuttoninthetoolbar,youcanopenfollowingdialogwindow. 从数据库载入浓缩如果您在文件菜单中选择“从数据库载入浓缩结果”或者点击中的按钮，您 Settingthecondensedtime,clickbutton“OK”,alldatathatcondensedbeforethattimeloadedfromDB.Loadeddatadisyedinthelist.通过设置浓缩时间并且点击“OK”按钮，此前浓缩的所有数据会从数据库载入。载入了的数据被显示在中。②SettingsofobjectTherearetwosettingsofsimpleclassificationofobjecttypesandadvancedclassification.Thesimpleclassificationforobjecttypescancarriedoutusingcomboboxinwhichincludeditemsofallobjects, s,vehicles,bicyclesandothers. 设置目标分combo框进行目标类型的简Settingdialogwindowforadvancedclassificationopenedby“Setting->Advancedsettingforobjectclassification”inthe barorbuttoninthetoolbar.可在菜单栏中的“设置->目标分类的高级设置”或 中的按钮打开高级分Twosubwindows,objectcharactersettingandsettingofobjecttype,areincludedinthisIfyouclickbutton“Apply”,settingvaluesselectedasparametersfortheclassification.Ifyouclickbutton“Save”,settingvaluessavedandmaintainedinthecaseofrestartingapplication.如果您点击应用按钮，那么设定值则被选对于分类的参数。如果您点击“钮，那么在重新启动应用中则保存和维持设定值。③yingof andobjectIndatalist,doubleclickedtheinterestingitem,loadedthecorrespondingcondensedanddisyedobjectimagesclassifiedbyuser’sinquiryintheobjectimagelistwindow.Youcanythecondensed. 浓缩和目标分在数据中双击感的项目，则会载入相应的浓缩，并且将按照用户查询的 窗口之中。您可以浓缩 ④ViewingofsingleobjectandoriginalIfyoudoubleclickobjectimageiteminobjectimagelistwindow,thesingleobjectandtheoriginalclipwillbeyed. 单个目标和如果您双击目标截图窗口中的目标截图项目，那么将会单个目标和原视Object目标检Objectretrievalfunctionisthecapabilitythatsearchsimilarobjectswiththespecialobjectfromdatabase.Usingthisfunction,youcanfindappearancepositionsandactionsofinterestingobject,rapidlyandlightly.目标检索功能能够搜索与来自数据库的特殊目标相类似的目标。您可以用这能快捷的找出您所感的目标所出现的完整。Alsousermayfindobjectsthathassimilarfaceswithselectedfacesfromdatabaseorarbitraryfaceimageusingfacerecognitionfunction.①ParametersettingforobjectIfyouselect“Setting->searchsetting”inthe barorclickbuttonintthetoolbar,openeddialogforselectingsearchmode.①对于目标检索的参数设如果您选择菜单栏中的“设置->搜索设置”或者点击中的按钮，则为选择搜索方式打开了框。Parametersettingforgeneralobject对于轮廓搜索的参数设Inthisdialog,usercanselectcharactersforobjectretrieval,thatis,allcharacters,texture(orshape)characterandcolorcharacter,thresholdofsimilaritymeasurementandthenumberofoutput用户可以在这一中选择对于目标检索的特性，即所有的特性、纹理(或者形状)特Parametersettingforface对于人脸搜索的参数设②OpeningobjectTheobjectimagecanopenbytwoways,selectoneimagefromstorageimageindatabaseor②打开目标截可以用两种方法打开目标截图，从数据库或者器中的截图中选择一个截图OpeningimagefromdataSelectitem“file->OpenimagefromDB”in barorclickbuttoninthe从数据库中打开 中点击按钮OpeningimagefromIfyouselectitem“file->Openimagefrommemory”inthe barorclickbuttoninthetoolbar,openfileopendialogandyoucanselectanobjectimage.从器打开截如果您在菜单栏中选择“文件->从 中点