HDR 多传感器系统实时HDR视频重建.doc_第1页
HDR 多传感器系统实时HDR视频重建.doc_第2页
HDR 多传感器系统实时HDR视频重建.doc_第3页
HDR 多传感器系统实时HDR视频重建.doc_第4页
HDR 多传感器系统实时HDR视频重建.doc_第5页
全文预览已结束

下载本文档

版权说明:本文档由用户提供并上传,收益归属内容提供方,若内容存在侵权,请进行举报或认领

文档简介

HDR 多传感器系统实时HDR视频重建 See discussions,stats,and authorprofiles forthis publicationat:s:/.researchgate./publication/254463253Real-time HDR video reconstructionfor multi-sensor systemsArticleAugustxxDOI:10.1145/2342896.2342975CITATIONS2READS423authors:Some of the authorsof thispublication arealso workingon theserelated projects:Anti-Aliased EuclideanDistance TransformView projectWebGL-noise ViewprojectJoel KronanderLink?ping University28PUBLICATIONS209CITATIONS SEEPROFILEStefan GustavsonLink?ping University22PUBLICATIONS256CITATIONS SEEPROFILEJonas UngerLink?ping University61PUBLICATIONS742CITATIONS SEEPROFILEAll contentfollowing thispage wasuploaded byStefan Gustavsonon12Augustxx.The userhas requestedenhancement ofthe downloadedfile.Real-time HDR video reconstructionfor multi-sensor systemsJoelKronander,Stefan Gustavson,Jonas Unger?Link?ping UniversityLensBeamSplitterI1I2I3ND flter1ND flter2ND flter3(a)T1T2T3I2I3I1(b)(c)Figure1:(a)Sketch of a typicalmulti-sensor HDRcapturing system.(b)Assuming aknown transformation sensor imagescan bewarped toa mon referencecoordinate system,note thatdue tonon-perfect pixelalignment,transformed sensorpixels willgenerally beirregularlydistributed in the referencegrid.The reconstructionat apoint z j usesmeasured sensorpixels fromall sensorsinside thesupport ofa f i nitewindowfunction withradius w.(c)Shows atonemapped HDRvideo framereconstructed at an resolutionof2400x1700using our method.1IntroductionHDR videois anemerging f i eldof technology,with afew camerasystemscurrently inexistenceMyszkowski etal.xx.Multi-sensor systemsToi etal.xxhave recentlyproved tobe par-ticularly promisingdue tosuperior robustnessagainst temporalar-tifacts,correct motionblur,and highlight eff i ciency.PreviousHDR reconstructionmethods formulti-sensor systemshave as-sumedpixelperfectalignmentofthephysicalsensors.Incontrasttothis,our methodis specif i callydesigned tohandle thecase ofnon-negligible misalignmentsbetween the sensors.This isbenef icialas perfectalignment isvery diff i cultto achievein practiceand thatrefl ectionsinbeamsplittersmaymakeitimpossibletomatchthear-rangement ofthe Bayerfilters betweensensors.Furthermore,whilepreviousreconstructiontechniqueshaveconsideredHDRassembly,debayering anddenoising asseparate problems,ourmethodis ca-pable ofsimultaneous HDRassembly,debayering andsmoothingof thedata(denoising).The methodis alsogeneral inthat ital-lows reconstructionto anarbitrary output resolution andmapping.The algorithmis implemented in CUDA,and showsvideo speedperformancefor anexperimental HDRvideo platformconsistingof four2400x1700pixels highquality CCDsensors imagingthescene troughamonoptical system.ND-filters ofdifferent den-sities areplaced infront ofthesensorsto capturea dynamicrangeof24f-stops.2ReconstructionWe treatthe reconstructionof eachHDRvideoframe,F,as asep-arate problem.Using Nsensors,the inputdata foreach framecon-sists ofa setof rawimages,I s(i,j)s=1.N,each with a possiblyvaryingexposure time,t sand ND-filter coeffi cient,ns.We assumethatthere existsan affi ransform,T srelating eachimage to a vir-tual referencecoordinate system,in whichwe seek to reconstructtheHDR outputimage.In practicewe fi ndthe transforms,T s,foreach sensormatching thedetected cornersofachessboard calibra-tion target(implementedinOpenCV2.1),for oursystem,we obtainamaximum reprojectionerror inthe orderof0.1pixels acrossthe?e-mail:joel.kronander,stefan.gustavson,jonas.ungerliu.seimage.As afi rst stepinthereconstruction,we performshading correctionforall sensor images,linearizing thesensor outputtoamonscale ofreference.We thenmap allsensorimages(pixel measure-ments)to theoutput coordinatesystem.This generallyproducesan irregulardistribution ofred,green andblue pixelsamples,y s,i,aptured fromsensors s=1.N,using alexicographical orderingindexi,see Figure1(a).We nowseektoreconstruct theoutputimage ina regulargrid,with spacingscorresponding tothe desiredoutputresolution.For eachoutput pixellocation,z j,we putealocally weightedaverage ofnearby pixelmeasurements,y s,c,i,foreach colorchannel c=R,G,B.?zj,c=XsXiw(j,s,i,c)y s,i,cPw(j,s,i,c) (1)We putethe weightsbased ontwo criteria,w(j,s,i,c)=w g(i,j)w r(j,s,i,c).The firstfactor wg(j,i)is awindowingfunction offinite support,giving higherweights tospatially nearbysamples,in ourimplementation weuse aGaussian functionwiththe euclideandistance asargument.The secondfactor isa radio-metric weight,w r(j,s,i,c).This weightis setaording toa linearfunctionoftheraw digitalinput valuewithasmall offsetfrom theblacklevellevel andsaturation point.Our methodthus automati-cally removessaturated pixelsbefore reconstruction/debayering bysettingtheir radiometricweight tozero.Figure1(b)shows areconstructed HDRframe capturedusing ourexperimentalHDRvideoplatform.Using ourCUDA implementa-tion,realtimevideoframeratesareachieved(runningatasustainedrate of26fps)atanoutputresolutionof1168x876pixels usingaNvidia GeForce580card.ReferencesM YSZKOWSKI,K.,M ANT

温馨提示

  • 1. 本站所有资源如无特殊说明,都需要本地电脑安装OFFICE2007和PDF阅读器。图纸软件为CAD,CAXA,PROE,UG,SolidWorks等.压缩文件请下载最新的WinRAR软件解压。
  • 2. 本站的文档不包含任何第三方提供的附件图纸等,如果需要附件,请联系上传者。文件的所有权益归上传用户所有。
  • 3. 本站RAR压缩包中若带图纸,网页内容里面会有图纸预览,若没有图纸预览就没有图纸。
  • 4. 未经权益所有人同意不得将文件中的内容挪作商业或盈利用途。
  • 5. 人人文库网仅提供信息存储空间,仅对用户上传内容的表现方式做保护处理,对用户上传分享的文档内容本身不做任何修改或编辑,并不能对任何下载内容负责。
  • 6. 下载文件中如有侵权或不适当内容,请与我们联系,我们立即纠正。
  • 7. 本站不保证下载资源的准确性、安全性和完整性, 同时也不承担用户因使用这些下载资源对自己和他人造成任何形式的伤害或损失。

评论

0/150

提交评论