全文预览已结束
下载本文档
版权说明:本文档由用户提供并上传,收益归属内容提供方,若内容存在侵权,请进行举报或认领
文档简介
HDR 多传感器系统实时HDR视频重建 See discussions,stats,and authorprofiles forthis publicationat:s:/.researchgate./publication/254463253Real-time HDR video reconstructionfor multi-sensor systemsArticleAugustxxDOI:10.1145/2342896.2342975CITATIONS2READS423authors:Some of the authorsof thispublication arealso workingon theserelated projects:Anti-Aliased EuclideanDistance TransformView projectWebGL-noise ViewprojectJoel KronanderLink?ping University28PUBLICATIONS209CITATIONS SEEPROFILEStefan GustavsonLink?ping University22PUBLICATIONS256CITATIONS SEEPROFILEJonas UngerLink?ping University61PUBLICATIONS742CITATIONS SEEPROFILEAll contentfollowing thispage wasuploaded byStefan Gustavsonon12Augustxx.The userhas requestedenhancement ofthe downloadedfile.Real-time HDR video reconstructionfor multi-sensor systemsJoelKronander,Stefan Gustavson,Jonas Unger?Link?ping UniversityLensBeamSplitterI1I2I3ND flter1ND flter2ND flter3(a)T1T2T3I2I3I1(b)(c)Figure1:(a)Sketch of a typicalmulti-sensor HDRcapturing system.(b)Assuming aknown transformation sensor imagescan bewarped toa mon referencecoordinate system,note thatdue tonon-perfect pixelalignment,transformed sensorpixels willgenerally beirregularlydistributed in the referencegrid.The reconstructionat apoint z j usesmeasured sensorpixels fromall sensorsinside thesupport ofa f i nitewindowfunction withradius w.(c)Shows atonemapped HDRvideo framereconstructed at an resolutionof2400x1700using our method.1IntroductionHDR videois anemerging f i eldof technology,with afew camerasystemscurrently inexistenceMyszkowski etal.xx.Multi-sensor systemsToi etal.xxhave recentlyproved tobe par-ticularly promisingdue tosuperior robustnessagainst temporalar-tifacts,correct motionblur,and highlight eff i ciency.PreviousHDR reconstructionmethods formulti-sensor systemshave as-sumedpixelperfectalignmentofthephysicalsensors.Incontrasttothis,our methodis specif i callydesigned tohandle thecase ofnon-negligible misalignmentsbetween the sensors.This isbenef icialas perfectalignment isvery diff i cultto achievein practiceand thatrefl ectionsinbeamsplittersmaymakeitimpossibletomatchthear-rangement ofthe Bayerfilters betweensensors.Furthermore,whilepreviousreconstructiontechniqueshaveconsideredHDRassembly,debayering anddenoising asseparate problems,ourmethodis ca-pable ofsimultaneous HDRassembly,debayering andsmoothingof thedata(denoising).The methodis alsogeneral inthat ital-lows reconstructionto anarbitrary output resolution andmapping.The algorithmis implemented in CUDA,and showsvideo speedperformancefor anexperimental HDRvideo platformconsistingof four2400x1700pixels highquality CCDsensors imagingthescene troughamonoptical system.ND-filters ofdifferent den-sities areplaced infront ofthesensorsto capturea dynamicrangeof24f-stops.2ReconstructionWe treatthe reconstructionof eachHDRvideoframe,F,as asep-arate problem.Using Nsensors,the inputdata foreach framecon-sists ofa setof rawimages,I s(i,j)s=1.N,each with a possiblyvaryingexposure time,t sand ND-filter coeffi cient,ns.We assumethatthere existsan affi ransform,T srelating eachimage to a vir-tual referencecoordinate system,in whichwe seek to reconstructtheHDR outputimage.In practicewe fi ndthe transforms,T s,foreach sensormatching thedetected cornersofachessboard calibra-tion target(implementedinOpenCV2.1),for oursystem,we obtainamaximum reprojectionerror inthe orderof0.1pixels acrossthe?e-mail:joel.kronander,stefan.gustavson,jonas.ungerliu.seimage.As afi rst stepinthereconstruction,we performshading correctionforall sensor images,linearizing thesensor outputtoamonscale ofreference.We thenmap allsensorimages(pixel measure-ments)to theoutput coordinatesystem.This generallyproducesan irregulardistribution ofred,green andblue pixelsamples,y s,i,aptured fromsensors s=1.N,using alexicographical orderingindexi,see Figure1(a).We nowseektoreconstruct theoutputimage ina regulargrid,with spacingscorresponding tothe desiredoutputresolution.For eachoutput pixellocation,z j,we putealocally weightedaverage ofnearby pixelmeasurements,y s,c,i,foreach colorchannel c=R,G,B.?zj,c=XsXiw(j,s,i,c)y s,i,cPw(j,s,i,c) (1)We putethe weightsbased ontwo criteria,w(j,s,i,c)=w g(i,j)w r(j,s,i,c).The firstfactor wg(j,i)is awindowingfunction offinite support,giving higherweights tospatially nearbysamples,in ourimplementation weuse aGaussian functionwiththe euclideandistance asargument.The secondfactor isa radio-metric weight,w r(j,s,i,c).This weightis setaording toa linearfunctionoftheraw digitalinput valuewithasmall offsetfrom theblacklevellevel andsaturation point.Our methodthus automati-cally removessaturated pixelsbefore reconstruction/debayering bysettingtheir radiometricweight tozero.Figure1(b)shows areconstructed HDRframe capturedusing ourexperimentalHDRvideoplatform.Using ourCUDA implementa-tion,realtimevideoframeratesareachieved(runningatasustainedrate of26fps)atanoutputresolutionof1168x876pixels usingaNvidia GeForce580card.ReferencesM YSZKOWSKI,K.,M ANT
温馨提示
- 1. 本站所有资源如无特殊说明,都需要本地电脑安装OFFICE2007和PDF阅读器。图纸软件为CAD,CAXA,PROE,UG,SolidWorks等.压缩文件请下载最新的WinRAR软件解压。
- 2. 本站的文档不包含任何第三方提供的附件图纸等,如果需要附件,请联系上传者。文件的所有权益归上传用户所有。
- 3. 本站RAR压缩包中若带图纸,网页内容里面会有图纸预览,若没有图纸预览就没有图纸。
- 4. 未经权益所有人同意不得将文件中的内容挪作商业或盈利用途。
- 5. 人人文库网仅提供信息存储空间,仅对用户上传内容的表现方式做保护处理,对用户上传分享的文档内容本身不做任何修改或编辑,并不能对任何下载内容负责。
- 6. 下载文件中如有侵权或不适当内容,请与我们联系,我们立即纠正。
- 7. 本站不保证下载资源的准确性、安全性和完整性, 同时也不承担用户因使用这些下载资源对自己和他人造成任何形式的伤害或损失。
最新文档
- 催办项目收尾工作的进度通知函4篇
- 市场活动推广费用核对回复函5篇
- 事业单位人事岗面试专业面试强化训练
- 事业单位护理岗面试2026经典考题强化训练试卷及解析
- 事业单位财会岗面试高频考题2026题库及答案
- 人力资源部2026年员工职业晋升考核通知函4篇范文
- 请求协助完成项目报告确认函(7篇范文)
- 航空机务团队协作与维护绩效表
- 2026事业单位人事岗面试高频考题题库及解析
- 事业单位财会岗面试高频考题题库及解析
- 2025年《治安管理处罚法》知识竞赛试题库及答案(完整版)
- (新教材)2025年部编人教版三年级上册语文第五单元复习课件
- 植物学课件马炜梁主编教学
- 腰部支具的正确使用方法
- 电影放映人员上岗证考试题库及答案
- JG/T 220-2016铜铝复合柱翼型散热器
- 高频手术电刀临床应用与操作规范
- 清华大学出社机械制图习题集参考答案第三机械制图清华大学答案
- 专题03 阅读填空20篇(中考真题+各区名校模拟)2023年广州中考英语冲刺专项训练(解析版)
- 《-电力系统分析(上)》试卷
- 19R505-19G540室外管道钢结构架空综合管廊敷设
评论
0/150
提交评论