视频特技外文翻译.doc

video special effectspeng huang2.1.2 object-space nparmeier was the first one who produced painterly animations from object-space scenes53.he triangulated surfaces in object-space and distributed strokes over each triangle in proportion to its area. since his initial work, many object-space npar systems have been presented. halls q-maps29(a q-map is a 3d texture which adapts to the intensity of light to give the object in the image a 3d look, for example, more marks are made where an object is darker) may be applied to create coherent pen-and-ink shaded animations.a system capable of rendering object-space eometries in a sketchy style was outlined by curtis15, and operates by tracing the paths of particles traveling stochastically around contours of a depth image generated from a 3d object. see figure 2.3 for some examples.in addition, most modern graphical modeling packages(3d studio max!,maya,xsi soft-image) support plug-ins which offer the option of rendering object-space scenes to give a flat shaded, cartoon-like appearance.2.1.3 image-space nparmost npar systems in image-space are still based on static painterly rendering techniques,brushing strokes frame by frame and trying to avoid unappealing swimming which distractsthe audience from the content of the animation. liwinowicz extends his static method and makes use of optical flow to estimate a motion vector field to translate the strokes painted on the first frame to successive frames47. a similar method is employed by kovacs and sziranyi42. a simpler solution is proposed by hertzmann33, who differences consecutive frames of video, re-painting only those areas which have changed above some global(userdefined) threshold. hays and essas approach32 builds on and improves these techniques by using edges to guide painterly refinement. see figure 2.4 for some examples. in their current work, they are looking into studying region-based methods to extend beyond pixels to cell-based renderings, which implies the trend from low-level analysis to higher-levelscene understanding. we also find various image-space tools which are highly interactive to assist users in the process of creating digital non-photorealistic animations. fekete et al. describe a system23 to assist in the creation of line art cartoons. agarwala proposes an interactive system2 that allows children and others untrained in “cel animation” to create 2d cartoons from images and video. users have to hand-segment the first image, and active contours(snakes) are used to track the segmentation boundaries from frame to frame. it is labor intensive(usersneed to correct the contours every frame), unstable(due to susceptibility of snakes to local minima and tracking fails under occlusion) and limited to video material with distinct objects and well-defined edges. another technique is called “advanced rotoscoping” by the computer graphics community, which requires artists to draw a shape in key-frames, and then interpolate the shape over the interval between key-frames a process referred to as “in-betweening” by animators. the film “waking life”26 used this technique. see figure 2.5 for some examples.npar techniques in image-space as well as commercial video effects software, such as adobe premier, which provide low-level effects(i.e slow-motion, spatial warping, and motion blur etc.), fail to do a high-level video analysis and are unable to create more complicated visual effects(e.g. motion emphasis). lake et al. present techniques for emphasizing motion of cartoon objects by introducing geometry into the cartoon scene43. however, their work is limited to object-space, avoiding the complex high-level video analysis, and their “motion lines” are quite simple. in their current work, they are trying to integrate other traditional cartoon effects into their system. collomosse and hall first introduce high-level computer vision analysis to npar in “videopaintbox”12. they argue that comprehensive video analysis should be the first step in the artistic rendering(ar) process; salient information(such as object boundaries or trajectories) must be extracted prior to representation in an artistic style. by developing novel computer vision techniques for ar, they are able to emphasize motion using traditional animation cues44 such as streak-lines, anticipation and deformation. their unique contribution is to build a video based npr system which can process over an extended period of time rather than on a per frame basis. this advance allows them to analyze trajectories, make decisions regarding occlusions and collisions and do motion emphasis. in this work we will also regard video as a whole rather than the sum of individual frames. however, their segmentation in “computer vision component” suffers labor intensity, since users have to manually identify polygons, which are “shrink wrapped” to the features edge contour using snake relaxation72 before tracking. and their tracking is based on the assumption that contour motion may be modeled by a linear conformal affine transform(lcat) in theimage plane. we try to use a more automatic segmentation and non-rigid region tracking to improve the capability of video analysis. see figure 2.6 for some examples.another high-level video-based npar system is provided by wang et al.69. they regard video as a 3d lattice(x,y,t) and then implement spatio-temporal segmentation of homogeneous regions using mean shift14 or improved mean shift70 to get volumes of contiguous pixels with similar colour. users have to define salient regions by manually sketching on key-frames and the system thus automatically generates salient regions per frame. this naturally build the correspondence between successive frames, avoiding non-rigid region tracking. their rendering is based on mean shift guided interpolation. the rendering style is limited to several approaches, such as changing segment colour and placing strokes and ignores motion analysis and motion emphasis. our system segments key-frame using 2d mean shift, identifies salient regions and then tracks them over the whole sequence. we extract motion information from the results and then do motion emphasis. see figure 2.6 for some examples.2.1.4 some other npar techniquesbregler et la present a technique called “cartoon capture and retargeting” in 7 which is used to track the motion from traditional animated cartoon and then retarget it onto different output media, including 2d cartoon animation, 3d cg models, and photo-realistic output. they describe vision-based tracking techniques and new modeling techniques. our research tries to borrow this idea to extract motion information, from general video rather than a cartoon, using different computer vision algorithms and then represent this in different output media. see figure 2.7 for some examples.2.1.5 npr application on sports analysisdue to a more and more competitive sports market, sports media companies try to attract audiences by increasingly providing more special or more specific graphics and effects. sports statistics are often graphically presented on tv during sporting events such as the percentage of time in a soccer game that the ball has been in one half compared to the other half. these statistics are collected in many ways both manually and automatically. it is desirable to be able to generate many statistics directly from the video of the game. there are many products in the broadcast environment that provide this capability.the telestrator78 is a simple but efficient tool to allow users to draw lines within a 2d video image by using a mouse. the product is sold as a dedicated box with a touch screen, a video input and video outputs the video with the graphics produced. typically, four very simple controls such as draw arrow, draw dotted line etc. are provided.视频特技黄鹏2.1.2三维空间的nparmeier 第一个在绘画上创造出三维感觉，他把物体按比例绘制到三维界面上实现在二维介质上实现立体感，有了他的理论工作，许多三维空间的npar开始被研发出来。hall的q-maps（q-maps是一种利用光影制造出三维感觉的质感，例如，很多物体都有黑色阴影）可以制作出互相密合着的钢笔画般的黑白动画。curtis提出一种利用几何学有力表现立体空间的系统，而且根据追踪操作在附近随机程序旅行的粒子的路径深度图像的等高线从而产生3d立体物体。如图例2.3 除此之外，大部分的图形工作界面软件（3d studio max!,maya,xsi soft-image）支持图形操作带来的三维立体感的插件。2.1.3二维空间的npar大部分的npar二维系统仍然使用静图显示技术，一种用画笔一帧一帧的描绘还要避免丢帧带来的跳动感。liwinowicz发展了这种静图描绘方法，利用光学流程到估计运动矢量领域呈现笔划着色的第一个帧上对应连续的帧 47。kovacs 和sziranyi 使用了类似的方法。hertzmann33提出了一种简便的解决方法，他区分出不同连续的帧，只描绘出有动作变化的局部而不是全部改变。hays 和 essa的方法通过精致的描绘边缘改进了技术。看图例2.4 。在他们最近的研究中，他们研究局部为主的方法来改进以像素为单位显示，从而暗示他们对那些由低到高分辨显示的理解。我们也找到了许多带有能够有效帮助使用者模拟动画的交互式二维工具。fekete 等人描绘了一个能够帮助创作卡通艺术形象的系统。agarwala提出了一个能允许孩子或未经训练的人们通过图片或视频创造二维卡通形象的交互式系统。使用者必须手动绘制出第一幅背景图画，然后再一帧一帧的分轨道的绘制活动的形象。它属于劳动密集型，这种情况下制作出来的影片带有不稳定性，影像质量受到限制。另一种工作在计算机图形操作界面的技术，它只需要艺术家在关键帧上绘制一个形象，计算机会使关键帧内的形象活动起来生成鲜活的动画。电影“ 唤醒生活”就是使用的这种技术。见图例2.5 。npar应用到二维视频特效处理软件，例如adobe premiere，它可以提供初级特效处理（慢动作、空间扭曲、运动模糊）却不能提供做高级视频分析和复杂的虚拟特效处理(如运动强调)。lake等人通过在卡通场景中引入几何学实现卡通形象的运动强调技术。然而，他们的成果由于运动轨迹过于简单而不能应用于三维空间和高级视频分析。在他们最近的研究中他们尝试将传统的卡通特效嵌入到他们的系统当中。collomosse 和 hall在“影像绘制箱” 中率先将高级计算机操作系统与npar结合。他们主张广泛的影像分析应该是艺术再现过程的第一步。显著的信息（例如物体的轮廓、轨道）必须首先在一种艺术风格中提取再现。通过给ar发展新的计算机技术，他们能够利用传统的动画开端技术实现运动强调。他们的独特贡献就是基于npr系统建立了一个能够超出一定规定时间的视频。这个进步允许他们分析轨道并根据障碍物和碰撞系数制作运动强调。在他们的研究中我们仍旧将视频看做一个整体而不是一个个独立的帧。然而，他们的“计算机视觉成分”分割技术