Name
Abstract | ||
|---|---|---|
This paper proposes a new framework for video editing in gradient domain. The spatio-temporal gradient fields of target videos are modified and/or mixed to generate a new gradient field which is usually not integrable. We compare two methods to solve this ''mixed gradient problem'', i.e., the variational method and loopy belief propagation. We propose a 3D video integration algorithm, which uses the variational method to find the potential function whose gradient field is closest to the mixed gradient field in the sense of least squares. The video is reconstructed by solving a 3D Poisson equation. The main contributions of our framework lie in three aspects: first, we derive a straightforward extension of current 2D gradient technique to 3D space, thus resulting in a novel video editing framework, which is very different from all current video editing software; secondly, we propose using a fast and accurate 3D discrete Poisson solver which uses diagonal multigrids to solve the 3D Poisson equation, which is up to twice as fast as a simple conventional multigrid algorithm; finally, we introduce a set of new applications, such as face replacement and painting, high dynamic range video compression and graphcut based video compositing. A set of gradient operators is also provided to the user for editing purposes. We evaluate our algorithm using a variety of examples for image/video or video/video pairs. The resulting video can be seamlessly reconstructed. |
Year | DOI | Venue |
|---|---|---|
2007 | 10.1016/j.gmod.2006.06.002 | Graphical Models \/graphical Models and Image Processing \/computer Vision, Graphics, and Image Processing |
Keywords | Field | DocType |
spatio-temporal video editing,video editing,novel video editing framework,poisson equation,image processing,video compositing,video pair,gradient domain,video integration algorithm,new framework,current video editing software,high dynamic range video,resulting video,target video,graphcut,variational method,painting,video compression,dynamic range,apertures,loopy belief propagation,color,motion pictures,image reconstruction,displays | Computer vision,Computer graphics (images),Computer science,Motion compensation,Color correction,Video editing,Video tracking,Software,Artificial intelligence,Pixel,Data compression,Compositing | Journal |
Volume | Issue | ISSN |
69 | 1 | Graphical Models |
Citations | PageRank | References |
13 | 0.94 | 28 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Hongcheng Wang | 1 | 928 | 54.77 |
| Ning Xu | 2 | 184 | 20.03 |
| Ramesh Raskar | 3 | 5305 | 422.69 |
| Narendra Ahuja | 4 | 7726 | 956.74 |