Unwrap Mosaics: A new representation for video editing


                                    Unwrap
Original Images Original Images Extracted Mosaic Edited Mosaic Edited Images Edited Images

People

Abstract

We introduce a new representation for video which facilitates a number of common editing tasks. The representation has some of the power of a full reconstruction of 3D surface models from video, but is designed to be easy to recover from a priori unseen and uncalibrated footage. By modelling the image-formation process as a 2D-to-2D transformation from an object’s texture map to the image, modulated by an object-space occlusion mask, we can recover a representation which we term the “unwrap mosaic”. Many editing operations can be performed on the unwrap mosaic, and then re-composited into the original sequence, for example resizing objects, repainting textures, copying/cutting/pasting objects, and attaching effects layers to deforming objects.

Press Coverage

Paper

Paper thumbnail Alex Rav-Acha, Pushmeet Kohli, Carsten Rother and Andrew Fitzgibbon.
Unwrap Mosaics, ACM Transactions on Graphics (SIGGRAPH 2008), August 2008.
[PDF TechReport (28MB) (recommended: extra figures)]
[PDF (25MB)] [BibTeX]

Video

Movie [1 min Low-res WMV (6.7 MB)]
[7 min Hi-res WMV (117 MB)]

Code

[Code for Embedding Tracks (MATLAB)]


This work is based on an earlier work: “Unwrap mosaics: a new representation for video editing”, in ACM Transactions on Graphics (TOG) Volume 27 , Issue 3 (August 2008) © ACM, 2008