Unwrap Mosaics: A new representation for video editing
 |
 |
 |
|
|
|
People
- Alex Rav Acha (Weizmann institute of Science)
- Pushmeet Kohli (Microsoft Research Cambridge)
- Carsten Rother (Microsoft Research Cambridge)
- Andrew Fitzgibbon (Microsoft Research Cambridge)
Abstract
We introduce a new representation for video which facilitates a number of common editing tasks. The representation has some of the power of a full reconstruction of 3D surface models from video, but is designed to be easy to recover from a priori unseen and uncalibrated footage. By modelling the image-formation process as a 2D-to-2D transformation from an object’s texture map to the image, modulated by an object-space occlusion mask, we can recover a representation which we term the “unwrap mosaic”. Many editing operations can be performed on the unwrap mosaic, and then re-composited into the original sequence, for example resizing objects, repainting textures, copying/cutting/pasting objects, and attaching effects layers to deforming objects.
Press Coverage
- Microsoft unwraps video editing process (CNET News)
- Realistic special effects coming soon for home videos (New Scientist)
- Microsoft's "Unwrap Mosaics" Add Moustaches (and More) to Video (Gizmodo)
- Microsoft Research unveils Unwrap Mosaic video editing tool (Geek.com)
- Microsoft builds simple video-editing software (PC Advisor)
Paper
|
Alex Rav-Acha,
Pushmeet Kohli,
Carsten Rother and
Andrew Fitzgibbon.
Unwrap Mosaics, ACM Transactions on Graphics (SIGGRAPH 2008), August 2008. [PDF TechReport (28MB) (recommended: extra figures)] [PDF (25MB)] [BibTeX] |
Video
|
[1 min Low-res WMV (6.7 MB)]
[7 min Hi-res WMV (117 MB)] |