Share on Facebook Tweet on Twitter Share on LinkedIn Share by email
From 2D Images to 2.5D Sprites: A Layered Approach to Modeling 3D Scenes

Richard Szeliski, P. Anandan, and Simon Baker

Abstract

We propose a framework for extracting structure from stereo which represents the scene as a collection of approximately planar layers. Each layer consists of an explicit 3D plane equation, a colored image with per-pixel opacity, and a per-pixel depth offset relative to the plane. Initial estimates of the layers are recovered using techniques taken from parametric motion estimation. These initial estimates are then refined using a re-synthesis algorithm which takes into account both occlusions and mixed pixels. Reasoning about such effects allows the recovery of depth and color information with high accuracy, even in partially occluded regions. Another key benefit is that the output consists of a collection of approximately planar regions, a representation which is better suited than a dense depth map for many applications such as rendering and video parsing.

Details

Publication typeInproceedings
Published inIEEE International Conference on Multimedia Computing and Systems (ICMCS'99)
Pages44-50
Volume1
AddressFlorence, Italy
PublisherIEEE Computer Society
> Publications > From 2D Images to 2.5D Sprites: A Layered Approach to Modeling 3D Scenes