Stereo Algorithms and Representations for Image-Based Rendering

This paper reviews a number of recently developed stereo matching algorithms and representations. It focuses on techniques that are especially well suited for image-based rendering applications such as novel view generation and the mixing of live imagery with synthetic computer graphics. The paper begins by reviewing some recent approaches to the classic problem of recovering a depth map from two or more images. It then describes a number of newer representations (and their associated reconstruction algorithms), including volumetric representations, layered plane-plus-parallax representations, and multiple depth maps. Each of these techniques has its own strengths and weaknesses, which are discussed.