Stereo matching with transparency and matting

This paper formulates and solves a new variant of the stereo correspondence problem: simultaneously recovering the disparities, true colors, and opacities of visible surface elements. This problem arises in newer applications of stereo reconstruction, such as view interpolation and the layering of real imagery with synthetic graphics for special effects and virtual studio applications. While this problem is intrinsically more difficult than traditional stereo correspondence, where only the disparities are being recovered, it provides a principled way of dealing with commonly occurring problems such as occlusions and the handling of mixed (foreground/background) pixels near depth discontinuities. It also provides a novel means for separating foreground and background objects (matting), without the use of a special blue screen. We formulate the problem as the recovery of colors and opacities in a generalized 3-D (x,y,d) disparity space, and solve the problem using a combination of initial evidence aggregation followed by iterative energy minimization

Szeliski-IJCV99.pdf
PDF file

In  International Journal of Computer Vision

Publisher  Kluwer Academic
All copyrights reserved by Kluwer Academic 2007.

Details

TypeArticle
URLhttp://www.ieee.org/
Pages45–61
Volume32
Number1
InstitutionMicrosoft Research
> Publications > Stereo matching with transparency and matting