Share on Facebook Tweet on Twitter Share on LinkedIn Share by email
Reconstructing Occluded Surfaces using Synthetic Apertures: Shape from Focus vs. Shape from Stereo

Vaibhav Vaish, Richard Szeliski, C. L. Zitnick, Sing Bing Kang, and Marc Levoy

Abstract

Most algorithms for 3D reconstruction from images use cost functions based on SSD, which assume that the surfaces being reconstructed are visible to all cameras. This makes it difficult to reconstruct objects which are partially occluded. Recently, researchers working with large camera arrays have shown it is possible to .see through. occlusions using a technique called synthetic aperture focusing. This suggests that we can design alternative cost functions that are robust to occlusions using synthetic apertures. Our paper explores this design space. We compare classical shape from stereo with shape from synthetic aperture focus. We also describe two variants of multi-view stereo based on color medians and entropy that increase robustness to occlusions. We present an experimental comparison of these cost functions on complex light fields, measuring their accuracy against the amount of occlusion.

Details

Publication typeInproceedings
Published inIEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'2006)
Pages2331-2338
Volume3
AddressNew York, NY
PublisherIEEE Computer Society
> Publications > Reconstructing Occluded Surfaces using Synthetic Apertures: Shape from Focus vs. Shape from Stereo