Image-based rendering using image-based priors
Andrew W. Fitzgibbon, Yonatan Wexler and Andrew Zisserman
Abstract:
Given a set of images acquired from known viewpoints, we
describe a method for synthesizing the image which would be seen from
a new viewpoint. In contrast to existing techniques, which explicitly
reconstruct the 3D geometry of the scene, we transform the problem to
the reconstruction of colour rather than depth. This retains the
benefits of geometric constraints, but projects out the ambiguities in
depth estimation which occur in textureless regions. On the other
hand, regularization is still needed in order to generate high-quality
images. The paper s second contribution is to constrain the generated
views to lie in the space of images whose texture statistics are those
of the input images. This amounts to a image-based prior on the
reconstruction which regularizes the solution, yielding realistic
synthetic views. Examples are given of new view generation for cameras
interpolated between the acquisition viewpoints which enables
synthetic steadicam stabilization of a sequence with a high level of
realism.
Paper: pdf
Some movies are available on awf's page here
Last modified: Wed Aug 27 14:09:42 2003