Share on Facebook Tweet on Twitter Share on LinkedIn Share by email
Structure from motion for scenes with large duplicate structures

Richard Roberts, Sudipta N. Sinha, Richard Szeliski, and Drew Steedly

Abstract

Most existing structure from motion (SFM) approaches for unordered images cannot handle multiple instances of the same structure in the scene. When image pairs containing different instances are matched based on visual similarity, the pairwise geometric relations as well as the correspondences inferred from such pairs are erroneous, which can lead to catastrophic failures in the reconstruction.

In this paper, we investigate the geometric ambiguities caused by the presence of repeated or duplicate structures and show that to disambiguate between multiple hypotheses requires more than pure geometric reasoning. We couple an expectation maximization (EM)-based algorithm that estimates camera poses and identifies the false match-pairs with an efficient sampling method to discover plausible data association hypotheses. The sampling method is informed by geometric and image-based cues. Our algorithm usually recovers the correct data association, even in the presence of large numbers of false pairwise matches.

Details

Publication typeInproceedings
Published inCVPR
URLhttp://research.microsoft.com/en-us/um/redmond/groups/ivm/dupSFM/
Pages3137-3144
PublisherComputer Vision and Patter Recognition
> Publications > Structure from motion for scenes with large duplicate structures