Share on Facebook Tweet on Twitter Share on LinkedIn Share by email
On the Motion and Appearance of Specularities in Image Sequences

Rahul Swaminathan, Sing Bing Kang, Antonio Criminisi, and Richard Szeliski


Real scenes are full of specularities (highlights and reflections), and yet most vision algorithms ignore them. In order to capture the appearance of realistic scenes, we need to model specularities as separate layers. In this paper, we study the behavior of specularities in static scenes as the camera moves, and describe their dependence on varying surface geometry, orientation, and scene point and camera locations. For a rectilinear camera motion with constant velocity, we study how the specular motion deviates from a straight trajectory (disparity de- viation) and how much it violates the epipolar constraint (epipolar deviation). Surprisingly, for surfaces that are convex or not highly undulating, these devi- ations are usually quite small. We also study the appearance of specularities, i.e., how they interact with the body reflection, and with the usual occlusion ordering constraints applicable to diffuse opaque layers. We present a taxonomy of specularities based on their photometric properties as a guide for designing separation techniques. Finally, we propose a technique to extract specularities as a separate layer, and demonstrate it using an image sequence of a complex scene.


Publication typeInproceedings
Published inProc. European Conference in Computer Vision (ECCV)
PublisherSpringer Verlag
> Publications > On the Motion and Appearance of Specularities in Image Sequences