Share on Facebook Tweet on Twitter Share on LinkedIn Share by email
Sudipta Sinha

Sudipta Sinha
RESEARCHER
.

[Resume]

I'm a researcher in the Interactive Visual Media group. My main research interests are in Computer Vision. I work on 3D modeling from Images and Video, Structure from Motion, Image-based Rendering and Vision-based Localization.

I did my PhD under the supervision of Marc Pollefeys at UNC Chapel Hill. Please visit my UNC research page for more details. 

 

Recent Projects

High Resolution Stereo Matching

 

High-Resolution Stereo Matching using Local Plane Sweeps

CVPR 2014

[www] [pdf]

 

 

 

Calibrating a non-isotropic near point light source using a plane 

CVPR 2014

(coming soon)

[www] [pdf]

 

 

Multiview Photometric Stereo using Planar Mesh Parameterization

 

Car Make and Model Recognition using 3D Curve Alignment

WACV 2014.

[www] [pdf]

Multiview Photometric Stereo using Planar Mesh Parameterization

 

AutoCaption: Automatic Caption Generation for Personal Photos

WACV 2014.

[www] [pdf]

Multiview Photometric Stereo using Planar Mesh Parameterization

     

Multiview Photometric Stereo using Planar Mesh Parameterization

ICCV 2013.

[www] [pdf]

 

       

Leveraging Structure from Motion to Learn Discriminative Codebooks for Scalable Landmark Classification,

CVPR 2013.

[www] [pdf]

 

      

Detecting and Reconstructing 3D Mirror Symmetric Objects, ECCV 2012.

[www] [pdf]

     

Multiple View Object Cosegmentation using Appearance and Stereo Cues,

ECCV 2012.

[www] [pdf]

 

Image-Based Rendering for Scenes with Reflections, SIGGRAPH 2012.

[www] [pdf]

 

Real-time Image-based 6-DOF Localization in Large-Scale Environments, CVPR 2012.

[www] [pdf]

  

 

 

Structure from motion for scenes with large duplicate structures, CVPR 2011.

[www] [pdf] [poster]

 

 

 

 

 

A linear approach to structure from motion,

RMLE - ECCV workshop 2010.

[www] [pdf]

 

 

  

Piecewise Planar Stereo for Image-based Rendering, ICCV 2009.

[www] [pdf] [avi]

 

Publications 

2014 

  1. Jaesik Park, Sudipta N. Sinha, Yasuyuki Matsushita, Yu-Wing Tai and In So Kweon, "Calibrating a non-isotropic near point light source using a plane", (to appear) CVPR 2014. [www] [pdf]
  2. Sudipta N. Sinha, Daniel Scharstein and Richard Szeliski, "Efficient High-Resolution Stereo Matching using Local Plane Sweeps", (to appear) CVPR 2014. [www] [pdf]
  3. Krishnan Ramnath, Simon Baker, Lucy Vanderwende, Motaz El-Saban, Sudipta Sinha, Anitha Kannan, Noran Hassan, Michel Galley, Yi Yang, Deva Ramanan, Alessandro Bergamo, and Lorenzo Torresani, "AutoCaption: Automatic Caption Generation for Personal Photos", WACV 2014. [www] [pdf] [video]
  4. Krishnan Ramnath, Sudipta N. Sinha, Richard Szeliski, and Edward Hsiao, "Car Make and Model Recognition using 3D Curve Alignment", WACV 2014. [www] [pdf]

2013

  1. Jaesik Park, Sudipta N. Sinha, Yasuyuki Matsushita, Yu-Wing Tai and In So Kweon, "Multiview Photometric Stereo using Planar Mesh Parameterization", ICCV 2013. [www] [pdf] [video]
  2. Alessandro Bergamo, Sudipta N. Sinha and Lorenzo Torresani, "Leveraging Structure from Motion to Learn Discriminative Codebooks for Scalable Landmark Classification", CVPR 2013. [www] [pdf]

2012

  1. Adarsh Kowdle, Sudipta N. Sinha and Richard Szeliski, "Multiple View Object Cosegmentation using Appearance and Stereo Cues", ECCV 2012. [www] [pdf]
  2. Sudipta N. Sinha, Krishnan Ramnath and Richard Szeliski, "Detecting and Reconstructing 3D Mirror Symmetric Objects", ECCV 2012. [www] [pdf]
  3. Varsha Hedau, Sudipta N. Sinha, C. Lawrence Zitnick and Richard Szeliski, "A Memory Efficient Discriminative approach for Location aided Recognition", (to appear) ECCV 2012 Workshop on Visual Analysis and Geo-Localization of Large-Scale Imagery. [pdf]
  4. Sudipta N. Sinha, Johannes Kopf, Michael Goesele, Daniel Scharstein and Richard Szeliski, "Image-Based Rendering for Scenes with Reflections", SIGGRAPH 2012. [www] [pdf]
  5. Hyon Lim, Sudipta N. Sinha, Michael Cohen and Matt Uyttendaele, "Real-time Image-based 6-DOF Localization in Large-Scale Environments", CVPR 2012. [www] [pdf]
  6. Andrea Cohen, Christopher Zach, Sudipta N. Sinha and Marc Pollefeys, "Discovering and exploiting 3D symmetries in structure from motion", CVPR 2012. [www] [pdf]
  7. Hyon Lim and Sudipta N. Sinha, "Towards Real-Time Semantic Localization", ICRA 2012 Workshop on Semantic Perception and Mapping (SPMK). [pdf] [video]

2011

  1. Richard Roberts, Sudipta N. Sinha, Richard Szeliski and Drew Steedly, "Structure from motion for scenes with large duplicate structures", CVPR 2011, Colorado Springs. [www] [pdf]
  2. Michael Bleyer, Carsten Rother, Pushmeet Kohli, Daniel Scharstein and Sudipta N. Sinha, "Object Stereo — Joint Stereo Matching and Object Segmentation ", CVPR 2011, Colorado Springs. [www] [pdf]  

2010

  1. Kumar Srijan, Syed Ahsan, Sudipta N. Sinha and C.V. Jawahar, "Image-based walkthroughs from incremental and partial scene reconstructions", BMVC 2010.[www] [pdf]
  2. Sudipta N. Sinha, Drew Steedly and Richard Szeliski, "A multi-stage linear approach to structure from motion", RMLE 2010 workshop on Reconstruction and Modeling of Large-Scale 3D Virtual Environments, to be held in conjunction with ECCV 2010. [www] [pdf] 

2009

  1. Sudipta N. Sinha, Drew Steedly and Richard Szeliski, "Piecewise Planar Stereo for Image-based Rendering", ICCV 2009. [www] [pdf]
  2. Sudipta N Sinha and Marc Pollefeys, "Camera Network Calibration and Synchronization from Silhouettes in Archived Video", (accepted July 2009). International Journal of Computer Vision (IJCV), DOI:10.1007/s11263-009-0269-2

2008

  1. Sudipta N. Sinha, Drew Steedly, Richard Szeliski, Maneesh Agarwala and Marc Pollefeys, "Interactive 3D Architectural Modeling from Unordered Photo Collections", (to appear) SIGGRAPH ASIA 2008 at Singapore, December 2008. [www] [pdf]
  2. M. Pollefeys, D. Nister, J.-M. Frahm, A. Akbarzadeh, P. Mordohai, B. Clipp, C. Engels, D. Gallup, S.-J. Kim, P. Merrell, C. Salmi, S. Sinha, B. Talton, L. Wang, Q. Yang, H. Stewenius, R. Yang, G. Welch, H. Towles,wles, "Detailed Real-Time Urban 3D Reconstruction From Video", International Journal of Computer Vision (IJCV), Vol. 78, Issue 2, Pages: 143 - 167, July 2008

2007

  1. Sudipta N Sinha, Philippos Mordohai and Marc Pollefeys, "Multi-View Stereo via Graph Cuts on the Dual of an Adaptive Tetrahedral Mesh", in Proc. of ICCV, 2007, at Rio de Janiero, Brazil.
  2. Sudipta N Sinha, Jan-Michael Frahm, Marc Pollefeys and Yakup Genc, "Feature Tracking and Matching in Video Using Programmable Graphics Hardware", (accepted, March 2007), Machine Vision and Applications (MVA), (available online - DOI 10.1007/s00138-007-0105-z)

2006

  1. Sudipta N Sinha and Marc Pollefeys, "Pan-Tilt-Zoom Camera Calibration and high-resolution mosaic generation", Computer Vision and Image Understanding (CVIU), special issue on Omnidirectional Cameras and Camera Networks, Volume 103, Issue 3 (September 2006), pp. 170-183.
  2. Li Guan, Sudipta N. Sinha, Jean-Sebastien Franco and Marc Pollefeys, "Visual Hull Construction in the Presence of Partial Occlusion", 3DPVT, Chapel Hill, June 2006.
  3. Sudipta N Sinha, Jan-Michael Frahm, Marc Pollefeys and Yakup Genc, "GPU-Based Video Feature Tracking and Matching", EDGE 2006, workshop on Edge Computing Using New Commodity Architectures, Chapel Hill, May 2006.
  4. A. Akbarzadeh, J.-M. Frahm, P. Mordohai, B. Clipp, C. Engels, D. Gallup, P. Merrell, M. Phelps, Sudipta N. Sinha, B. Talton, L. Wang, Q. Yang, H. Stewenius, R. Yang, G. Welch, H. Towles, D. Nister and M. Pollefeys, "Towards Urban 3D Reconstruction From Video", in 3DPVT, Chapel Hill, June 2006. 

2005

  1. Sudipta N Sinha and Marc Pollefeys, "Multi-view Reconstruction using Photo-consistency and Exact Silhouette Constraints: A Maximum-Flow Formulation", In Proc. of ICCV, 2005, at Beijing, China.

2004

  1. Sudipta N Sinha, Marc Pollefeys and Seon Joo Kim, "High-Resolution Multiscale Panoramic Mosaics from Pan-Tilt-Zoom Cameras", In Proc. of 4th Indian Conference on Computer Vision, Graphics and Image Processing (ICVGIP), 2004, Kolkata, India.
  2. Sudipta N Sinha and Marc Pollefeys, "Synchronization and Calibration of Camera Networks from Silhouettes", ICPR 2004, Cambridge,UK.
  3. Sudipta N Sinha, Marc Pollefeys and Leonard McMillan, "Camera Network Calibration from Dynamic Silhouettes", CVPR 2004, at Washington DC.
  4. Marc Pollefeys and Sudipta N. Sinha, "Iso-disparity surfaces for general stereo configurations", ECCV 2004, at Prague.
  5. Sudipta N Sinha and Marc Pollefeys, "Visual-Hull Reconstruction from Uncalibrated and Unsynchronized Video Streams", 2nd International Symposium on 3D Data Processing, Visualization & Transmission (3DPVT), 2004, at Thessaloniki, Greece.
  6. Sudipta N Sinha and Marc Pollefeys, "Towards Calibrating a Pan-Tilt-Zoom Camera Network", OMNIVIS 2004, workshop on Omnidirectional Vision and Camera Networks held in conjunction with ECCV 2004.

2003

  1. Kelshikar, N., X. Zabulis, K. Daniilidis, V. Sawant, S. Sinha, T. Sparks, S. Larsen, H. Towles, K. Mayer-Patel, H. Fuchs, J. Urbanic, K. Benninger, R. Reddy, and G. Huntoon. "Real-time Terascale Impementation of Tele-immersion," International Conference on Computation Science (ICCS) 2003. Melbourne, Australia. June, 2003.
  2. Towles, Herman, Sang-Uok Kum, Travis Sparks, Sudipta N. Sinha, Scott Larsen and Nathan Beddes. "Transport and Rendering Challenges of Multi-Stream 3D Tele-Immersion Data," NSF Lake Tahoe Workshop on Collaborative Virtual Reality and Visualization (CVRV 2003) Tahoe City, CA, USA (October 26-28, 2003).

1998

  1. Soumyadeep Paul, Sudipta N Sinha and Amitabha Mukerjee, Virtual Kathakali : Gesture Driven Metamorphosis, Proceedings of International Conference on Knowledge Based Computer Systems (KBCS), Mumbai, India, Dec 1998.

 

Book Chapters

  1. Marc Pollefeys, Sudipta N. Sinha, Li Guan, Jean-Sebastien Franco,"Multiview Calibration Synchronization and Dynamic Scene Reconstruction", invited chapter, Multi-Camera Networks: Principles and Applications, H. Aghajan and A. Cavallaro (Eds.), ELSEVIER, May 2009, ISBN-13: 978-0-12-374633-7. 
  2. Marc Pollefeys, Sudipta N. Sinha and Jingyu Yan, "Calibration and Shape Recovery from Videos of Dynamic Scenes", (Invited Book Chapter) Computational Vision in Neural and Machine Systems, L. Harris and M. Jenkins (Eds.), Cambridge University Press, 2007.

Demo

  1. Real-time Urban Reconstruction, CVPR 2007 Best Demo Prize, J-M. Frahm, P. Mordohai, A. Akbarzadeh, B. Clipp, C. Engels, D. Gallup, X. Li, P. Merrell, S. N. Sinha, L. Wang, C. Wu, Q-X. Yang, H. Towles, G. Welch, R. Yang, D. Nister and M. Pollefeys.

Thesis

  1. Silhouettes for Calibration and Reconstruction from Multiple Views, PhD Dissertation, UNC Chapel Hill, August 2009.[pdf]

Video Proceedings

  1. Sudipta N Sinha and Marc Pollefeys, "Synchronization and Calibration of a Camera Network for 3D Event Reconstruction from Live Video", VPCVPR 2005, at San Diego.
  2. SriRam Thirthala, Sudipta N Sinha and Marc Pollefeys, "Calibration of Pan-Tilt-Zoom (PTZ) Cameras and Omni-directional Cameras", VPCVPR 2005, at San Diego.

Techreports/Others

  1. Sudipta N. Sinha, "Calibration of a heterogeneous network of color and depth cameras", one of the 10 selected entries in Phase I of the Canesta Design Contest, December 2004.
  2. Sudipta N Sinha, "Graph Cut Algorithms in Vision, Graphics and Machine Learning", Integrative Paper, November, 2004, UNC Chapel Hill.