We focus on new multimedia and graphics experiences made possible with the growth in computing power and storage. Our research focus spans the linear and interactive media spectrum, across television, broadband, and gaming. We seek to address the challenges involved in the high computational cost of producing, transmitting, and displaying complex models by researching geometric compression and multiresolution representations.
- Real-Time, 3-D Scene Capture and ReconstructionWe demonstrate a novel method for real-time 3D scene capture and reconstruction. Using several live color images, we build a high resolution voxelization of the visible surfaces. The key to our approach is an efficient sparse voxel representation ideally suited to Graphics Processing Unit (GPU) acceleration. We store only those voxels that contain the visible surfaces, leading to a compact representation for the 3D model.
- Facing InteractionHow can we communicate one's biometric info, in non-verbal ways, to others, ourselves, places and across time? Under the assumptions that one's face is a sound window to somebody’s emotion, we constructed different art pieces and interactive prototypes that comprise different communication channels ( aural, visual, haptics), and aim to help reflecting on communication itself, its poetry, and ourselves. This project starts with the internship work from Tomas Laurenzo http://laurenz.net.
- BodyAvatar: Creating 3-D Avatars with Your Body and ImaginationXiang Cao, Xin Tong, Yang Liu, Takaaki Shiratori, Yupeng Zhang, Zhimin Ren, Teng Han, Nobuyuki Umetani
- VidWiki: Crowd-Enhanced Online LearningVidWiki is a project out of MSR India that leverages the crowd to improve the quality and content of online video lectures like those produced by Khan Academy, Coursera, EdX, and Udacity. Through the online platform, users annotate videos by overlaying content on top of the video. Annotations can be typed text, LaTeX equations, shapes, images, or custom pen-drawn notes directly on the canvas.
Dilip Krishnan, Raanan Fattal, and Richard Szeliski, Efficient Preconditioning of Laplacian Matrices for Computer Graphics, in ACM Transactions on Graphics (Proc. SIGGRAPH 2013), vol. 32, no. 4, ACM SIGGRAPH, July 2013
Tiezheng Ge, Kaiming He, Qifa Ke, and Jian Sun, Optimized Product Quantization for Approximate Nearest Neighbor Search, in CVPR 2013, IEEE Computer Society, June 2013
Ting Yao, Yuan Liu, Chong-Wah Ngo, and Tao Mei, Unified Entity Search in Social Media Community, in International World-Wide Web Conference (WWW), May 2013
Andrew Cross, Mydhili Bayyapunedi, Edward Cutrell, Anant Agarwal, and William Thies, TypeRighting: Combining the Benefits of Handwriting and Typeface in Online Educational Videos, 29 April 2013
Christopher Smowton, Jacob R. Lorch, David Molnar, Stefan Saroiu, and Alec Wolman, Seamless Customer Identification, no. MSR-TR-2013-31, 14 March 2013