Our research
Content type
+
Downloads (441)
+
Events (396)
 
Groups (150)
+
News (2593)
 
People (803)
 
Projects (1066)
+
Publications (12000)
+
Videos (5237)
Labs
Research areas
Algorithms and theory47205 (58)
Communication and collaboration47188 (57)
Computational linguistics47189 (8)
Computational sciences47190 (69)
Computer systems and networking47191 (111)
Computer vision208594 (17)
Data mining and data management208595 (7)
Economics and computation47192 (24)
Education47193 (81)
Gaming47194 (21)
Graphics and multimedia47195 (62)
Hardware and devices47196 (62)
Health and well-being47197 (28)
Human-computer interaction47198 (146)
Machine learning and intelligence47200 (79)
Mobile computing208596 (9)
Quantum computing208597 (15)
Search, information retrieval, and knowledge management47199 (61)
Security and privacy47202 (24)
Social media208598 (5)
Social sciences47203 (37)
Software development, programming principles, tools, and languages47204 (30)
Speech recognition, synthesis, and dialog systems208599 (5)
Technology for emerging markets208600 (2)
1–25 of 146
Sort
Show 25 | 50 | 100
123456Next 
Sensing Techniques for Tablet+Stylus Interaction We explore grip and motion sensing to afford new techniques that leverage how users naturally manipulate tablet and stylus devices during pen + touch interaction. We can detect whether the user holds the pen in a writing grip or tucked between his fingers. We can distinguish bare-handed inputs, such as drag and pinch gestures produced by the non-preferred hand, from touch gestures produced by the hand holding the pen, which necessarily impart a detectable motion signal to the stylus. We can sense which...
Video details
Date: 5 October 2014
Duration: 00:04:21
Publisher: Microsoft
3D-Board: A Whole-body Remote Collaborative WhiteboardIntroducing 3D-Board, a digital whiteboard capable of capturing life-sized virtual embodiments of geographically distributed users. When using large-scale screens for remote collaboration, awareness for the distributed users' gestures and actions is of particular importance. Our work adds to the literature on remote collaborative workspaces, it facilitates intuitive remote collaboration on large-scale, interactive whiteboards by preserving awareness of the full-body pose and gestures of the remote...
Video details
Date: 5 October 2014
Duration: 00:02:18
Publisher: Microsoft
Sensing Techniques for Tablet+Stylus Interaction (short)​We explore grip and motion sensing to afford new techniques that leverage how users naturally manipulate tablet and stylus devices during pen + touch interaction. We can detect whether the user holds the pen in a writing grip or tucked between his fingers. We can distinguish bare-handed inputs, such as drag and pinch gestures produced by the non-preferred hand, from touch gestures produced by the hand holding the pen, which necessarily impart a detectable motion signal to the stylus. We can sense which...
Video details
Date: 5 October 2014
Duration: 00:00:28
Publisher: Microsoft
RichReview: Blending Ink, Speech, and Gesture to Support Collaborative Document ReviewThis paper introduces a novel document annotation system that aims to enable the kinds of rich communication that usually only occur in face-to-face meetings. Our system, RichReview, lets users create annotations on top of digital documents using three main modalities: freeform inking, voice for narration, and deictic gestures in support of voice. RichReview uses novel visual representations and time-synchronization between modalities to simplify annotation access and navigation. Moreover, RichReview’s...
Video details
Date: 5 October 2014
Duration: 00:03:02
Publisher: Microsoft
On RoomAlive and Augmented RealityIn an excerpt from his Microsoft Research Luminaries interview, Senior Researcher Hrvoje Benko discusses the goals of Project RoomAlive and his vision of augmented reality.
Video details
Date: 5 October 2014
Duration: 00:01:03
Publisher: Microsoft
Hrvoje Benko on what inspires himIn an excerpt from his Microsoft Research Luminaries interview, Senior Researcher Hrvoje Benko discusses his inspiration.
Video details
Date: 5 October 2014
Duration: 00:00:38
Publisher: Microsoft
In-Air Gestures Around Unmodified Mobile DevicesIn research led by ETH-Zurich, we present a novel machine learning based algorithm extending the interaction space around mobile devices. The technique uses only the RGB camera now commonplace on off-the-shelf mobile devices. Our algorithm robustly recognizes a wide range of in-air gestures, supporting user variation, and varying lighting conditions. We demonstrate that our algorithm runs in real-time on unmodified mobile devices, including resource-constrained smartphones and smartwatches. Our goal is not...
Video details
Date: 5 October 2014
Duration: 00:03:41
Publisher: Microsoft
LightRing: Always-Available 2D Input on Any SurfaceWe present LightRing, a wearable sensor in a ring form factor that senses the 2D location of a fingertip on any surface, independent of orientation or material. The device consists of an infrared proximity sensor for measuring finger flexion and a 1-axis gyroscope for measuring finger rotation. Notably, LightRing tracks subtle fingertip movements from the finger base without requiring instrumentation of other body parts or the environment. This keeps the normal hand function intact and allows for a...
Video details
Date: 5 October 2014
Duration: 00:03:57
Publisher: Microsoft
Dyadic Projected Spatial Augmented RealityMano-a-Mano is a unique spatial augmented reality system that combines dynamic projection mapping, multiple perspective views and device-less interaction to support face to face, or dyadic, interaction with 3D virtual objects. Its main advantage over more traditional AR approaches, such as handheld devices with composited graphics or seethrough head worn displays, is that users are able to interact with 3D virtual objects and each other without cumbersome devices that obstruct face to face interaction. We...
Video details
Date: 5 October 2014
Duration: 00:05:17
Publisher: Microsoft
RoomAlive: Magical Experiences Enabled by Scalable, Adaptive Projector-Camera UnitsRoomAlive is a proof-of-concept prototype that transforms any room into an immersive, augmented entertainment experience. Our system enables new interactive projection mapping experiences that dynamically adapts content to any room. Users can touch, shoot, stomp, dodge and steer projected content that seamlessly co-exists with their existing physical environment. The basic building blocks of RoomAlive are projector-depth camera units, which can be combined through a scalable, distributed framework. The...
Video details
Date: 5 October 2014
Duration: 00:03:19
Publisher: Microsoft
FlexSense: A Transparent Self-Sensing Deformable SurfaceWe present FlexSense, a new thin-film, transparent sensing surface based on printed piezoelectric sensors, which can reconstruct complex deformations without the need for any external sensing, such as cameras. Done in collaboration with Media Interaction Lab, Hagenberg, Austria, and the Institute of Surface Technologies and Photonics, Joanneum Research, FlexSense provides a fully self-contained setup which improves mobility and is not affected from occlusions. Using only a sparse set of sensors, printed...
Video details
Date: 5 October 2014
Duration: 00:04:24
Publisher: Microsoft
Research as a showcase for what is possibleIn an excerpt from his Microsoft Research Luminaries interview, Senior Researcher Hrvoje Benko comments on the role of research.
Video details
Date: 5 October 2014
Duration: 00:00:46
Publisher: Microsoft
Handpose: Fully Articulated Hand TrackingIntroducing a new real-time articulated hand tracker which can enable new possibilities for human-computer interaction (HCI). Our system accurately reconstructs complex hand poses across a variety of subjects using only a single depth camera. It also allows for a high-degree of robustness, continually recovering from tracking failures. However, the most unique aspect of our tracker is its flexibility in terms of camera placement and operating range.​Please note, we are using a standard Xbox One Kinect...
Video details
Date: 3 October 2014
Duration: 00:02:29
Publisher: Microsoft
Contributions to SIGGRAPH 2014A brief visual representation of Microsoft Research's contributions to SIGGRAPH 2014.
Video details
Date: 11 August 2014
Duration: 00:01:35
Publisher: Microsoft
Real-Time Non-Rigid Reconstruction Using an RGB-D CameraAmong Microsoft Research's contributions to SIGGRAPH 2014, a combined hardware and software solution for markerless reconstruction of non-rigidly deforming physical objects with arbitrary shape in real-time. Our system uses a single self-contained stereo camera unit built from off-the-shelf components and consumer graphics hardware to generate spatio-temporally coherent 3D models at 30 Hz. A new stereo matching algorithm estimates real-time RGB-D data. The system is an order of magnitude faster than...
Video details
Date: 11 August 2014
Duration: 00:06:45
Publisher: Microsoft
Haptic Feedback at the FingertipsPresenting fingertip haptics: touch feedback on flat keyboards and touchscreens. Imagine feeling key clicks while typing on a Touch Cover or a Windows Phone, and locating a tile on a touchscreen through its unique tactile texture. Such effects are realized with piezoelectric actuators and electrostatic haptics technology.
Video details
Date: 5 August 2014
Duration: 00:03:59
Publisher: Microsoft
Arjmand Samuel, Buz Chmielewski, and Nilanjan Banerjee
New Hope for People Living with ParalysisLearn how Nilanjan Banerjee from the University of Maryland, BaltimoreCounty, uses the Lab of Things as the platform to interconnect wearable sensorslike gloves, headbands, and capacitive sensors built into clothing, bedsheets,and wheelchair pads. These sensors capture/monitor subtle motions such asfinger twitching, lower arm rotation, and head movements among paralysispatients, with the ultimate goal of providing these individuals the ability tocontrol appliances in caregiving and home settings.
Video details
Date: 10 July 2014
Duration: 00:01:58
Collection: Faculty Summit 2014
Publisher: Microsoft
KrishiPustak: A social networking system for low-literate farmersWith the wide penetration of mobile internet, social networking systems are becoming increasingly popular in the developing world. However, most social networking sites are text heavy, and are therefore unusable by low-literate populations. KrishiPustak is a research and design investigation that explores what a social networking application for low-literate users would look like and how it might be used. We designed and deployed KrishiPustak, a prototype audio-visual mobile application for low-literate...
Video details
Date: 30 May 2014
Duration: 00:05:34
Publisher: ACM – Association for Computing Machinery
RetroDepth: Visual-based 3-D sensing and interactionWatch a demonstration of RetroDepth, a vision-based system that accurately senses the 3-D silhouettes of hands and other objects as they interact on and above physical surfaces.
Video details
Date: 28 April 2014
Duration: 00:04:47
Publisher: Microsoft
Beyond voice recognition: Windows PhoneCortana, the world’s first truly personal digital assistant, is available soon on Windows Phone 8.1. Powered by Bing, Cortana is driven by state-of-the-art algorithms using natural language, machine learning, and contextual signals that benefit from advances incubated at Microsoft Research. This approach uses the massive clickstream-feedback loop of web search, along with additional semantics and data. This approach enables Cortana to grow in breadth of domains that cover the web: from the more common...
Video details
Date: 17 April 2014
Duration: 00:01:53
Collection: TechFair 2014
Publisher: Microsoft
Floating Display: Visual Cues for Gestural InteractionsMany people are working on near-field user-interface devices that detect hover, gesture, and pose. But there is nothing in the space in front of a device to show the user what to do. This project introduces a floating display that hovers over the device, providing visual cues for gestural interactions.
Video details
Date: 17 April 2014
Duration: 00:02:42
Collection: TechFair 2014
Publisher: Microsoft
Printing Interactivity: Customizable 3-D PrintingPresenting two new technologies that empower consumers to design and produce working physical devices customized to their particular needs: A highly interactive, touch-first 3-D printing app makes 3-D modeling accessible to a broad range of consumers. It uses the 3-D printer support in Windows 8.1 and adds an intuitive, block-based editor. A technique enabling users to create working interactive devices cheaply and easily, based on recent advances in conductive inks coupled with a new type of modular...
Video details
Date: 17 April 2014
Duration: 00:04:38
Collection: TechFair 2014
Publisher: Microsoft
Holograph: 3-D spatiotemporal interactive data visualizationHolograph is an interactive, 3-D data-visualization research platform that can render static and dynamic data above or below the plane of the display using a variety of 3-D stereographic techniques. The platform enables rapid exploration, selection, and manipulation of complex, multidimensional data to create and refine natural user-interaction techniques and technologies, with the goal of empowering everyone to understand the growing tide of large, complex data sets.
Video details
Date: 17 April 2014
Duration: 00:02:55
Collection: TechFair 2014
Publisher: Microsoft
Immersive, Collaborative Data VisualizationThis project uses head-mounted displays, Kinect skeletal tracking, a custom hardware controller, and a large display for the public to watch vicariously. Individuals enter a virtual-reality environment created using the WorldWide Telescope and navigate through a virtual 3-D universe in orbit with the International Space Station—or inside a brain cell. The system delivers the capability for an external audience to watch avatars of the individuals exploring the environment and monitor their progress, while...
Video details
Date: 17 April 2014
Duration: 00:03:32
Publisher: Microsoft
SurroundWeb: Spreading the Web to Multiple ScreensProjectors, tablets, and other devices, combined with depth cameras, enable applications to span multiple 'screens.' This work enables webpages to be experienced outside of your PC monitors to take advantage of all your devices in concert. For example, a karaoke webpage could use your phone, tablet, big-screen television, and projectors to provide an awesome entertainment experience. Webpages also are enabled to “see” objects in the room and respond to them -- all while preserving privacy from the owner of...
Video details
Date: 17 April 2014
Duration: 00:03:04
Collection: TechFair 2014
Publisher: Microsoft
1–25 of 146
Sort
Show 25 | 50 | 100
123456Next 
> Our research