Computer Aided Language Learning (CALL)
NewsPad is a collaborative news editor designed to empower small communities to write articles collaboratively through: community sourcing, structured stories, and the ability to embed the story anywhere.
Labs: FUSE Labs
Site under construction
We develop novel eye-gaze tracking technologies in order to make eye-gaze tracking technology ubiquitously available for improved natural user interaction (NUI).
ViiBoard uses vision techniques to significantly enhance the user experience on large touch displays (e.g. Microsoft Perceptive Pixels) in two directions: human computer interaction and immersive remote collaboration. the first
Eventful is a system that helps produce news reports by recruiting and guiding remote and locative crowd workers who attend events in person to perform information collection missions. Eventful explores and hopes to problematize the concept of journalism as a service. For initial details please read the short paper below. Full paper coming soon.
Labs: FUSE Labs
We built the Sketch2Cartoon system, which is an automatic cartoon making system. It enables users to sketch major curves of characters and props in their mind, and real-time search results from millions of clipart images could be selected to compose the cartoon images. The selected com- ponents are vectorized and thus could be further edited. By enabling sketch-based input, even a child who is too young to read or write can draw whatever he/she imagines and get interesting cartoon images.
We built the Sketch2Tag system for hand-drawn sketch recognition. Due to large variations presented in hand-drawn sketches, most of existing work was limited to a particular domain or limited pre-defined classes. Different from existing work, Sketch2Tag is a general sketch recognition system, towards recognizing any semantically meaningful object that a child can recognize. This system enables a user to draw a sketch on the query panel, and then provides real-time recognition results.
Conversational systems interact with people through language to assist, enable, or entertain. Research at Microsoft spans dialogs that use language exclusively, or in conjunctions with additional modalities like gesture; where language is spoken or in text; and in a variety of settings, such as conversational systems in apps or devices, and situated interactions in the real world.
Stroke Recovery with Kinect is an interactive rehabilitation system that helps stroke patients improve their upper-limb motor functioning in the comfort of their own home. By using the Microsoft Kinect sensor’s gesture recognition technology, the system recognizes and interprets the user’s movements, assesses their rehabilitation progress, and adjusts the level of difficulty for subsequent therapy sessions.
Ethnographic project to better understand the crowd work ecosystem.
Office Remote turns your Windows Phone into a smart remote for Microsoft Office, providing convenient touch-based control of Word, Excel, and PowerPoint documents projected from your PC. It lets you show what you want, when you want, with all the freedom you need to walk around and connect with your audience.
Crowded: Digital Piecework and the Politics of Platform Responsibility in Precarious Times looks as crowdsourcing as a focal point for many of the issues that are raised by the structure of our current information economy: economic value, cultural meaning, and ethics.
Labs: New England
The Samples of Synthesized Speech
We work on fundamental issues in crowdsourcing, in particular, incentive mechanisms for paid crowdsourcing, algorithms and theory for crowdsourced problem solving.
The LKW project is aimed at designing low-power algorithms and systems for admission control to speech systems: i.e., detecting foreground speech, recognizing leading keywords and verifying speakers on a continuously-on wearable device. Our goal is to consume under 10 mW average on generic embedded hardware available today and under 100uW on custom hardware.
Big Sky is a web service for exploratory data analysis.
Circuit stickers and conductive printing provide an accessible way to rapidly prototype all sorts of electronic circuits. We use a regular inkjet printer to instantly create conductive traces on regular photo paper and combine this with a special type of double-sided tape to stick down electronic sub-circuit elements which we imagine would be sold as a kit for hobbyists, students and researchers.
Prototypes of key-click haptic feedback are being developed with Surface tablet to demonstrate key-click tactile feedback on the Soft Keyboard of Windows8. In order to provide tactile feedback on the touchscreen, a customized piezoelectric bender has been designed and verified on the tablet’s touch screen. The designed piezoelectric benders were tightly integrated with the tablet and synchronized with touch typing on the Software Keyboard.
Our team from Microsoft Research is studying social information seeking behavior.
AskyBot is part of a Microsoft Research project about understanding people's motivations and satisfaction when they ask questions using Twitter hashtags.
The goal of the Spin project is to enable users to capture photorealistic 3D models of objects using just an ordinary camera -- with no special lighting, sensors, or other equipment. Our approach works equally well for a mobile phone, a point-and-shoot camera, or a digital SLR camera. The results can be shared and viewed on a phone, in a web browser, or in a desktop application.
Microsoft Research is looking for grandparents and grandchildren who regularly use Skype to help us understand how grandparents and grandchildren interact using video technology. If you have any questions regarding this study, please feel free to send email to email@example.com.
Microsoft Research is looking for parents of children with a chronic health condition to fill out a 10-minute survey with questions on how their child stays in touch with friends when they are away from friends because of various factors from their illness. In addition, they also ask that the child fill out a 10-minute survey on their experiences of staying in touch with their friends.
This project focuses on rural government maternal health workers in India (called Accredited Social Health Activists, or ASHAs), using a tool called ASHA Assist to help ASHAs engage their clients in persuasive discussions about various topics related to maternal health. ASHA Assist consists of interactive videos on mobile phones, covering topics related to maternal health for use in counseling their clients.