Stroke Recovery with Kinect is an interactive rehabilitation system that helps stroke patients improve their upper-limb motor functioning in the comfort of their own home. By using the Microsoft Kinect sensor’s gesture recognition technology, the system recognizes and interprets the user’s movements, assesses their rehabilitation progress, and adjusts the level of difficulty for subsequent therapy sessions.
Ethnographic project to better understand the crowd work ecosystem.
Office Remote turns your Windows Phone into a smart remote for Microsoft Office, providing convenient touch-based control of Word, Excel, and PowerPoint documents projected from your PC. It lets you show what you want, when you want, with all the freedom you need to walk around and connect with your audience.
Crowded: Digital Piecework and the Politics of Platform Responsibility in Precarious Times looks as crowdsourcing as a focal point for many of the issues that are raised by the structure of our current information economy: economic value, cultural meaning, and ethics.
Labs: New England
The Samples of Synthesized Speech
We work on fundamental issues in crowdsourcing, in particular, incentive mechanisms for paid crowdsourcing, algorithms and theory for crowdsourced problem solving.
The LKW project is aimed at designing low-power algorithms and systems for admission control to speech systems: i.e., detecting foreground speech, recognizing leading keywords and verifying speakers on a continuously-on wearable device. Our goal is to consume under 10 mW average on generic embedded hardware available today and under 100uW on custom hardware.
Big Sky is a web service for exploratory data analysis.
Circuit stickers and conductive printing provide an accessible way to rapidly prototype all sorts of electronic circuits. We use a regular inkjet printer to instantly create conductive traces on regular photo paper and combine this with a special type of double-sided tape to stick down electronic sub-circuit elements which we imagine would be sold as a kit for hobbyists, students and researchers.
Prototypes of key-click haptic feedback are being developed with Surface tablet to demonstrate key-click tactile feedback on the Soft Keyboard of Windows8. In order to provide tactile feedback on the touchscreen, a customized piezoelectric bender has been designed and verified on the tablet’s touch screen. The designed piezoelectric benders were tightly integrated with the tablet and synchronized with touch typing on the Software Keyboard.
Our team from Microsoft Research is studying social information seeking behavior.
AskyBot is part of a Microsoft Research project about understanding people's motivations and satisfaction when they ask questions using Twitter hashtags.
The goal of the Spin project is to enable users to capture photorealistic 3D models of objects using just an ordinary camera -- with no special lighting, sensors, or other equipment. Our approach works equally well for a mobile phone, a point-and-shoot camera, or a digital SLR camera. The results can be shared and viewed on a phone, in a web browser, or in a desktop application.
Microsoft Research is looking for grandparents and grandchildren who regularly use Skype to help us understand how grandparents and grandchildren interact using video technology. If you have any questions regarding this study, please feel free to send email to email@example.com.
Microsoft Research is looking for parents of children with a chronic health condition to fill out a 10-minute survey with questions on how their child stays in touch with friends when they are away from friends because of various factors from their illness. In addition, they also ask that the child fill out a 10-minute survey on their experiences of staying in touch with their friends.
This project focuses on rural government maternal health workers in India (called Accredited Social Health Activists, or ASHAs), using a tool called ASHA Assist to help ASHAs engage their clients in persuasive discussions about various topics related to maternal health. ASHA Assist consists of interactive videos on mobile phones, covering topics related to maternal health for use in counseling their clients.
Spoken language understanding (SLU) is an emerging field in between the areas of speech processing and natural language processing. The term spoken language understanding has largely been coined for targeted understanding of human speech directed at machines. This project covers our research on SLU tasks such as domain detection, intent determination, and slot filling, using data-driven methods.
With proliferation of ubiquitous access to information, the question arises of how distracting processing information can be in social settings, especially during a face-to-face conversation. In this paper, we investigate how much information users can consume during a conversation and what information delivery mode, via audio or visual aids, helps them effectively conceal the fact that they are receiving information.
Data is all the buzz. It's being seen in everything and found everywhere. But what are the consequences of this vision of a data-rich world for those of us on the street; what impact if any does it have on our everyday experiences and with the things that matter most to us. Here, we aim to reflect on the rise of (big) data and investigate what it does mean for us, and what it could come to mean.
We investigate how people's behaviour online can be characterized in terms of psychometric measurements such as the Big-5 personality traits openness, conscientiousness, extraversion, agreeableness, and neuroticism as well as general intelligence and satisfaction-with-life. We investigate patterns of Facebook usage, website preferences, query logs, and Facebook Likes and look for interesting correlations which can be used to predict users behaviours, preferences or characteristics.
In order to render a high quality, versatile 3D talking head, a stable, high frame rate AV data acquisition system is constructed. It can capture 3D position, surface orientation and albedo texture of the talking head video images along with the corresponding speech signals.
We propose a new photo-realistic, voice driven only (i.e. no linguistic info of the voice input is needed) talking head.
We conducted a study comparing avatar conferencing with video and audio conferencing for work scenarios. We studied nine four-person teams using a within-subjects design that measured users’ perceptions and preferences across the three conferencing conditions.
People sometimes miss small parts of meetings and need to quickly catch up without disrupting the rest of the meeting. We developed an Accelerated Instant Replay (AIR) Conferencing system for videoconferencing that enables users to catch up on missed content while the meeting is ongoing. AIR can replay parts of the conference using four different modalities: audio, video, conversation transcript, and shared workspace.
In recent years the Web has evolved substantially, transforming from a place where we primarily find information to a place where we also leave, share and keep it. This presents a fresh set of challenges for the management of personal information, which include how to underpin greater awareness and more control over digital belongings and other personally meaningful content that is hosted online.