NewsPad is a collaborative news editor designed to empower small communities to write articles collaboratively through: community sourcing, structured stories, and the ability to embed the story anywhere.
Labs: FUSE Labs
Site under construction
We develop novel eye-gaze tracking technologies in order to make eye-gaze tracking technology ubiquitously available for improved natural user interaction (NUI).
ViiBoard uses vision techniques to significantly enhance the user experience on large touch displays (e.g. Microsoft Perceptive Pixels) in two directions: human computer interaction and immersive remote collaboration. the first
3D scanning on portable device is a technology that empower people turn physical objects into high-quality 3D models with the normal RGB camera capturing on mobile device and support for 3D printing. The Skynet UI design aims to enhance user experience to lower the barriers between common consumers and 3D reconstruction.
This presents next-generation webcam hardware and software prototype which captures stereo video and high-accuracy depth images simultaneously in order to support some near-field Kinect scenarios on pc with non-touch screen. Showcases here are finger-controlled windows 8 UI and slingshot game.
Phone-to-Phone Mobile Motion Games (MMG) represent interesting and novel gameplay for ad hoc users in the same location. Seeking to offer Kinect-like experiences using only mobile devices, leading to new mobile gaming experiences. Key technical achievements include development of fast, accurate and robust phone-to-phone distance measurement system, and a 3D phone-to-phone measurement techniques. Several innovative games have been prototyped.
TerminAnt is a conceptual AR game on Windows Phone. This game puts street cars from the real urban environment against virtual ants on mobile screen, the user could simply point mobile device at a source of real-time street traffic, based on GPRS equipped phone’s data and car’s speed motion detection data, to help create the database of dynamic traffic information collection.
Eventful is a system that helps produce news reports by recruiting and guiding remote and locative crowd workers who attend events in person to perform information collection missions. Eventful explores and hopes to problematize the concept of journalism as a service. For initial details please read the short paper below. Full paper coming soon.
Labs: FUSE Labs
FlexStroke is a pen-based input device with a deformable tip that simulates several real paint brush sensations, providing new digital drawing experience for users with both visual and tactile feedback. It is configured as a Chinese brush, an oil brush, and a crayon through changing the jamming tip. This tip has different levels of stiffness based on its jamming structure.
With RoCuModel, common user is able to design a sketchy model from the scratch by hand shaping a tangible curve which can be detected by IR camera in order to generate 3D geometric model file and also directly preview the 3D volumetric image of the model in real before sending to the 3D printer. As a result, to simplify the process of personal fabrication.
We built the Sketch2Cartoon system, which is an automatic cartoon making system. It enables users to sketch major curves of characters and props in their mind, and real-time search results from millions of clipart images could be selected to compose the cartoon images. The selected com- ponents are vectorized and thus could be further edited. By enabling sketch-based input, even a child who is too young to read or write can draw whatever he/she imagines and get interesting cartoon images.
We built the Sketch2Tag system for hand-drawn sketch recognition. Due to large variations presented in hand-drawn sketches, most of existing work was limited to a particular domain or limited pre-defined classes. Different from existing work, Sketch2Tag is a general sketch recognition system, towards recognizing any semantically meaningful object that a child can recognize. This system enables a user to draw a sketch on the query panel, and then provides real-time recognition results.
Conversational systems interact with people through language to assist, enable, or entertain. Research at Microsoft spans dialogs that use language exclusively, or in conjunctions with additional modalities like gesture; where language is spoken or in text; and in a variety of settings, such as conversational systems in apps or devices, and situated interactions in the real world.
Stroke Recovery with Kinect is an interactive rehabilitation system that helps stroke patients improve their upper-limb motor functioning in the comfort of their own home. By using the Microsoft Kinect sensor’s gesture recognition technology, the system recognizes and interprets the user’s movements, assesses their rehabilitation progress, and adjusts the level of difficulty for subsequent therapy sessions.
Ethnographic project to better understand the crowd work ecosystem.
Office Remote turns your Windows Phone into a smart remote for Microsoft Office, providing convenient touch-based control of Word, Excel, and PowerPoint documents projected from your PC. It lets you show what you want, when you want, with all the freedom you need to walk around and connect with your audience.
Crowded: Digital Piecework and the Politics of Platform Responsibility in Precarious Times looks as crowdsourcing as a focal point for many of the issues that are raised by the structure of our current information economy: economic value, cultural meaning, and ethics.
Labs: New England
The Samples of Synthesized Speech
We work on fundamental issues in crowdsourcing, in particular, incentive mechanisms for paid crowdsourcing, algorithms and theory for crowdsourced problem solving.
The LKW project is aimed at designing low-power algorithms and systems for admission control to speech systems: i.e., detecting foreground speech, recognizing leading keywords and verifying speakers on a continuously-on wearable device. Our goal is to consume under 10 mW average on generic embedded hardware available today and under 100uW on custom hardware.
Big Sky is a web service for exploratory data analysis.
Circuit stickers and conductive printing provide an accessible way to rapidly prototype all sorts of electronic circuits. We use a regular inkjet printer to instantly create conductive traces on regular photo paper and combine this with a special type of double-sided tape to stick down electronic sub-circuit elements which we imagine would be sold as a kit for hobbyists, students and researchers.
Prototypes of key-click haptic feedback are being developed with Surface tablet to demonstrate key-click tactile feedback on the Soft Keyboard of Windows8. In order to provide tactile feedback on the touchscreen, a customized piezoelectric bender has been designed and verified on the tablet’s touch screen. The designed piezoelectric benders were tightly integrated with the tablet and synchronized with touch typing on the Software Keyboard.
Our team from Microsoft Research is studying social information seeking behavior.