Several studies have demonstrated the need for the world’s food production to double by 2050. However, there is limited amount of additional arable land, and water levels have also been receding at a fast rate. Although technology could help the farmer, its adoption is limited because the farms usually do not have power, or Internet connectivity, and the farmers are typically not technology savvy. We are working towards an end-to-end approach, from sensors to the cloud, to solve the problem.
Room2Room is a life-size telepresence system that leverages projected augmented reality to enable co-present interaction between two remote participants. We enable a face-to-face conversation by performing 3D capture of the local user with color + depth cameras and projecting their virtual copy into the remote space at life-size scale. This creates an illusion of the remote person’s presence in the local space, as well as a shared understanding of verbal and non-verbal cues (e.g., gaze).
BLE Angle of Arrival (AoA) system that can locate a commercial mobile device with high accuracy at distances over a dozen meters.
The amount of digital data produced has long been outpacing the amount of storage available. This project enables molecular-level data storage into DNA molecules by leveraging biotechnology advances in synthesizing, manipulating and sequencing DNA to develop archival storage.
The BBC and partners, including Microsoft, announce the BBC micro:bit – a pocket-sized, codeable computer that allows children to get creative with technology. Up to 1 million micro:bits will be given to every 11 or 12 year old child in Year 7 or equivalent across the UK, for free.
The Eye Gaze keyboard is a project to enable people who are unable to speak or use a physical keyboard to communicate using only their eyes. Our initial prototypes are based around an on screen qwerty keyboard very similar to the 'taptip' keyboard built into Windows 8 which has been extended to response to eye gaze input from a sensor bar like the Tobii EyeX. Our goal is to improve communication speed by 25% compared to experienced users of off the shelf Speech Generating Devices.
Mobile devices such as smartphones, along with other battery operated devices, are energy constrained. While hardware capabilities have increased tremendously over the last ten years, battery energy density has only doubled. In this project we are exploring several techniques to extend the battery life of mobile devices. Our vision is to create a fully-capable phone which runs for a week without recharging under normal usage.
The Indoor Patrol Robot is a low cost holonomic-drive enabled robot that can navigate autonomously indoors using just RGB and ultrasonic sensors. The robot leverages the Better Together Framework to allow real-time remote-viewing of the video, and includes a feature to upload photos to OneDrive. The robot can sef-navigate to a charging base, enabling 24/7 maintenance-free operation.
Project Blush explorers the materiality of digital ephemera and people's receptiveness to 'digital jewellery' - exploring the materials and aesthetics that may allow wearables to become jewellables.Project Blush is a research project that originates from the Human Experience and Design group (HXD). HXD specialise in designing and fabricating new human experiences with computing. These play on many different kinds of human values, from amplifying efficiency and effectiveness to creating delight a
We envision using Eye Gaze technology to bring independent mobility to people living with disabilities who are unable to use a joystick.
We explore grip and motion sensing to afford new techniques that leverage how users naturally manipulate tablet and stylus devices during pen-and-touch interaction. We can detect whether the user holds the pen in a writing grip or tucked between his fingers. We can distinguish bare-handed inputs, such as drag and pinch gestures, from touch gestures produced by the hand holding the pen, and we can sense which hand grips the tablet, and determine the screen's relative orientation to the pen.
EmotoCouch is a furniture prototype that uses lights, changing patterns and haptic feedback to change its appearance and thereby convey emotion. EmotoCouch is built using the Lab of Things platform.
Animated computer graphics are projected onto the base of a fiber optic tree to create a sparse 3D display within the tree. This was done as an entry into Microsoft Research's MakeFest and demonstrated on 1/10/2014 to the MSRMakeFest community.
We present Sparse Reflections Analysis (SRA), an algorithm for removing multipath interference from Time of Flight sensors. SRA allows for very general forms of multipath, including interference with three or more paths, diffuse multipath resulting from Lambertian surfaces, and combinations thereof. SRA removes this general multipath with robust techniques based on L1 optimization. Further, due to a novel dimension reduction, we present a very fast version of SRA, which can run at frame rate.
Labs: ATL Israel
Data compression is essential to large-scale data centers to save both storage and network bandwidth. Current software based method suffers from high computational cost with limited performance. In this project, we are migrating the fundamental workload of the computer system to FPGA accelerator, aiming high throughput performance and high energy efficiency, as well as freeing some CPU resources.
ImDevice stands for Integrated Mobile Devices. ImDevice is based on virtual device driver technology. When a smart phone is connected with a PC, users can control the PC with smart phone (with touch screen and virtual keyboard), and PC software can access smart phone’s sensors just like they are built-in hardwares.
Waypoint is an NFC-tag based indoor geolocation service which explores ultra-low cost deployment. Waypoint was deployed using over 1400 NFC tags across all of MSR's Building 99. The entire deployment, including geo-configuration took less than 20 man-hours.
Circuit stickers and conductive printing provide an accessible way to rapidly prototype all sorts of electronic circuits. We use a regular inkjet printer to instantly create conductive traces on regular photo paper and combine this with a special type of double-sided tape to stick down electronic sub-circuit elements which we imagine would be sold as a kit for hobbyists, students and researchers.
The Windows 8 + Windows Phone Better Together SDK provides 3rd party developers the means to build Windows 8 Store applications that can connect to a Windows Phone and leverage its sensors, display, and touch screen through a peer-to-peer wireless connection. Scenarios include displaying additional info on the phone's screen (second screen scenario), remotely viewing the video and audio stream from the phone's camera/microphone, and using the phone's accelerometer to provide gesture input.
With proliferation of ubiquitous access to information, the question arises of how distracting processing information can be in social settings, especially during a face-to-face conversation. In this paper, we investigate how much information users can consume during a conversation and what information delivery mode, via audio or visual aids, helps them effectively conceal the fact that they are receiving information.
The great thing about large displays is their size. But their size is also the bad news - in terms of conventional interface design. Conventional UI elements may be too far to conveniently reach, or reach at all. This work is directed at exploring alternative modes of interaction which bring the interaction to the user, rather than the reverse - using various techniques and technologies. Emerging from this are new insights in how to work in natural, appropriate and engaging ways.
The goal of the Physical Analytics project, or Phytics, is to perform analytics on the physical actions of users.
Digits is a wrist-worn sensor that recovers the full 3D pose of the user's hand without requiring any external sensing infrastructure or covering the hand itself (unlike data gloves). The system targets mobile settings and is specifically designed to be low-power and easily reproducible using only off-the-shelf hardware. We demonstrate the utility of Digits for a variety of application scenarios, including 3D gaming and eyes-free interaction on the move.
Building a 6-dof tracker using the Kinect projector.
Windows Phone consumer entertainment app to find 'closest match' celebrity results given a face in a photo. App searches from a pre-built database of celebrity images.