The Eye Gaze keyboard is a project to enable people who are unable to speak or use a physical keyboard to communicate using only their eyes. Our initial prototypes are based around an on screen qwerty keyboard very similar to the 'taptip' keyboard built into Windows 8 which has been extended to response to eye gaze input from a sensor bar like the Tobii EyeX. Our goal is to improve communication speed by 25% compared to experienced users of off the shelf Speech Generating Devices.
Mobile devices are severely battery constrained. While smartphone capabilities have increased manifold in the last ten years, the battery energy density has only doubled. We have been exploring several techniques to improve the battery life of mobile devices towards a vision of having a phone last a week without recharge under normal usage.
The Indoor Patrol Robot is a low cost holonomic-drive enabled robot that can navigate autonomously indoors using just RGB and ultrasonic sensors. The robot leverages the Better Together Framework to allow real-time remote-viewing of the video, and includes a feature to upload photos to OneDrive. The robot can sef-navigate to a charging base, enabling 24/7 maintenance-free operation.
Project Blush explorers the materiality of digital ephemera and people's receptiveness to 'digital jewellery' - exploring the materials and aesthetics that may allow wearables to become jewellables.Project Blush is a research project that originates from the Human Experience and Design group (HXD). HXD specialise in designing and fabricating new human experiences with computing. These play on many different kinds of human values, from amplifying efficiency and effectiveness to creating delight a
We envision using Eye Gaze technology to bring independent mobility to people living with disabilities who are unable to use a joystick.
We explore grip and motion sensing to afford new techniques that leverage how users naturally manipulate tablet and stylus devices during pen-and-touch interaction. We can detect whether the user holds the pen in a writing grip or tucked between his fingers. We can distinguish bare-handed inputs, such as drag and pinch gestures, from touch gestures produced by the hand holding the pen, and we can sense which hand grips the tablet, and determine the screen's relative orientation to the pen.
EmotoCouch is a furniture prototype that uses lights, changing patterns and haptic feedback to change its appearance and thereby convey emotion. EmotoCouch is built using the Lab of Things platform.
Animated computer graphics are projected onto the base of a fiber optic tree to create a sparse 3D display within the tree. This was done as an entry into Microsoft Research's MakeFest and demonstrated on 1/10/2014 to the MSRMakeFest community.
We present Sparse Reflections Analysis (SRA), an algorithm for removing multipath interference from Time of Flight sensors. SRA allows for very general forms of multipath, including interference with three or more paths, diffuse multipath resulting from Lambertian surfaces, and combinations thereof. SRA removes this general multipath with robust techniques based on L1 optimization. Further, due to a novel dimension reduction, we present a very fast version of SRA, which can run at frame rate.
Labs: ATL Israel
Data compression is essential to large-scale data centers to save both storage and network bandwidth. Current software based method suffers from high computational cost with limited performance. In this project, we are migrating the fundamental workload of the computer system to FPGA accelerator, aiming high throughput performance and high energy efficiency, as well as freeing some CPU resources.
ImDevice stands for Integrated Mobile Devices. ImDevice is based on virtual device driver technology. When a smart phone is connected with a PC, users can control the PC with smart phone (with touch screen and virtual keyboard), and PC software can access smart phone’s sensors just like they are built-in hardwares.
Waypoint project is up and running in Building 99.
Circuit stickers and conductive printing provide an accessible way to rapidly prototype all sorts of electronic circuits. We use a regular inkjet printer to instantly create conductive traces on regular photo paper and combine this with a special type of double-sided tape to stick down electronic sub-circuit elements which we imagine would be sold as a kit for hobbyists, students and researchers.
The Windows 8 + Windows Phone Better Together SDK provides 3rd party developers the means to build Windows 8 Store applications that can connect to a Windows Phone and leverage its sensors, display, and touch screen through a peer-to-peer wireless connection. Scenarios include displaying additional info on the phone's screen (second screen scenario), remotely viewing the video and audio stream from the phone's camera/microphone, and using the phone's accelerometer to provide gesture input.
With proliferation of ubiquitous access to information, the question arises of how distracting processing information can be in social settings, especially during a face-to-face conversation. In this paper, we investigate how much information users can consume during a conversation and what information delivery mode, via audio or visual aids, helps them effectively conceal the fact that they are receiving information.
The great thing about large displays is their size. But their size is also the bad news - in terms of conventional interface design. Conventional UI elements may be too far to conveniently reach, or reach at all. This work is directed at exploring alternative modes of interaction which bring the interaction to the user, rather than the reverse - using various techniques and technologies. Emerging from this are new insights in how to work in natural, appropriate and engaging ways.
The goal of the Physical Analytics project, or Phytics, is to perform analytics on the physical actions of users.
Digits is a wrist-worn sensor that recovers the full 3D pose of the user's hand without requiring any external sensing infrastructure or covering the hand itself (unlike data gloves). The system targets mobile settings and is specifically designed to be low-power and easily reproducible using only off-the-shelf hardware. We demonstrate the utility of Digits for a variety of application scenarios, including 3D gaming and eyes-free interaction on the move.
Building a 6-dof tracker using the Kinect projector.
Windows Phone consumer entertainment app to find 'closest match' celebrity results given a face in a photo. App searches from a pre-built database of celebrity images.
Exploration of Face Recognition application in an Enterprise environment. v1 was completed on Windows Mobile, v2 was completed on Windows Phone. Goal: create a mobile app that allows a user to take a picture of a co-worker, then run a 'facial query' against a face database to return identity and metadata, including name, title, position in org, location of office (highlighted on a map). Also enable creation of content e.g. email, appointments, and follow-up notes with the target.
We exploit the falloff of visual acuity away from the gaze direction in the human visual system for dynamic 3D rendering. Through user studies, we have honed our system parameters and demonstrated the effectiveness of the system. We have also shown the system to bring significant performance increases, or equivalent reductions in hardware and power requirements, in typical 3D rendering applications on existing hardware. Finally, the method is easily integrated into existing 3D applications.
One of the barriers to adoption cloud database technologies such as SQL Azure is data security and privacy. Data is a valuable asset to most organizations and storing the data in the cloud is often perceived as a security risk. This project investigates encryption as a mechanism to address such data security concerns. In particular, the goal of the project is to research, design, and build a comprehensive database system that supports encryption as a first class citizen.
We present AffectAura, an emotional prosthetic that allows users to reflect on their emotional states over long periods of time. We designed a multimodal sensor set-up for continuous logging of audio, visual, physiological and contextual data, a classification scheme for predicting user affective state and an interface for user reflection. The system continuously predicts a user's valence, arousal and engagement, and correlates this with information on events, communications and data i
Farbricate PCBs using a new hobby tool - paper and vinyl CNC cutter.