We explore grip and motion sensing to afford new techniques that leverage how users naturally manipulate tablet and stylus devices during pen-and-touch interaction. We can detect whether the user holds the pen in a writing grip or tucked between his fingers. We can distinguish bare-handed inputs, such as drag and pinch gestures, from touch gestures produced by the hand holding the pen, and we can sense which hand grips the tablet, and determine the screen's relative orientation to the pen.
EmotoCouch is a furniture prototype that uses lights, changing patterns and haptic feedback to change its appearance and thereby convey emotion. EmotoCouch is built using the Lab of Things platform.
Animated computer graphics are projected onto the base of a fiber optic tree to create a sparse 3D display within the tree. This was done as an entry into Microsoft Research's MakeFest and demonstrated on 1/10/2014 to the MSRMakeFest community.
We present Sparse Reflections Analysis (SRA), an algorithm for removing multipath interference from Time of Flight sensors. SRA allows for very general forms of multipath, including interference with three or more paths, diffuse multipath resulting from Lambertian surfaces, and combinations thereof. SRA removes this general multipath with robust techniques based on L1 optimization. Further, due to a novel dimension reduction, we present a very fast version of SRA, which can run at frame rate.
Labs: ATL Israel
Data compression is essential to large-scale data centers to save both storage and network bandwidth. Current software based method suffers from high computational cost with limited performance. In this project, we are migrating the fundamental workload of the computer system to FPGA accelerator, aiming high throughput performance and high energy efficiency, as well as freeing some CPU resources.
ImDevice stands for Integrated Mobile Devices. ImDevice is based on virtual device driver technology. When a smart phone is connected with a PC, users can control the PC with smart phone (with touch screen and virtual keyboard), and PC software can access smart phone’s sensors just like they are built-in hardwares.
Waypoint project is up and running in Building 99.
Circuit stickers and conductive printing provide an accessible way to rapidly prototype all sorts of electronic circuits. We use a regular inkjet printer to instantly create conductive traces on regular photo paper and combine this with a special type of double-sided tape to stick down electronic sub-circuit elements which we imagine would be sold as a kit for hobbyists, students and researchers.
With proliferation of ubiquitous access to information, the question arises of how distracting processing information can be in social settings, especially during a face-to-face conversation. In this paper, we investigate how much information users can consume during a conversation and what information delivery mode, via audio or visual aids, helps them effectively conceal the fact that they are receiving information.
The great thing about large displays is their size. But their size is also the bad news - in terms of conventional interface design. Conventional UI elements may be too far to conveniently reach, or reach at all. This work is directed at exploring alternative modes of interaction which bring the interaction to the user, rather than the reverse - using various techniques and technologies. Emerging from this are new insights in how to work in natural, appropriate and engaging ways.
The goal of the Physical Analytics project, or Phytics, is to perform analytics on the physical actions of users.
Digits is a wrist-worn sensor that recovers the full 3D pose of the user's hand without requiring any external sensing infrastructure or covering the hand itself (unlike data gloves). The system targets mobile settings and is specifically designed to be low-power and easily reproducible using only off-the-shelf hardware. We demonstrate the utility of Digits for a variety of application scenarios, including 3D gaming and eyes-free interaction on the move.
Building a 6-dof tracker using the Kinect projector.
Windows Phone consumer entertainment app to find 'closest match' celebrity results given a face in a photo. App searches from a pre-built database of celebrity images.
Exploration of Face Recognition application in an Enterprise environment. v1 was completed on Windows Mobile, v2 was completed on Windows Phone. Goal: create a mobile app that allows a user to take a picture of a co-worker, then run a 'facial query' against a face database to return identity and metadata, including name, title, position in org, location of office (highlighted on a map). Also enable creation of content e.g. email, appointments, and follow-up notes with the target.
We exploit the falloff of visual acuity away from the gaze direction in the human visual system for dynamic 3D rendering. Through user studies, we have honed our system parameters and demonstrated the effectiveness of the system. We have also shown the system to bring significant performance increases, or equivalent reductions in hardware and power requirements, in typical 3D rendering applications on existing hardware. Finally, the method is easily integrated into existing 3D applications.
One of the barriers to adoption cloud database technologies such as SQL Azure is data security and privacy. Data is a valuable asset to most organizations and storing the data in the cloud is often perceived as a security risk. This project investigates encryption as a mechanism to address such data security concerns. In particular, the goal of the project is to research, design, and build a comprehensive database system that supports encryption as a first class citizen.
We present AffectAura, an emotional prosthetic that allows users to reflect on their emotional states over long periods of time. We designed a multimodal sensor set-up for continuous logging of audio, visual, physiological and contextual data, a classification scheme for predicting user affective state and an interface for user reflection. The system continuously predicts a user's valence, arousal and engagement, and correlates this with information on events, communications and data i
Farbricate PCBs using a new hobby tool - paper and vinyl CNC cutter.
SideSight expands the multi-touch capabilities of small mobile devices beyond the screen. Infrared sensors embedded along each side of device are capable of detecting the presence and position of fingers within the proximity of the device. When the device is rested on a flat surface, such as a table, the user can carry out single and multi-touch gestures using the space around the device. This gives a larger input space than would otherwise be possible, and which may be used in conjunction with,
This project explores a new technique for optical sensing through thin form-factor displays. It allows for detection of fingers and other physical objects close to or on the display surface. This essentially allows us to turn a regular LCD into a sensing surface that can be used for multi-touch and tangible computing applications. We are interested in both the underlying hardware and software aspects of this approach as well as the interaction techniques and application scenarios it enables.
Seeking to offer Kinect-like experiences using only mobile devices, leading to new mobile gaming experiences. Key technical achievements include development of fast, accurate and robust phone-to-phone distance measurement system, and a 3D phone-to-phone measurement techniques. Several innovative games, including SwordFight, have been prototyped.
3D display is popular more and more. If the webcam can support stereoscopic video capturing. We can use it do 3D web chatting or capturing 3D movie. If we can build a cheap and small Kinect module, we can bring the Kinect experience to mobile scenario. We intend to build a low cost and high resolution of the stereoscopic video capturing Webcam in near distance.
Index serving is always pursuing to serve larger index, which may result in much more traffic on tens of thousands of servers. Besides, the ranking part consumes most of CPU time, and is evolving to deploy more complex models on more features. Our goal is to improve the performance/cost ratio of index serving with the customized hardware.
People are increasingly conscious of their everyday health and wellness conditions, and actively seek to improve them. In this project, we build software and hardware solutions that utilize and/or augment mobile phones to continuously monitor users' wellness without changing their existing lifestyle. Instead of solely passive monitoring, we further explore the actuation possibilities, i.e., seek to leverage the social networks to properly motivate the user towards improved health conditions.