In the 40 years since the introduction of the mouse, computing input has remained much the same: it’s you, the mouse, the keyboard, and the screen. But all that is undergoing a sea change, as researchers like Patrick Baudisch of the Hasso Plattner Institute and Shahram Izadi of Microsoft Research Cambridge push the boundaries of natural user interface (NUI).

In this interview during the Microsoft Research Faculty Summit 2012, Patrick and Shahram, along with Microsoft Research’s Stewart Tansley, discuss developments in NUI and their thoughts about a future of ubiquitous computer-human interactions.