John Vilk, David Molnar, Eyal Ofek, Chris Rossbach, Benjamin Livshits, Alexander Moshchuk, Helen J. Wang, and Ran Gal
We introduce SurroundWeb, the ﬁrst least-privilege platform for immersive room experiences. Sur- roundWeb is a “3D Browser” that gives web pages the ability to display across multiple surfaces in a room, adapt their appearance to objects present in that room, and interact using natural user input. SurroundWeb enables least privilege for these im- mersive web pages by introducing two new abstrac- tions: ﬁrst, a Room Skeleton that enables least priv- ilege for room rendering, unlike previous approaches that focus on inputs alone. Second, a Detection Sandbox that allows web pages to register content to show if an object is detected, but prevents the web server from knowing if the object is present. SurroundWeb provides three privacy properties: de- tection privacy, rendering privacy, and interaction privacy while simultaneously enabling Web pages to use object recognition and room display capabili- ties. Surveys show the information revealed by Sur- roundWeb is acceptable. SurroundWeb is practical: After a one-time setup procedure that scans a room for projectable surfaces in about a minute, our proto- type can render immersive multi-display web rooms at greater than 30 frames per second with up to 25 screens and up to a 1440x720 display. We demon- strate a range of previously proposed and novel expe- riences can be implemented in a least-privilege way using SurroundWeb.