Determining the orientation of proximate mobile devices using their back facing camera

Proximate mobile devices that are aware of their orientation relative to one another can support novel and natural forms of interaction. In this paper, we present a method to determine the relative orientation of proximate mobile devices using only the backside camera. We implemented this method as a service called Orienteer, which provides mobile device with the orientation of other proximate mobile devices. We demonstrate that orientation information can be used to enable novel and natural interactions by developing two applications that allow the user to push content in the direction of another device to share it and point the device toward another to filter content based on the device's owner. An informal evaluation revealed that interactions built upon orientation information can be natural and compelling to users, but developers and designers need to carefully consider how orientation should be applied effectively.

[1]  Nicolai Marquardt,et al.  Proxemic interactions: the new ubicomp? , 2011, INTR.

[2]  Shwetak N. Patel,et al.  Location in Ubiquitous Computing , 2010, Ubicomp 2010.

[3]  Bill N. Schilit,et al.  Context-aware computing applications , 1994, Workshop on Mobile Computing Systems and Applications.

[4]  Andreas Butz,et al.  Multi-user interaction on media facades through live video on mobile devices , 2011, CHI.

[5]  Mark W. Newman,et al.  Share and share alike: exploring the user interface affordances of file sharing , 2006, CHI.

[6]  Roy Want,et al.  Bridging physical and virtual worlds with electronic tags , 1999, CHI '99.

[7]  Till Ballendat,et al.  Visualization of and Interaction with Digital Devices around Large Surfaces as a Function of Proxim , 2011 .

[8]  Nicolai Marquardt,et al.  The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies , 2011, UIST.

[9]  Chris Harrison,et al.  Lean and zoom: proximity-aware user interface and content magnification , 2008, CHI.

[10]  Bernt Schiele,et al.  Smart-Its Friends: A Technique for Users to Easily Establish Connections between Smart Artefacts , 2001, UbiComp.

[11]  Gerd Kortuem,et al.  Sensing and visualizing spatial relations of mobile devices , 2005, UIST.

[12]  Andy Hopper,et al.  The active badge location system , 1992, TOIS.

[13]  Andreas Butz,et al.  Touch projector: mobile interaction through video , 2010, CHI.

[14]  Ken Hinckley,et al.  Synchronous gestures for multiple persons and computers , 2003, UIST '03.

[15]  Colin Edward Swindells Use that there! : pointing to establish device identity , 2002 .