HeadPhones: Ad Hoc Mobile Multi-Display Environments through Head Tracking

We present HeadPhones (Headtracking + smartPhones), a novel approach for the spatial registration of multiple mobile devices into an ad hoc multi-display environment. We propose to employ the user's head as external reference frame for the registration of multiple mobile devices into a common coordinate system. Our approach allows for dynamic repositioning of devices during runtime without the need for external infrastructure such as separate cameras or fiducials. Specifically, our only requirements are local network connections and mobile devices with built-in front facing cameras. This way, HeadPhones enables spatially-aware multi-display applications in mobile contexts. A user study and accuracy evaluation indicate the feasibility of our approach.

[1]  Hans-Werner Gellersen,et al.  Usability classification for spontaneous device association , 2011, Personal and Ubiquitous Computing.

[2]  Sidney S. Fels,et al.  pCubee: a perspective-corrected handheld cubic display , 2010, CHI.

[3]  Guobin Shen,et al.  BeepBeep: a high accuracy acoustic ranging system using COTS mobile devices , 2007, SenSys '07.

[4]  David Chu,et al.  SwordFight: Exploring Phone-to-Phone Motion Games , 2012, IEEE Pervasive Computing.

[5]  Simon Lucey,et al.  Face alignment through subspace constrained mean-shifts , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[6]  Ming Li,et al.  Ad-Hoc Multi-Displays for Mobile Interactive Applications , 2010, Eurographics.

[7]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[8]  Patrick Baudisch,et al.  Stitching: pen gestures that span multiple displays , 2004, AVI.

[9]  Yvonne Rogers,et al.  HuddleLamp: Spatially-Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration , 2014, ITS '14.

[10]  Pei Zhang,et al.  Headio: zero-configured heading acquisition for indoor mobile devices through multimodal context sensing , 2013, UbiComp.

[11]  Kent Lyons,et al.  Corona: Positioning Adjacent Device with Asymmetric Bluetooth Low Energy RSSI Distributions , 2015, UIST.

[12]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[13]  Abigail Sellen,et al.  Toward compound navigation tasks on mobiles via spatial manipulation , 2013, MobileHCI '13.

[14]  Ming Li,et al.  Dynamic tiling display: building an interactive display surface using multiple mobile devices , 2012, MUM.

[15]  Jesper Kjeldskov,et al.  JuxtaPinch: an application for collocated multi-device photo sharing , 2014, MobileHCI '14.

[16]  Stephen A. Brewster,et al.  Usable gestures for mobile interfaces: evaluating social acceptability , 2010, CHI.

[17]  Khai N. Truong,et al.  Determining the orientation of proximate mobile devices using their back facing camera , 2012, CHI.

[18]  Andrew Wilson,et al.  Phone as a pixel: enabling ad-hoc, large-scale displays using mobile devices , 2012, CHI.

[19]  Dieter Schmalstieg,et al.  GlassHands: Interaction Around Unmodified Mobile Devices Using Sunglasses , 2016, ISS.

[20]  Kasper Hornbæk,et al.  Tracko: Ad-hoc Mobile 3D Tracking Using Bluetooth Low Energy and Inaudible Signals for Cross-Device Interaction , 2015, UIST.

[21]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Jens Grubert,et al.  Challenges in mobile multi-device ecosystems , 2016, mUX: The Journal of Mobile User Experience.