Visual separation in mobile multi-display environments

Projector phones, handheld game consoles and many other mobile devices increasingly include more than one display, and therefore present a new breed of mobile Multi-Display Environments (MDEs) to users. Existing studies illustrate the effects of visual separation between displays in MDEs and suggest interaction techniques that mitigate these effects. Currently, mobile devices with heterogeneous displays such as projector phones are often designed without reference to visual separation issues; therefore it is critical to establish whether concerns and opportunities raised in the existing MDE literature apply to the emerging category of Mobile MDEs (MMDEs). This paper investigates the effects of visual separation in the context of MMDEs and contrasts these with fixed MDE results, and explores design factors for Mobile MDEs. Our study uses a novel eye-tracking methodology for measuring switches in visual context between displays and identifies that MMDEs offer increased design flexibility over traditional MDEs in terms of visual separation. We discuss these results and identify several design implications.

[1]  Desney S. Tan,et al.  Effects of Visual Separation and Physical Discontinuities when Distributing Information across Multiple Displays , 2003, INTERACT.

[2]  Xiaojun Bi,et al.  Effects of interior bezels of tiled-monitor large displays on visual search, tunnel steering, and target selection , 2010, CHI.

[3]  Paul P. Maglio,et al.  On Distinguishing Epistemic from Pragmatic Action , 1994, Cogn. Sci..

[4]  Tsutomu Terada,et al.  A Method for Wearable Projector Selection that Considers the Viewability of Projected Images , 2010, CIE.

[5]  Nicholas Chen,et al.  Navigation techniques for dual-display e-book readers , 2008, CHI.

[6]  Steven K. Feiner,et al.  Multi-monitor mouse , 2005, CHI EA '05.

[7]  Regan L. Mandryk,et al.  Sticky widgets: pseudo-haptic widget enhancements for multi-monitor displays , 2005, CHI Extended Abstracts.

[8]  Lisa G. Cowan,et al.  ShadowPuppets: supporting collocated interaction with mobile projector phones using hand shadows , 2011, CHI.

[9]  Brian P. Bailey,et al.  Put Them Where? Towards Guidelines for Positioning Large Displays in Interactive Workspaces , 2005, INTERACT.

[10]  Takashi Matsumoto,et al.  Z-agon: mobile multi-display browser cube , 2006, CHI Extended Abstracts.

[11]  Daniel J. Wigdor,et al.  Exploring the effects of group size and display configuration on visual search , 2006, CSCW '06.

[12]  Roel Vertegaal,et al.  LookPoint: an evaluation of eye input for hands-free switching of input devices between multiple computers , 2006, OZCHI '06.

[13]  Pattie Maes,et al.  Siftables: towards sensor network user interfaces , 2007, TEI.

[14]  Steven K. Feiner,et al.  Pointer warping in heterogeneous multi-monitor environments , 2007, GI '07.

[15]  Claudio S. Pinhanez,et al.  Applications of Steerable Projector-Camera Systems , 2003 .

[16]  Jonathan Grudin,et al.  Partitioning digital worlds: focal and peripheral awareness in multiple monitor use , 2001, CHI.

[17]  Patrick Baudisch,et al.  Stitching: pen gestures that span multiple displays , 2004, AVI.

[18]  Ravin Balakrishnan,et al.  Codex: a dual screen tablet computer , 2009, CHI.

[19]  Carl Gutwin,et al.  Perspective cursor: perspective-based interaction for multi-display environments , 2006, CHI.

[20]  Patrick Baudisch,et al.  Mouse ether: accelerating the acquisition of targets across multi-monitor displays , 2004, CHI EA '04.

[21]  Chien-Hsiung Chen,et al.  Effects of RSVP display design on visual performance in accomplishing dual tasks with small screens , 2007 .

[22]  Xiang Cao,et al.  LensMouse: augmenting the mouse with an interactive touch display , 2010, CHI.

[23]  Albrecht Schmidt,et al.  Gazemarks: gaze-based visual placeholders to ease attention switching , 2010, CHI.

[24]  Michael Boyle,et al.  PDAs and shared public displays: Making personal information public, and public information personal , 1999, Personal Technologies.

[25]  Barbara Rosario,et al.  Multi-display Composition: Supporting Display Sharing for Collocated Mobile Devices , 2009, INTERACT.

[26]  Alina Hang,et al.  Projector phone: a study of using mobile phones with integrated projector for interaction with maps , 2008, Mobile HCI.

[27]  Jason Alexander,et al.  Offsetting Displays on Mobile Projector Phones , 2010 .

[28]  Xiang Cao,et al.  Multi-user interaction using handheld projectors , 2007, UIST.