The personal cockpit: a spatial interface for effective task switching on head-worn displays

As wearable computing goes mainstream, we must improve the state of interface design to keep users productive with natural-feeling interactions. We present the Personal Cockpit, a solution for mobile multitasking on head-worn displays. We appropriate empty space around the user to situate virtual windows for use with direct input. Through a design-space exploration, we run a series of user studies to fine-tune our layout of the Personal Cockpit. In our final evaluation, we compare our design against two baseline interfaces for switching between everyday mobile applications. This comparison highlights the deficiencies of current view-fixed displays, as the Personal Cockpit provides a 40% improvement in application switching time. We demonstrate of several useful implementations and a discussion of important problems for future implementation of our design on current and near-future wearable devices.

[1]  George W. Fitzmaurice,et al.  Situated information spaces and spatially aware palmtop computers , 1993, CACM.

[2]  Mark Billinghurst,et al.  A wearable spatial conferencing space , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[3]  Brian P. Bailey,et al.  Put Them Where? Towards Guidelines for Positioning Large Displays in Interactive Workspaces , 2005, INTERACT.

[4]  Mark Billinghurst,et al.  An evaluation of wearable information spaces , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[5]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[6]  Khai N. Truong,et al.  Virtual shelves: interactions with orientation aware devices , 2009, UIST '09.

[7]  qcMIZCV QoKNQ,et al.  Increased Display Size and Resolution Improve Task Performance in Information-Rich Virtual Environments , 2006 .

[8]  Klaus H. Hinrichs,et al.  Touching Floating Objects in Projection-based Virtual Reality Environments , 2010, EGVE/EuroVR/VEC.

[9]  Steven K. Feiner,et al.  Windows on the world: 2D windows for 3D augmented reality , 1993, UIST '93.

[10]  T. Mayer,et al.  Noninvasive measurement of cervical tri-planar motion in normal subjects. , 1993, Spine.

[11]  Chris North,et al.  The effects of peripheral vision and physical navigation on large scale visualization , 2008, Graphics Interface.

[12]  Byron J. Pierce,et al.  Perceptual Issues in the Use of Head-Mounted Visual Displays , 2006, Hum. Factors.

[13]  Xiang Cao,et al.  Interacting with dynamically defined information spaces using a handheld projector and a pen , 2006, UIST.

[14]  Antonio Krüger,et al.  Back to the app: the costs of mobile application interruptions , 2012, Mobile HCI.

[15]  Kori Inkpen Quinn,et al.  My MDE: configuring virtual workspaces in multi-display environments , 2006, CHI EA '06.

[16]  Mary Czerwinski,et al.  The Task Gallery: a 3D window manager , 2000, CHI.

[17]  R Ceci,et al.  A category-ratio perceived exertion scale: relationship to blood and muscle lactates and heart rate. , 1983, Medicine and science in sports and exercise.

[18]  Desney S. Tan,et al.  Women take a wider view , 2002, CHI.

[19]  Desney S. Tan,et al.  Effects of Visual Separation and Physical Discontinuities when Distributing Information across Multiple Displays , 2003, INTERACT.

[20]  David M. Hoffman,et al.  The zone of comfort: Predicting visual discomfort with stereo displays. , 2011, Journal of vision.

[21]  Peter Willemsen,et al.  The effects of head-mounted display mechanical properties and field of view on distance judgments in virtual environments , 2009, TAP.

[22]  Johannes Schöning,et al.  Falling asleep with Angry Birds, Facebook and Kindle: a large scale study on mobile application usage , 2011, Mobile HCI.

[23]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[24]  Katashi Nagao,et al.  The world through the computer: computer augmented interaction with real world environments , 1995, UIST '95.

[25]  Antonio Krüger,et al.  m+pSpaces: virtual workspaces in the spatially-aware mobile environment , 2012, Mobile HCI.

[26]  Carl Gutwin,et al.  Improving Window Switching Interfaces , 2009, INTERACT.

[27]  John T. Stasko,et al.  Lightweight task/application performance using single versus multiple monitors: a comparative study , 2008, Graphics Interface.

[28]  Henry Been-Lirn Duh,et al.  Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment , 2002, Proceedings IEEE Virtual Reality 2002.

[29]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[30]  Ka-Ping Yee,et al.  Peephole displays: pen interaction on spatially aware handheld computers , 2003, CHI '03.

[31]  Chris North,et al.  Evaluation of viewport size and curvature of large, high-resolution displays , 2006, Graphics Interface.

[32]  Xiang Cao,et al.  LensMouse: augmenting the mouse with an interactive touch display , 2010, CHI.

[33]  Steven K. Feiner,et al.  View management for virtual and augmented reality , 2001, UIST '01.

[34]  Steven K. Feiner,et al.  Dynamic space management for user interfaces , 2000, UIST '00.

[35]  Aaron J. Quigley,et al.  The cost of display switching: a comparison of mobile, large display and hybrid UI configurations , 2012, AVI.

[36]  Jonathan Grudin,et al.  Partitioning digital worlds: focal and peripheral awareness in multiple monitor use , 2001, CHI.

[37]  Pourang Irani,et al.  Consumed endurance: a metric to quantify arm fatigue of mid-air interactions , 2014, CHI.

[38]  Jane Yung-jen Hsu,et al.  Touching the void: direct-touch interaction for intangible displays , 2010, CHI.

[39]  David A. Southard,et al.  Head-mounted displays for virtual reality , 1994, Defense, Security, and Sensing.

[40]  Alexander Toet,et al.  Effects of Field-of-View Restrictions on Speed and Accuracy of Manoeuvring , 2007, Perceptual and motor skills.

[41]  Glenn Osga,et al.  Designing for Multi-Tasking Environments: Multiple Monitors vs. Multiple Windows , 1997 .

[42]  Ben Shneiderman,et al.  Direct Manipulation: A Step Beyond Programming Languages , 1983, Computer.