Ease of juggling: studying the effects of manual multitasking

Everyday activities often involve using an interactive device while one is handling various other physical objects (wallets, bags, doors, pens, mugs, etc.). This paper presents the Manual Multitasking Test, a test with 12 conditions emulating manual demands of everyday multitasking situations. It allows experimenters to expose the effects of design on "manual flexibility": users' ability to reconfigure the sensorimotor control of arms, hands, and fingers in order to regain the high performance levels they experience when using the device on its own. The test was deployed for pointing devices on laptops and Qwerty keyboards of mobile devices. In these studies, we identified facilitative design features whose absence explains, for example, why the mouse and stylus function poorly in multi-object performance. The issue deserves more attention, because interfaces that are nominally similar (e.g., "one-handed input") can vary dramatically in terms of "ease of juggling".

[1]  Shumin Zhai,et al.  Manual and cognitive benefits of two-handed input: an experimental study , 1998, TCHI.

[2]  Stephen A. Brewster,et al.  Designing audio and tactile crossmodal icons for mobile devices , 2007, ICMI '07.

[3]  Holger Kenn,et al.  Designing a wearable user interface for hands-free interaction in maintenance applications , 2006, Fourth Annual IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOMW'06).

[4]  Stephen A. Brewster,et al.  Wrist rotation for interaction in mobile contexts , 2008, Mobile HCI.

[5]  Alan M Jette,et al.  Late Life Function and Disability Instrument: II. Development and evaluation of the function component. , 2002, The journals of gerontology. Series A, Biological sciences and medical sciences.

[6]  A. Landi Human Hand Function , 2007 .

[7]  Kees C. J. Overbeeke,et al.  A natural human hand model , 2007, The Visual Computer.

[8]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[9]  Scott D. Mainwaring,et al.  Living for the Global City: Mobile Kits, Urban Interfaces, and Ubicomp , 2005, UbiComp.

[10]  Karel Brookhuis,et al.  Handbook of Human Factors and Ergonomics Methods , 2009 .

[11]  Ian Oakley,et al.  Pointing with fingers, hands and arms for wearable computing , 2008, CHI Extended Abstracts.

[12]  Joanna Bergstrom-Lehtovirta,et al.  A simple index for multimodal flexibility , 2010, CHI.

[13]  I. Scott MacKenzie,et al.  Phrase sets for evaluating text entry techniques , 2003, CHI Extended Abstracts.

[14]  Yung-Hui Lee,et al.  Design and validation of a desk-free and posture-independent input device. , 2008, Applied ergonomics.

[15]  Johanna I Westbrook,et al.  All in a day's work: an observational study to quantify how and with whom doctors on hospital wards spend their time , 2008, The Medical journal of Australia.

[16]  Antti Oulasvirta,et al.  Understanding mobile contexts , 2003, Personal and Ubiquitous Computing.

[17]  Poika Isokoski,et al.  Effect of foreign language on text transcription performance: Finns writing English , 2004, NordiCHI '04.

[18]  L. Jones,et al.  Contribution of tactile feedback from the hand to the perception of force , 2005, Experimental Brain Research.

[19]  Shumin Zhai,et al.  The influence of muscle groups on performance of multiple degree-of-freedom input , 1996, CHI.

[20]  Kent Lyons,et al.  Twiddler typing: one-handed chording text entry for mobile phones , 2004, CHI.

[21]  John L. Sibert,et al.  An analysis of the index finger as a pointing device , 1999, CHI Extended Abstracts.

[22]  Chris Schmandt,et al.  Nomadic radio: speech and audio interaction for contextual messaging in nomadic environments , 2000, TCHI.

[23]  I. Scott MacKenzie,et al.  Performance differences in the fingers, wrist, and forearm in computer input control , 1997, CHI.

[24]  Víctor M. González,et al.  "Constant, constant, multi-tasking craziness": managing multiple working spheres , 2004, CHI.

[25]  Y. Guiard Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. , 1987, Journal of motor behavior.

[26]  Loukia D. Loukopoulos,et al.  COCKPIT INTERRUPTIONS AND DISTRACTIONS: A LINE OBSERVATION STUDY , 2001 .

[27]  Vincent Hayward,et al.  A role for haptics in mobile interaction: initial design using a handheld tactile display prototype , 2006, CHI.

[28]  James R. Lewis,et al.  Keys and Keyboards , 1997 .

[29]  Ying Liu,et al.  Environment Analysis as a Basis for Designing Multimodal and Multidevice User Interfaces , 2010, Hum. Comput. Interact..