Extending a mobile device's interaction space through body-centric interaction

Modern mobile devices rely on the screen as a primary input modality. Yet the small screen real-estate limits interaction possibilities, motivating researchers to explore alternate input techniques. Within this arena, our goal is to develop Body-Centric Interaction with Mobile Devices: a class of input techniques that allow a person to position and orient her mobile device to navigate and manipulate digital content anchored in the space on and around the body. To achieve this goal, we explore such interaction in a bottom-up path of prototypes and implementations. From our experiences, as well as by examining related work, we discuss and present three recurring themes that characterize how these interactions can be realized. We illustrate how these themes can inform the design of Body-Centric Interactions by applying them to the design of a novel mobile browser application. Overall, we contribute a class of mobile input techniques where interactions are extended beyond the small screen, and are instead driven by a person's movement of the device on and around the body.

[1]  Alan D. Baddeley,et al.  Developments in the concept of working memory. , 1994 .

[2]  D. Saucier,et al.  Neuropsychology: Clinical and Experimental Foundations , 2020 .

[3]  Joaquim A. Jorge,et al.  Mnemonical Body Shortcuts for Interacting with Mobile Devices , 2007, Gesture Workshop.

[4]  Steve Benford,et al.  A Spatial Model of Interaction in Large Virtual Environments , 1993, ECSCW.

[5]  George W. Fitzmaurice,et al.  Situated information spaces and spatially aware palmtop computers , 1993, CACM.

[6]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[7]  Stephen A. Brewster,et al.  Usable gestures for mobile interfaces: evaluating social acceptability , 2010, CHI.

[8]  Kenton O'Hara,et al.  BISi: a blended interaction space , 2011, CHI EA '11.

[9]  Desney S. Tan,et al.  Skinput: appropriating the body as an input surface , 2010, CHI.

[10]  Desney S. Tan,et al.  The Infocockpit: providing location and place to aid human memory , 2001, PUI '01.

[11]  Maggie Orth,et al.  Smart fabric, or "wearable clothing" , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[12]  Scott R. Klemmer,et al.  Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology , 2011, UIST 2011.

[13]  Desney S. Tan,et al.  Kinesthetic cues aid spatial memory , 2002, CHI Extended Abstracts.

[14]  Desney S. Tan,et al.  Enabling always-available input with muscle-computer interfaces , 2009, UIST '09.

[15]  N. D. Durie,et al.  Digest of papers , 1976 .

[16]  Yoshifumi Kitamura,et al.  Body-centric interaction techniques for very large wall displays , 2010, NordiCHI.

[17]  Tom Rodden,et al.  Proceedings of the 28th International Conference on Human Factors in Computing Systems, CHI 2010, Extended Abstracts Volume, Atlanta, Georgia, USA, April 10-15, 2010 , 2010, CHI Extended Abstracts.

[18]  Nicholas P. Holmes,et al.  The body schema and multisensory representation(s) of peripersonal space , 2004, Cognitive Processing.

[19]  Mary Beth Rosson,et al.  CHI '07 Extended Abstracts on Human Factors in Computing Systems , 2007, CHI 2007.

[20]  Desney S. Tan,et al.  Your noise is my command: sensing gestures using the body as an antenna , 2011, CHI.

[21]  Patrick Baudisch,et al.  Imaginary phone: learning imaginary interfaces by transferring spatial memory from a familiar device , 2011, UIST.

[22]  Sriram Subramanian,et al.  Tilt techniques: investigating the dexterity of wrist-based input , 2009, CHI.

[23]  Dennis R. Wixon,et al.  CHI '02 Extended Abstracts on Human Factors in Computing Systems , 2002, CHI 2002.

[24]  Anthony Tang,et al.  Shadow reaching: a new perspective on interaction for large displays , 2007, UIST.

[25]  Nicolai Marquardt,et al.  The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies , 2011, UIST.

[26]  M. Sile O'Modhrain,et al.  BodySpace: inferring body pose for natural control of a music player , 2007, CHI Extended Abstracts.

[27]  Pattie Maes,et al.  SixthSense: a wearable gestural interface , 2009, SIGGRAPH ASIA Art Gallery & Emerging Technologies.

[28]  Sean Gustafson,et al.  Imaginary interfaces , 2013 .

[29]  Ben Marder,et al.  CHI 2011 Workshop ‘Privacy for a Networked World: Bridging Theory and Design workshop: Proceedings of the 2011 annual conference, extended abstracts on Human factors in computing systems , 2011 .

[30]  Scott P. Robertson,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 1991 .

[31]  Donald A. Norman,et al.  Affordance, conventions, and design , 1999, INTR.

[32]  S. Gandevia,et al.  The kinaesthetic senses , 2009, The Journal of physiology.

[33]  Khai N. Truong,et al.  Virtual shelves: interactions with orientation aware devices , 2009, UIST '09.

[34]  Sriram Subramanian,et al.  Talking about tactile experiences , 2013, CHI.

[35]  Patrick Baudisch,et al.  Imaginary interfaces: spatial interaction with empty hands and without visual feedback , 2010, UIST.

[36]  Ian Oakley,et al.  Body Mnemonics , 2003 .

[37]  Nicolas Courty,et al.  Gesture in Human-Computer Interaction and Simulation , 2006 .