Designing mid-air gesture interaction with mobile devices for older adults

This chapter presents a user-centered perspective on the design of effective mid-air gesture interaction with mobile technology for seniors. Starting from the basic characteristics of mid-air gesture interaction, we introduce the main design challenges of this interaction and report on a case study in which we implemented a user-centered design process focused on the engagement of older adults in each design stage. We present a series of studies in which we aimed at involving older users as active creators of the interaction, taking into account their feedback and values in the design process. Finally, we propose a set of recommendations for the design of mid-air gesture interaction for older adults. These recommendations are elaborated combining research on HCI, ageing and ergonomic principles, and the results from the user studies we conducted in the process.

[1]  Bernabé Linares-Barranco,et al.  An Event-Driven Multi-Kernel Convolution Processor Module for Event-Driven Vision Sensors , 2012, IEEE Journal of Solid-State Circuits.

[2]  Per Ola Kristensson,et al.  Memorability of pre-designed and user-defined gesture sets , 2013, CHI.

[3]  Patrick Langdon,et al.  Physical gestures for abstract concepts: Inclusive design with primary metaphors , 2010, Interact. Comput..

[4]  Lionel Delphin-Poulat,et al.  From a Wizard of Oz experiment to a real time speech and gesture multimodal interface , 2006, Signal Process..

[5]  Regan L. Mandryk,et al.  Full-body motion-based game interaction for older adults , 2012, CHI.

[6]  Manfred Tscheligi,et al.  Evaluating performance and acceptance of older adults using freehand gestures for TV menu control , 2012, EuroITV.

[7]  Jing Chen,et al.  Response–Effect Compatibility Defines the Natural Scrolling Direction , 2013, Hum. Factors.

[8]  Nadia Mana,et al.  Design of Multimodal Interaction with Mobile Devices - Challenges for Visually Impaired and Elderly Users , 2018, VISIGRAPP.

[9]  Henk Eertink,et al.  Touch Versus In-Air Hand Gestures: Evaluating the Acceptance by Seniors of Human-Robot Interaction , 2011, AmI.

[10]  Yang Li,et al.  User-defined motion gestures for mobile interaction , 2011, CHI.

[11]  Regan L. Mandryk,et al.  Is movement better?: comparing sedentary and motion-based game controls for older adults , 2013, Graphics Interface.

[12]  Martin C. Maguire,et al.  Methods to support human-centred design , 2001, Int. J. Hum. Comput. Stud..

[13]  Carl Gutwin,et al.  Air pointing: Design and evaluation of spatial target acquisition with and without visual feedback , 2011, Int. J. Hum. Comput. Stud..

[14]  Viswanath Venkatesh,et al.  Technology Acceptance Model 3 and a Research Agenda on Interventions , 2008, Decis. Sci..

[15]  Dennis Wixon,et al.  The Natural User Interface , 2011 .

[16]  Philip Kortum,et al.  HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces , 2008 .

[17]  Céline Coutrix,et al.  Designing 3D Gesture Guidance: Visual Feedback and Feedforward Design Options , 2016, AVI.

[18]  Paul Green,et al.  The Rapid Development of User Interfaces: Experience with the Wizard of OZ Method , 1985 .

[19]  Daniel Gonçalves,et al.  Evaluation of in-air hand gestures interaction for older people , 2016, Universal Access in the Information Society.

[20]  D. Rempel,et al.  Effects of finger posture on carpal tunnel pressure during wrist motion. , 1998, The Journal of hand surgery.

[21]  Kasper Hornbæk,et al.  Vulture: a mid-air word-gesture keyboard , 2014, CHI.

[22]  Yvonne Rogers,et al.  Does he take sugar?: moving beyond the rhetoric of compassion , 2013, INTR.

[23]  Steve Harrison,et al.  Making epistemological trouble: Third-paradigm HCI as successor science , 2011, Interact. Comput..

[24]  Stephen A. Brewster,et al.  Usable gestures for mobile interfaces: evaluating social acceptability , 2010, CHI.

[25]  Marko Jurmu,et al.  Scroll, tilt or move it: using mobile phones to continuously control pointers on large public displays , 2009, OZCHI.

[26]  Virpi Roto,et al.  User Experience Evaluation Methods in Product Development (UXEM'09) , 2009, INTERACT.

[27]  Thomas B. Moeslund,et al.  A Procedure for Developing Intuitive and Ergonomic Gesture Interfaces for HCI , 2003, Gesture Workshop.

[28]  E B Ryan,et al.  Attitudes toward younger and older adults learning to use computers. , 1992, Journal of gerontology.

[29]  Dietmar Wolfram,et al.  Internet searching, tablet technology and older adults , 2012, ASIST.

[30]  Chris North,et al.  Design and evaluation of freehand menu selection interfaces using tilt and pinch gestures , 2011, Int. J. Hum. Comput. Stud..

[31]  Daniel Rosenberg,et al.  "Will Use It, Because I Want to Look Cool" A Comparative Study of Simple Computer Interactions Using Touchscreen and In-Air Hand Gestures , 2014, HCI.

[32]  J. Gutman.  A Means-End Chain Model Based on Consumer Categorization Processes , 1982 .

[33]  C I HOVLAND,et al.  The effect of verbalization during observation of stimulus objects upon accuracy of recognition and recall. , 1953, Journal of experimental psychology.

[34]  Nadia Mana,et al.  Mobile for older adults: towards designing multimodal interaction , 2015, MUM.

[35]  T. J. Reynolds,et al.  Laddering theory, method, analysis, and interpretation. , 2001 .

[36]  Susanne Bødker,et al.  When second wave HCI meets third wave challenges , 2006, NordiCHI '06.

[37]  Nadia Mana,et al.  Mobile multimodal interaction for older and younger users: exploring differences and similarities , 2017, MUM.

[38]  Pourang Irani,et al.  Consumed endurance: a metric to quantify arm fatigue of mid-air interactions , 2014, CHI.

[39]  Faustina Hwang,et al.  How Do Novice Older Users Evaluate and Perform Mid-Air Gesture Interaction for the First Time? , 2016, NordiCHI.

[40]  Elise van den Hoven,et al.  Crossing the bridge over Norman's Gulf of Execution: revealing feedforward's true identity , 2013, CHI.