Adapting the Navigation Interface of Smart Watches to User Movements

ABSTRACT The high mobility of smart watches can easily impair interaction performance, and many applications are squeezed into an extremely tiny screen, which causes disorientations. Therefore, this study examines the extent of performance impairment caused by user movements and proposes navigation aids to alleviate the impairment. An experiment was conducted among 28 college students to investigate the influence of user movements and navigation aids on users’ performance and subjective feedback. The results indicate that the performance of using smart watches in walking conditions is comparable to that in sitting conditions. However, the use of smart watches while running reduces the success rates of operating, perceived ease of use, perceived usefulness, and flow experience, and it increases subjective cognitive workload. To improve user experience, the effectiveness of providing navigation aids for smart watches is confirmed. Using static navigation aids while sitting and walking and using animated navigation aids while moving can significantly improve users’ perceived ease of use and perceived usefulness and decrease cognitive workload. Based on these results, guidelines for tailoring the interface design of smart watches to user movements through navigation aids are proposed.

[1]  Chris Baber,et al.  Wearable Computers: A Human Factors Review , 2001, Int. J. Hum. Comput. Interact..

[2]  Kori Inkpen Quinn,et al.  Walk 'n scroll: a comparison of software-based navigation techniques for different levels of mobility , 2005, Mobile HCI.

[3]  Stephen A. Brewster,et al.  The effects of walking speed on target acquisition on a touchscreen interface , 2011, Mobile HCI.

[4]  Mark D. Dunlop,et al.  The Challenge of Mobile Devices for Human Computer Interaction , 2002, Personal and Ubiquitous Computing.

[5]  Jacob O. Wobbrock,et al.  The Future of Mobile Device Research in HCI , 2006 .

[6]  Lynda L. McGhie,et al.  World Wide Web , 2011, Encyclopedia of Information Assurance.

[7]  Pei-Luen Patrick Rau,et al.  Playing with multiple wearable devices: Exploring the influence of display, motion and gender , 2015, Comput. Hum. Behav..

[8]  Kai-Christoph Hamborg,et al.  The effect of banner animation on fixation behavior and recall performance in search tasks , 2012, Comput. Hum. Behav..

[9]  Ji Jung Lim,et al.  Visual search on a mobile device while walking , 2012, Mobile HCI.

[10]  F. Paas,et al.  Attention Cueing as a Means to Enhance Learning from an Animation , 2007 .

[11]  Fred Paas,et al.  Making instructional animations more effective: a cognitive load approach , 2007 .

[12]  Alan Chamberlain,et al.  A comparative investigation into two pointing systems for use with wearable computers while mobile , 2004, Eighth International Symposium on Wearable Computers.

[13]  Andrew Sears,et al.  Capturing the effects of context on human performance in mobile computing systems , 2007, Personal and Ubiquitous Computing.

[14]  D. R. Danielson,et al.  How do users evaluate the credibility of Web sites?: a study with over 2,500 participants , 2003, DUX '03.

[15]  Yang Li,et al.  Experimental analysis of touch-screen gesture designs in mobile environments , 2011, CHI.

[16]  Virpi Roto,et al.  Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI , 2005, CHI.

[17]  Jean Vanderdonckt,et al.  Animated transitions between user interface views , 2012, AVI.

[18]  M. Csíkszentmihályi.  Beyond boredom and anxiety , 1975 .

[19]  Greg Foster,et al.  Barrel menu: a new mobile phone menu for feature rich devices , 2011, SAICSIT '11.

[20]  Jacob O. Wobbrock,et al.  WalkType: using accelerometer data to accomodate situational impairments in mobile touch screen text entry , 2012, CHI.

[21]  Ping Zhang,et al.  The Effects of Animation on Information Seeking Performance on the World Wide Web: Securing Attention or Interfering with Primary Tasks? , 2000, J. Assoc. Inf. Syst..

[22]  Fabio Paternò,et al.  Human Computer Interaction with Mobile Devices , 2002, Lecture Notes in Computer Science.

[23]  Jukka Häkkinen,et al.  Examining mobile phone text legibility while walking , 2004, CHI EA '04.

[24]  Mark H. Chignell,et al.  Mobile text entry: relationship between walking speed and text input task difficulty , 2005, Mobile HCI.

[25]  James R. Lewis,et al.  Psychometric Evaluation of the PSSUQ Using Data from Five Years of Usability Studies , 2002, Int. J. Hum. Comput. Interact..

[26]  Andrew Sears,et al.  An empirical comparison of use-in-motion evaluation scenarios for mobile computing devices , 2005, Int. J. Hum. Comput. Stud..

[27]  Fan Mo,et al.  The Influence of Menu Structure and Layout on Usability of Smartwatches , 2018, Int. J. Mob. Hum. Comput. Interact..

[28]  Stephen A. Brewster,et al.  The Effects of Encumbrance and Mobility on Touch-Based Gesture Interactions for Mobile Phones , 2015, MobileHCI.

[29]  Markus Löchtefeld,et al.  A user-specific machine learning approach for improving touch accuracy on mobile devices , 2012, UIST '12.

[30]  Martina Ziefle.  Spatial Cues in Small Screen Devices: Benefit Or Handicap? , 2009, INTERACT.

[31]  Martina Ziefle,et al.  Information presentation in small screen devices: the trade-off between visual density and menu foresight. , 2010, Applied ergonomics.

[32]  Martina Ziefle,et al.  Effects of age, cognitive, and personal factors on PDA menu navigation performance , 2009, Behav. Inf. Technol..

[33]  F. L. van Noort,et al.  Effect of running on throughput in pointing tasks: a Fitts' law experiment , 2015 .

[34]  Jakob Nielsen,et al.  Designing web usability , 1999 .

[35]  David P. Quigley,et al.  Texting while walking: an evaluation of mini-qwerty text input while on-the-go , 2014, MobileHCI '14.

[36]  Thomas Alexander,et al.  Optimal Touch Button Size for the use of Mobile Devices while Walking , 2015 .

[37]  Andrew Sears,et al.  How do people tap when walking? An empirical investigation of nomadic data entry , 2007, Int. J. Hum. Comput. Stud..

[38]  Jinwoo Kim,et al.  Do size and structure matter to mobile users? An empirical study of the effects of screen size, information structure, and task complexity on user activities with standard web phones , 2004, Behav. Inf. Technol..

[39]  Pei-Luen Patrick Rau,et al.  Exploring factors influencing multitasking interaction with multiple smart devices , 2013, Comput. Hum. Behav..

[40]  Stephen A. Brewster,et al.  The Impact of Encumbrance on Mobile Interactions , 2013, INTERACT.

[41]  Jae-Hyeon Ahn,et al.  Attention to Banner Ads and Their Effectiveness: An Eye-Tracking Approach , 2012, Int. J. Electron. Commer..

[42]  Roderick Murray-Smith,et al.  Nomadic Input on Mobile Devices: The Influence of Touch Input Technique and Walking Speed on Performance and Offset Modeling , 2016, Hum. Comput. Interact..

[43]  Elena Karahanna,et al.  Time Flies When You're Having Fun: Cognitive Absorption and Beliefs About Information Technology Usage , 2000, MIS Q..

[44]  Kent Lyons,et al.  Reading on-the-go: a comparison of audio and hand-held displays , 2006, Mobile HCI.

[45]  Benjamin B. Bederson,et al.  Does animation help users build mental maps of spatial information? , 1999, Proceedings 1999 IEEE Symposium on Information Visualization (InfoVis'99).

[46]  Enrico Rukzio,et al.  Investigating selection and reading performance on a mobile phone while walking , 2010, Mobile HCI.

[47]  Sean Hayes,et al.  Tablet Interaction Accuracy and Precision , 2014 .

[48]  Liwen Wang,et al.  Chinese-Based Spearcons: Improving Pedestrian Navigation Performance in Eyes-Free Environment , 2016, Int. J. Hum. Comput. Interact..

[49]  Kang Li,et al.  The impacts of banner format and animation speed on banner effectiveness: Evidence from eye movements , 2016, Comput. Hum. Behav..

[50]  Stephen A. Brewster,et al.  Comparing evaluation methods for encumbrance and walking on interaction with touchscreen mobile devices , 2014, MobileHCI '14.

[51]  Steinar Kristoffersen,et al.  “Making place” to make IT work: empirical explorations of HCI for mobile CSCW , 1999, GROUP.

[52]  Stephen A. Brewster,et al.  A paradigm shift: alternative interaction techniques for use with mobile & wearable devices , 2003, CASCON.

[53]  R. Brislin.  Back-Translation for Cross-Cultural Research , 1970 .

[54]  Stephen A. Brewster,et al.  Gestural and audio metaphors as a means of control for mobile devices , 2002, CHI.

[55]  Daniel Buschek,et al.  User-specific touch models in a cross-device context , 2013, MobileHCI '13.

[56]  Fred D. Davis.  A technology acceptance model for empirically testing new end-user information systems : theory and results , 1985 .

[57]  Carl Gutwin,et al.  Supporting and Exploiting Spatial Memory in User Interfaces , 2013, Found. Trends Hum. Comput. Interact..

[58]  A. Gully.  The Discourse of Arabic Advertising: Preliminary Investigations , 2017 .

[59]  Niels Henze,et al.  RSVP on the go: implicit reading support on smart watches through eye tracking , 2016, SEMWEB.

[60]  Manish Bhardwaj,et al.  Is It Gropable? – Assessing the Impact of Mobility on Textile Interfaces , 2009, 2009 International Symposium on Wearable Computers.

[61]  Stanley R. Parkinson,et al.  Effects of Breadth, Depth and Number of Responses on Computer Menu Search Performance , 1988, Int. J. Man Mach. Stud..

[62]  Michelle E. Bayles,et al.  Designing online banner advertisements: should we animate? , 2002, CHI.

[63]  Marcus Trapp,et al.  Addressing Animated Transitions already in Mobile App Storyboards , 2013, HCI.

[64]  Anthony J. Hornof,et al.  High-cost banner blindness: Ads increase perceived workload, hinder visual search, and are forgotten , 2005, TCHI.

[65]  Elin Andersson,et al.  Exploring alternatives to the hierarchical menu structure used in mobile phones , 2007 .

[66]  Donald Voet,et al.  Time flies when you're having fun , 2009, Biochemistry and molecular biology education : a bimonthly publication of the International Union of Biochemistry and Molecular Biology.

[67]  Chris Baber,et al.  Defining and evaluating context for wearable computing , 2004, Int. J. Hum. Comput. Stud..

[68]  Ling Chen,et al.  A Comparative Study of Sonification Methods to Represent Distance and Forward-Direction in Pedestrian Navigation , 2014, Int. J. Hum. Comput. Interact..

[69]  최준호,et al.  A Study of Menu Structure on Smartwatch for Effective Navigation , 2015 .

[70]  Val Head.  Designing Interface Animation: Meaningful Motion for User Experience , 2016 .

[71]  Martina Ziefle,et al.  Instruction Formats and Navigation Aids in Mobile Devices , 2008, USAB.

[72]  C. Yoo,et al.  Processing of animation in online banner advertising: The roles of cognitive and emotional responses , 2005 .

[73]  Thomas Alexander,et al.  Analysis of Visual Performance during the Use of Mobile Devices While Walking , 2014, HCI.

[74]  Gavriel Salvendy,et al.  Use and Design of Handheld Computers for Older Adults: A Review and Appraisal , 2012, Int. J. Hum. Comput. Interact..

[75]  Martina Ziefle,et al.  How to Overcome Disorientation in Mobile Phone Menus: A Comparison of Two Different Types of Navigation Aids , 2006, Hum. Comput. Interact..

[76]  Jacob O. Wobbrock,et al.  Getting off the treadmill: evaluating walking user interfaces for mobile devices in public spaces , 2008, Mobile HCI.

[77]  Manfred Tscheligi,et al.  CHI '04 Extended Abstracts on Human Factors in Computing Systems , 2004, CHI 2004.

[78]  Stephen A. Brewster,et al.  Multimodal 'eyes-free' interaction techniques for wearable devices , 2003, CHI '03.

[79]  David R. Morse,et al.  Using while moving: HCI issues in fieldwork environments , 2000, TCHI.

[80]  Stephen A. Brewster,et al.  The relationship between encumbrance and walking speed on mobile interactions , 2013, CHI Extended Abstracts.