Exploring Multimodal Navigation Aids for Mobile Users

When navigating in real physical environments, as human beings we tend to display systematic or near-systematic errors with distance, direction and other navigation issues. To avoid making these errors, we choose different stratategies to find our way. While there have been a lot of HCI studies of navigation design guidelines for using maps or speech-based or tactile-based guidance in mobile devices, in this paper we introduce an initial study of multimodal navigation design utilising the design practice of episodes of motion originated from urban planning. The implications of designing cues and providing rhythm, as the design guidelines of episodes of motions suggests, are explored in this study with the subjects being pedestrians with wayfinding tasks in an urban area. The main contributions of this paper are in evaluating the design implications in the context of mobile wayfinding tasks and in reflecting the results according to human wayfinding behaviour. It is concluded that by designing predictive clues and rhythm into mobile multimodal navigation applications, we can improve navigation aids for users.

[1]  Wolfgang Wahlster Smartweb: multimodal web services on the road , 2007, ACM Multimedia.

[2]  Antti Oulasvirta,et al.  Understanding mobile contexts , 2003, Personal and Ubiquitous Computing.

[3]  Gerrit C. van der Veer,et al.  CHI '05 Extended Abstracts on Human Factors in Computing Systems , 2005, CHI 2005.

[4]  Rainer Malaka,et al.  Multimodal interaction for pedestrians: an evaluation study , 2005, IUI '05.

[5]  interactions Staff,et al.  CHI 2005 , 2005 .

[6]  Stephen A. Brewster,et al.  Multimodal 'eyes-free' interaction techniques for wearable devices , 2003, CHI '03.

[7]  Sharon L. Oviatt,et al.  When do we interact multimodally?: cognitive load and multimodal communication patterns , 2004, ICMI '04.

[8]  Wolfgang Wahlster,et al.  A resource-adaptive mobile navigation system , 2002, IUI '02.

[9]  Barbara Tversky,et al.  Navigating by Mind and by Body , 2003, Spatial Cognition.

[10]  Teija Vainio Exploring cues and rhythm for designing multimodal tools to support mobile users in wayfinding , 2009, CHI Extended Abstracts.

[11]  David R. Morse,et al.  AudioGPS: Spatial Audio Navigation with a Minimal Attention Interface , 2002, Personal and Ubiquitous Computing.

[12]  Michela Bertolotto,et al.  Personalised maps in multimodal mobile GIS , 2007, Int. J. Web Eng. Technol..

[13]  C. Lawton Gender differences in way-finding strategies: Relationship to spatial ability and spatial anxiety , 1994 .

[14]  Virpi Roto,et al.  Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI , 2005, CHI.

[15]  Ben Shneiderman,et al.  Interactive sonification of choropleth maps , 2005, IEEE MultiMedia.

[16]  Mika Raento,et al.  Interpreting and Acting on Mobile Awareness Cues , 2007, Hum. Comput. Interact..

[17]  Susanne Boll,et al.  Interactive 3D sonification for the exploration of city maps , 2006, NordiCHI '06.

[18]  William C. Halperin,et al.  EXPLORING SPATIAL FAMILIARITY , 1990 .

[19]  Sergei Nirenburg Proceedings of the sixth conference on Applied natural language processing , 2000 .

[20]  Antti Oulasvirta,et al.  Understanding Mobile Contexts , 2003, Mobile HCI.

[21]  Antonio Krüger,et al.  Auditory perceptible landmarks in mobile navigation , 2007, IUI '07.

[22]  Wilfried Brauer,et al.  Spatial Cognition III , 2003, Lecture Notes in Computer Science.

[23]  C. Lawton,et al.  Gender Differences in Wayfinding Strategies and Anxiety About Wayfinding: A Cross-Cultural Comparison , 2002 .

[24]  R. Golledge Wayfinding Behavior: Cognitive Mapping and Other Spatial Processes , 2010 .

[25]  Dimitrios Charitos,et al.  Designing Space in Virtual Environments for Aiding Wayfinding Behaviour , 1997 .

[26]  Philip R. Cohen,et al.  The Efficiency of Multimodal Interaction for a Map-based Task , 1999, ANLP.

[27]  Haixia Zhao Interactive sonification of geo-referenced data , 2005, CHI EA '05.

[28]  Sharon L. Oviatt,et al.  Multimodal system processing in mobile environments , 2000, UIST '00.

[29]  Lorna M. Brown,et al.  Tactile feedback for mobile interactions , 2007, CHI.

[30]  Stephen A. Brewster,et al.  Designing audio and tactile crossmodal icons for mobile devices , 2007, ICMI '07.

[31]  Andreas Butz,et al.  A hybrid indoor navigation system , 2001, IUI '01.

[32]  Kevin Lynch,et al.  The Image of the City , 1960 .

[33]  Barbara Leporini,et al.  Vibrotactile feedback as an orientation aid for blind users of mobile guides , 2008, Mobile HCI.