Interfaces for accessing location‐based information on mobile devices: An empirical evaluation

Location‐based information can now be easily accessed anytime and anywhere using mobile devices. Common ways of presenting such information include lists, maps, and augmented reality (AR). Each of these interface types has its strengths and weaknesses, but few empirical evaluations have been conducted to compare them in terms of performance and perceptions of usability. In this paper, we investigate these issues using three interface types for searching and browsing location‐based information across two task types: open and closed ended. The experimental study involved 180 participants who were issued an Android mobile phone preloaded with a specific interface and asked to perform a set of open‐ and closed‐ended tasks using both searching and browsing approaches. The results suggest that the list interface performed best across all tasks in terms of completion times, whereas the AR interface ranked second and the map interface performed worst. Participants rated the list as best across most usability constructs but the map was rated better than the AR interface, even though the latter performed better. Implications of the work are discussed.

[1]  Raafat George Saadé,et al.  First impressions last a lifetime: effect of interface type on disorientation and cognitive load , 2007, Comput. Hum. Behav..

[2]  Yili Liu,et al.  Webpage aesthetics, performance and usability: Design variables and their effects , 2009, Ergonomics.

[3]  Atsuyuki Okabe,et al.  Wayfinding with a GPS-based mobile navigation system: A comparison with maps and direct experience , 2008 .

[4]  Gary Marchionini,et al.  Information-seeking strategies of novices using a full-text electronic encyclopedia , 1989, JASIS.

[5]  Barry Smyth,et al.  Mobile information access: A study of emerging search behavior on the mobile Internet , 2007, TWEB.

[6]  Mark Billinghurst,et al.  Exploring the use of handheld AR for outdoor navigation , 2012, Comput. Graph..

[7]  Fabio Crestani,et al.  A Personalised Recommendation System for Context-Aware Suggestions , 2014, ECIR.

[8]  Daniel R. Montello,et al.  Sex-Related Differences and Similarities in Geographic and Environmental Spatial Abilities , 1999 .

[9]  Chei Sian Lee,et al.  Comparative Evaluation of Interfaces for Presenting Location-Based Information on Mobile Devices , 2011, ICADL.

[10]  Luca Chittaro,et al.  Interactive visual analysis of geographic data on mobile devices based on dynamic queries , 2008, J. Vis. Lang. Comput..

[11]  Akash Singh,et al.  Can Adaptive Interfaces Improve the Usability of Mobile Applications? , 2010, HCIS.

[12]  Gary Marchionini,et al.  Finding facts vs. browsing knowledge in hypertext systems , 1988, Computer.

[13]  Thomas Olsson,et al.  Narratives of satisfying and unsatisfying experiences of current mobile augmented reality applications , 2012, CHI.

[14]  Kasper Hornbæk,et al.  Current practice in measuring usability: Challenges to usability studies and research , 2006, Int. J. Hum. Comput. Stud..

[15]  David M. Mountain,et al.  Geographic information retrieval in a mobile environment: evaluating the needs of mobile individuals , 2007, J. Inf. Sci..

[16]  Bernard J. Jansen,et al.  Brand and its effect on user perception of search engine performance , 2009, J. Assoc. Inf. Sci. Technol..

[17]  Nuria Oliver,et al.  The "Map Trap"?: an evaluation of map versus text-based interfaces for location-based mobile search services , 2010, WWW '10.

[18]  Iván Cantador,et al.  Time-aware recommender systems: a comprehensive survey and analysis of existing evaluation protocols , 2013, User Modeling and User-Adapted Interaction.

[19]  Ee-Peng Lim,et al.  Evaluating the Use of a Mobile Annotation System for Geography Education , 2012, Electron. Libr..

[20]  Fredrik Espinoza,et al.  GeoNotes: Social and Navigational Aspects of Location-Based Information Systems , 2001, UbiComp.

[21]  James J. Jiang,et al.  User resistance and strategies for promoting acceptance across system types , 2000, Inf. Manag..

[22]  Toon De Pessemier,et al.  Context-aware Recommendations through Activity Recognition , 2013, WEBIST.

[23]  Harry Bouwman,et al.  Analysis of users and non-users of smartphone applications , 2010, Telematics Informatics.

[24]  Michael A. Shepherd,et al.  A Field Study Characterizing Web-based Information Seeking Tasks , 2022 .

[25]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[26]  Jun Rekimoto,et al.  NaviCam:A Magnifying Glass Approach to Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[27]  Karl Aberer,et al.  SoCo: a social network aided context-aware recommender system , 2013, WWW.

[28]  David M. Nichols,et al.  Contextual queries express mobile information needs , 2010, Mobile HCI.

[29]  Jana Kosecka,et al.  Visual Navigation for Mobile Devices , 2010, IEEE MultiMedia.

[30]  Chei Sian Lee,et al.  Looking for a Good Time: Information Seeking in a Mobile Content Sharing and Gaming Environments , 2010, 2010 International Conference on Cyberworlds.

[31]  Barry Smyth,et al.  Understanding the intent behind mobile information needs , 2009, IUI.

[32]  Hsinchun Chen,et al.  Internet Browsing and Searching: User Evaluations of Category Map and Concept Space Techniques , 1998, J. Am. Soc. Inf. Sci..

[33]  Alton Yeow-Kuan Chua,et al.  Tagging, Sharing and the Influence of Personal Experience , 2009, J. Digit. Inf..

[34]  Fethi Calisir,et al.  The relation of interface usability characteristics, perceived usefulness, and perceived ease of use to end-user satisfaction with enterprise resource planning (ERP) systems , 2004, Comput. Hum. Behav..

[35]  Brian F. Goldiez,et al.  Effects of Augmented Reality Display Settings on Human Wayfinding Performance , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[36]  Fabio Crestani,et al.  Effective search results summary size and device screen size: Is there a relationship? , 2005, Inf. Process. Manag..

[37]  Christoph Hölscher,et al.  Taxonomy of Human Wayfinding Tasks: A Knowledge-Based Approach , 2009, Spatial Cogn. Comput..

[38]  Kasper Hornbæk,et al.  Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? , 2000, CHI.

[39]  Ee-Peng Lim,et al.  Managing Media Rich Geo-spatial Annotations for a Map-Based Mobile Application Using Clustering , 2010, 2010 Seventh International Conference on Information Technology: New Generations.

[40]  Hsinchun Chen,et al.  Internet Browsing and Searching: User Evaluations of Category Map and Concept Space Techniques , 1998, J. Am. Soc. Inf. Sci..

[41]  Dieter Schmalstieg,et al.  The World as a User Interface: Augmented Reality for Ubiquitous Computing , 2007, Location Based Services and TeleCartography.

[42]  Ann Blandford,et al.  Evaluating the Information Behaviour methods: Formative evaluations of two methods for assessing the functionality and usability of electronic information resources , 2011, Int. J. Hum. Comput. Stud..

[43]  Christian Kray,et al.  Presenting route instructions on mobile devices , 2003, IUI '03.

[44]  George Buchanan,et al.  Questions not answers: a novel mobile search technique , 2007, CHI.

[45]  Lisa M. Stevenson,et al.  Real-World Knowledge through Real-World Maps: A Developmental Guide for Navigating the Educational Terrain , 2002 .

[46]  David G. Novick,et al.  Usability over time , 2005, SIGDOC '05.

[47]  Pin Luarn,et al.  Predicting consumer intention to use mobile service , 2006, Inf. Syst. J..

[48]  Magnus Bång,et al.  Exploring place and direction: mobile augmented reality in the Astrid Lindgren landscape , 2012, OZCHI.

[49]  Tumasch Reichenbacher,et al.  The concept of relevance in mobile maps , 2007, Location Based Services and TeleCartography.

[50]  Timo Jokela,et al.  Methods for quantitative usability requirements: a case study on the development of the user interface of a mobile phone , 2006, Personal and Ubiquitous Computing.

[51]  James D. Hollan,et al.  A diary study of mobile information needs , 2008, CHI.

[52]  Thomas Olsson,et al.  City scene: field trial of a mobile street-imagery-based navigation service , 2013, MobileHCI '13.

[53]  George Buchanan,et al.  Improving Web Interaction on Small Displays , 1999, Comput. Networks.

[54]  Dieter Schmalstieg,et al.  Zooming interfaces for augmented reality browsers , 2010, Mobile HCI.

[55]  Johannes Schöning,et al.  Map navigation with mobile devices: virtual versus physical movement with and without visual context , 2007, ICMI '07.

[56]  Alia Amin,et al.  Fancy a Drink in Canary Wharf?: A User Study on Location-Based Mobile Search , 2009, INTERACT.

[57]  Kori Inkpen Quinn,et al.  Planners, navigators, and pragmatists: collaborative wayfinding using a single mobile phone , 2008, Personal and Ubiquitous Computing.

[58]  Virpi Roto,et al.  How people use the web on mobile devices , 2008, WWW.

[59]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[60]  Peter Fröhlich,et al.  On the move, wirelessly connected to the world , 2011, Commun. ACM.

[61]  Jacek Gwizdka,et al.  Search behaviors in different task types , 2010, JCDL '10.

[62]  Bradley M. Hemminger,et al.  A tale of two interfaces: How facets affect the library catalog search , 2012, J. Assoc. Inf. Sci. Technol..

[63]  Shumeet Baluja,et al.  A large scale study of wireless search behavior: Google mobile search , 2006, CHI.

[64]  Thomas Grechenig,et al.  Comparing viewing and filtering techniques for mobile urban exploration , 2011, J. Locat. Based Serv..

[65]  Blair MacIntyre,et al.  Browsing the Real-World Wide Web: Maintaining Awareness of Virtual Information in an AR Information Space , 2003, Int. J. Hum. Comput. Interact..

[66]  Ann Morrison,et al.  Collaborative use of mobile augmented reality with paper maps , 2011, Comput. Graph..

[67]  Ann Morrison,et al.  Like bees around the hive: a comparative study of a mobile augmented reality map , 2009, CHI.

[68]  Carolyn R. Watters,et al.  Geosearcher: Location-based Ranking of Search Engine Results , 2003, J. Assoc. Inf. Sci. Technol..

[69]  George Buchanan,et al.  An Evaluation of WebTwig - A Site Outliner for Handheld Web Access , 1999, HUC.

[70]  Heinrich Hußmann,et al.  Mobile or desktop websites?: website usage on multitouch devices , 2010, NordiCHI.

[71]  Andreas Paepcke,et al.  Power browser: efficient Web browsing for PDAs , 2000, CHI.

[72]  Mervyn A. Jack,et al.  A usability comparison of three alternative message formats for an SMS banking service , 2008, Int. J. Hum. Comput. Stud..

[73]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[74]  Martina Ziefle,et al.  The influence of user expertise and phone complexity on performance, ease of use and learnability of different mobile phones , 2002, Behav. Inf. Technol..

[75]  Jaime Teevan,et al.  Understanding the importance of location, time, and people in mobile local search behavior , 2011, Mobile HCI.

[76]  Keith Cheverst,et al.  A Survey of Map-based Mobile Guides , 2005 .

[77]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.

[78]  Daniel E. Rose,et al.  Understanding user goals in web search , 2004, WWW '04.

[79]  Ian Rowlands,et al.  Information on the go: A case study of Europeana mobile users , 2013, J. Assoc. Inf. Sci. Technol..