MRsive: An Augmented Reality Tool for Enhancing Wayfinding and Engagement with Art in Museums

Most museums use printed methods to support indoor navigation and visitor engagement strategies. However, modern museum visitors’ needs are not always met using static and conventional approaches, which are commonly employed in today’s museums. This paper investigates how indoor wayfinding and visitor engagement in the museum might be improved through interactive augmented reality. We designed “MRsive”, a handheld Augmented Reality (AR) tool using a user-centered design approach. The ultimate goal is twofold: the first is to simplify the required cognitive effort in navigating the museum space, and the second goal is to boost visitor engagement with museum artifacts through multisensory interaction. MRsive uses computer vision tools to read visual features in the space and achieve accurate indoor positioning of the directions and virtual cues anchored in the physical space. To evaluate our design, we followed a human-centered design approach. We conducted user testing at the Art Gallery of Ontario (AGO) followed by semi-structured interviews. The observations and answers of participants showed a considerable improvement in the speed, accuracy and ease-of-use when completing a wayfinding or engagement task. We hope our findings and discussion will contribute to the future development of this system and other AR tools that may improve wayfinding in complex indoor spaces and engagement with points of interest in other indoor environments.

[1]  Fotis Liarokapis,et al.  Examining User Experiences in a Mobile Augmented Reality Tourist Guide , 2016, PETRA.

[2]  Alycia M. Hund,et al.  Getting From Here to There: Spatial Anxiety, Wayfinding Strategies, Direction Type, and Wayfinding Efficiency , 2006, Spatial Cogn. Comput..

[3]  Dieter Schmalstieg,et al.  Handheld augmented reality indoor navigation with activity-based instructions , 2011, Mobile HCI.

[4]  Rui Li,et al.  Wayfinding Behaviors in Complex Buildings , 2016 .

[5]  Ying Wang,et al.  Implementing an augmented reality-enabled wayfinding system through studying user experience and requirements in complex environments , 2015 .

[6]  Nobuyoshi Yabuki,et al.  WAY-FINDING ASSISTANCE SYSTEM FOR UNDERGROUND FACILITIES USING AUGMENTED REALITY , 2015 .

[7]  Alyssa Friend Wise,et al.  Getting Down to Details: Using Theories of Cognition and Learning to Inform Tangible User Interface Design , 2013, Interact. Comput..

[8]  M. Munot,et al.  Research Methodology , 2019, Storytelling with Data in Healthcare.

[9]  Dieter Schmalstieg,et al.  Global Localization from Monocular SLAM on a Mobile Phone , 2014, IEEE Transactions on Visualization and Computer Graphics.

[10]  G. Allen.  Principles and practices for communicating route knowledge , 2000 .

[11]  H. Mallot.  Spatial cognition: Behavioral competences, neural mechanisms, and evolutionary scaling , 1999 .

[12]  Beatrix Emo,et al.  Wayfinding and Spatial Configuration: evidencefrom street corners , 2012 .

[13]  Daniel R. Montello,et al.  Wayfinding as a Social Activity , 2019, Front. Psychol..

[14]  G. Moscardo.  The shaping of tourist experience: the importance of stories and themes , 2010 .

[15]  Christian Heath,et al.  Configuring 'Interactivity' , 2008 .

[16]  Ching-Sheng Wang,et al.  3D augmented reality mobile navigation system supporting indoor positioning function , 2012, 2012 IEEE International Conference on Computational Intelligence and Cybernetics (CyberneticsCom).

[17]  Robert Xiao,et al.  Augmenting the Field-of-View of Head-Mounted Displays with Sparse Peripheral Displays , 2016, CHI.

[18]  P. Brunet,et al.  Through the Loupe: Visitor Engagement With a Primarily Text-Based Handheld AR Application , 2015 .

[19]  Romedi Passini,et al.  Wayfinding in Architecture , 1984 .

[20]  Amir Dirin,et al.  User Experience in Mobile Augmented Reality: Emotions, Challenges, Opportunities and Best Practices , 2018, Comput..

[21]  Jan M. Wiener,et al.  Towards a Taxonomy of Wayfinding Tasks : A Knowledge-Based Approach , 2009 .

[22]  Gerard Hanley,et al.  The Placement and Misplacement of You-Are-Here Maps , 1984 .

[23]  Christoph Hölscher,et al.  Taxonomy of Human Wayfinding Tasks: A Knowledge-Based Approach , 2009, Spatial Cogn. Comput..

[24]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[25]  Brian M. Tomaszewski,et al.  INSAR: indoor navigation system using augmented reality , 2014, ISA '14.

[26]  Nik Atilla Atasha Shamsuddin,et al.  Spatial Ability Skills: A correlation between Augmented Reality (AR) and conventional way on wayfinding system , 2016 .

[27]  Rudy Darken.  Wayfinding in large-scale virtual worlds , 1995, CHI '95.

[28]  PiekarskiWayne,et al.  First Person Indoor/Outdoor Augmented Reality Application: ARQuake , 2002 .

[29]  Amy Lobben,et al.  Tasks, Strategies, and Cognitive Processes Associated With Navigational Map Reading: A Review Perspective* , 2004, The Professional Geographer.

[30]  Maria Roussou,et al.  Flow, Staging, Wayfinding, Personalization: Evaluating User Experience with Mobile Museum Narratives , 2018, Multimodal Technol. Interact..

[31]  Micheal Drieberg,et al.  Augmented reality based indoor positioning navigation tool , 2011, 2011 IEEE Conference on Open Systems.

[32]  Deborah Hix,et al.  User-Centered Design and Evaluation of Virtual Environments , 1999, IEEE Computer Graphics and Applications.

[33]  A. Bickford.  Identity and the Museum Visitor Experience , 2010 .

[34]  Francisco Rebelo,et al.  Indoor Human Wayfinding Performance Using Vertical and Horizontal Signage in Virtual Reality , 2014 .

[35]  Daniel R. Montello,et al.  THE CONTRIBUTION OF SPACE SYNTAX TO A COMPREHENSIVE THEORY OF ENVIRONMENTAL PSYCHOLOGY , 2007 .

[36]  The multisensory museum , 2012 .

[37]  Kelly Caine,et al.  Local Standards for Sample Size at CHI , 2016, CHI.

[38]  Mark Billinghurst,et al.  A Survey of Augmented Reality , 2015, Found. Trends Hum. Comput. Interact..

[39]  Jan Willem Marck,et al.  Indoor radar SLAM A radar application for vision and GPS denied environments , 2013, 2013 European Radar Conference.

[40]  Patrick O'Shea,et al.  An Analysis of Engagement in a Combination Indoor/Outdoor Augmented Reality Educational Game. , 2011 .

[41]  Karen Cheng,et al.  Map Design for Complex Architecture: A User Study of Maps & Wayfinding , 2014 .

[42]  Y. Laberge,et al.  The Engaging Museum: Developing Museums for Visitor Involvement , 2008 .

[43]  R. Golledge.  Wayfinding Behavior: Cognitive Mapping and Other Spatial Processes , 2010 .

[44]  Mark Weiser.  The computer for the 21st Century , 2002 .

[45]  Lucienne Blessing,et al.  DRM, a Design Research Methodology , 2009 .

[46]  M. Raubal.  UMAN WAYFINDING IN UNFAMILIAR BUILDINGS : A SIMULATION WITH A COGNIZING AGENT , 2001 .

[47]  Maria Economou,et al.  Promising Beginning? Evaluating Museum Mobile Phone Apps , 2011 .

[48]  Wim van Eck,et al.  The augmented painting: Playful interaction with multi-spectral images , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH).

[49]  A. Leask,et al.  Visitor engagement at museums: Generation Y and ‘Lates’ events at the National Museum of Scotland , 2017 .