Effects of Locomotion and Visual Overview on Spatial Memory when Interacting with Wall Displays

Wall displays support people in interacting with large information spaces in two ways: On the one hand, the physical space in front of such displays enables them to navigate information spaces physically. On the other hand, the visual overview of the information space on the display may promote the formation of spatial memory; from studies of desktop computers we know this can boost performance. However, it remains unclear how the benefits of locomotion and overviews relate and whether one is more important than the other. We study this question through a wall display adaptation of the classic Data Mountain system to separate the effects of locomotion and visual overview. Our findings suggest that overview improves recall and that the combination of overview and locomotion outperforms all other combinations of factors.

[1]  Wendy E. Mackay,et al.  Effects of display size and navigation type on a classification task , 2014, CHI.

[2]  Sebastian Boring,et al.  Should I Stay or Should I Go? Selecting Between Touch and Mid-Air Gestures for Large-Display Interaction , 2015, INTERACT.

[3]  Olivier Chapuis,et al.  Mid-air pan-and-zoom on wall-sized displays , 2011, CHI.

[4]  Marcel Worring,et al.  Navigating on hand held displays: Dynamic versus Static Keyhole Navigation , 2006 .

[5]  Ali Jahanian,et al.  Web pages: What can you see in a single fixation? , 2018, Cognitive research: principles and implications.

[6]  Roman Rädle,et al.  An Experimental Comparison of Vertical and Horizontal Dynamic Peephole Navigation , 2015, CHI.

[7]  Catherine Plaisant,et al.  Virtual memory palaces: immersion aids recall , 2018, Virtual Reality.

[8]  R. Ruddle.  The Effect of Translational and Rotational Body-Based Information on Navigation , 2013 .

[9]  Mikkel Rønne Jakobsen,et al.  Is Moving Improving?: Some Effects of Locomotion in Wall-Display Interaction , 2015, CHI.

[10]  Harald Reiterer,et al.  Does (multi-)touch aid users' spatial memory and navigation in 'panning' and in 'zooming & panning' UIs? , 2012, AVI.

[11]  Kenton O'Hara,et al.  Supporting memory for spatial location while reading from small displays , 1999, CHI EA '99.

[12]  Ka-Ping Yee,et al.  Peephole displays: pen interaction on spatially aware handheld computers , 2003, CHI '03.

[13]  Ben Shneiderman,et al.  Image-Browser Taxonomy and Guidelines for Designers , 1995, IEEE Softw..

[14]  Catherine Plaisant,et al.  Navigation patterns and usability of zoomable user interfaces with and without an overview , 2002, TCHI.

[15]  Shane T. Mueller,et al.  The Psychology Experiment Building Language (PEBL) and PEBL Test Battery , 2014, Journal of Neuroscience Methods.

[16]  Jens Emil Grønbæk,et al.  Pac-Many: Movement Behavior when Playing Collaborative and Competitive Games on Large Displays , 2018, CHI.

[17]  Mary Czerwinski,et al.  The Contribution of Thumbnail Image, Mouse-over Text and Spatial Location Memory to Web Page Retrieval in 3D , 1999, INTERACT.

[18]  Roman Rädle,et al.  The effect of egocentric body movements on users' navigation performance and spatial memory in zoomable user interfaces , 2013, ITS.

[19]  Joanna Bergstrom-Lehtovirta,et al.  Placing and Recalling Virtual Items on the Skin , 2017, CHI.

[20]  Andy Cockburn,et al.  Evaluating the effectiveness of spatial memory in 2D and 3D physical and virtual environments , 2002, CHI.

[21]  Desney S. Tan,et al.  Kinesthetic cues aid spatial memory , 2002, CHI Extended Abstracts.

[22]  A. Miyake,et al.  The Cambridge Handbook of Visuospatial Thinking , 2005 .

[23]  Philip L. Roth,et al.  The Usefulness of Unit Weights in Creating Composite Scores , 2007 .

[24]  Mary Czerwinski,et al.  Data mountain: using spatial memory for document management , 1998, UIST '98.

[25]  Shengdong Zhao,et al.  Physical Loci: Leveraging Spatial, Object and Semantic Memory for Command Selection , 2015, CHI.

[26]  Carl Gutwin,et al.  Supporting and Exploiting Spatial Memory in User Interfaces , 2013, Found. Trends Hum. Comput. Interact..

[27]  Carl Gutwin,et al.  HARK No More: On the Preregistration of CHI Experiments , 2018, CHI.

[28]  J. Williamson,et al.  The art of memory , 2019, The Lancet Neurology.

[29]  George W. Fitzmaurice,et al.  Situated information spaces and spatially aware palmtop computers , 1993, CACM.

[30]  Harald Reiterer,et al.  Memory in Motion: The Influence of Gesture- and Touch-Based Input Modalities on Spatial Memory , 2017, CHI.

[31]  Bonifaz Kaufmann,et al.  Studying spatial memory and map navigation performance on projector phones with peephole interaction , 2013, CHI.

[32]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[33]  Carl Gutwin,et al.  Improving command selection with CommandMaps , 2012, CHI.

[34]  Niels Henze,et al.  Using Space: Effect of Display Size on Users' Search Performance , 2015, CHI Extended Abstracts.

[35]  Desney S. Tan,et al.  Physically large displays improve performance on spatial tasks , 2006, TCHI.

[36]  Chris North,et al.  Move to improve: promoting physical navigation to increase user performance with large displays , 2007, CHI.

[37]  Andy Cockburn,et al.  3D or not 3D?: evaluating the effect of the third dimension in a document management system , 2001, CHI.

[38]  Ekaterina P. Volkova,et al.  The effect of landmark and body-based sensory information on route knowledge , 2011, Memory & cognition.

[39]  Hrag Pailian,et al.  The reliability and internal consistency of one-shot and flicker change detection for measuring individual differences in visual working memory capacity , 2015, Memory & cognition.