Memory in Motion: The Influence of Gesture- and Touch-Based Input Modalities on Spatial Memory

People's ability to remember and recall spatial information can be harnessed to improve navigation and search performances in interactive systems. In this paper, we investigate how display size and input modality influence spatial memory, especially in relation to efficiency and user satisfaction. Based on an experiment with 28 participants, we analyze the effect of three input modalities (trackpad, direct touch, and gesture-based motion controller) and two display sizes (10.6" and 55") on people's ability to navigate to spatially spread items and recall their positions. Our findings show that the impact of input modality and display size on spatial memory is not straightforward, but characterized by trade-offs between spatial memory, efficiency, and user satisfaction.

[1]  Desney S. Tan,et al.  With similar visual angles, larger displays improve spatial performance , 2003, CHI '03.

[2]  Desney S. Tan,et al.  Kinesthetic cues aid spatial memory , 2002, CHI Extended Abstracts.

[3]  Norman G. Vinson,et al.  Design guidelines for landmarks to support navigation in virtual environments , 1999, CHI '99.

[4]  Kathrin Probst,et al.  Peripheral Interaction in Desktop Computing: Why It’s Worth Stepping Beyond Traditional Mouse and Keyboard , 2016 .

[5]  Harald Reiterer,et al.  Applying Guidelines for the Design of Distortions on Focus+Context Interfaces , 2016, AVI.

[6]  Kasper Hornbæk,et al.  Meta-analysis of correlations among usability measures , 2007, CHI.

[7]  Roman Rädle,et al.  The effect of egocentric body movements on users' navigation performance and spatial memory in zoomable user interfaces , 2013, ITS.

[8]  Svenja Leifert.  The influence of grids on spatial and content memory , 2011, CHI EA '11.

[9]  Carl Gutwin,et al.  Improving revisitation in fisheye views with visit wear , 2005, CHI.

[10]  Florence Tyndiuk,et al.  Cognitive comparison of 3D interaction in front of large vs. small displays , 2005, VRST '05.

[11]  Dennis Wixon,et al.  The Natural User Interface , 2011 .

[12]  Harald Reiterer,et al.  Body Panning: a movement-based navigation technique for large interactive surfaces , 2013, ITS.

[13]  Lena Schwartz.  Human Spatial Memory Remembering Where , 2016 .

[14]  Sebastian Boring,et al.  Should I Stay or Should I Go? Selecting Between Touch and Mid-Air Gestures for Large-Display Interaction , 2015, INTERACT.

[15]  Desney S. Tan,et al.  Physically large displays improve path integration in 3D virtual navigation tasks , 2004, CHI '04.

[16]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[17]  Martin Schrepp,et al.  Construction and Evaluation of a User Experience Questionnaire , 2008, USAB.

[18]  Kasper Hornbæk,et al.  Current practice in measuring usability: Challenges to usability studies and research , 2006, Int. J. Hum. Comput. Stud..

[19]  Roman Rädle,et al.  Bigger is not always better: display size, performance, and task load during peephole map navigation , 2014, CHI.

[20]  Jakob Nielsen,et al.  Measuring usability: preference vs. performance , 1994, CACM.

[21]  Roman Rädle,et al.  Virtual Objects as Spatial Cues in Collaborative Mixed Reality Environments: How They Shape Communication Behavior and User Task Load , 2016, CHI.

[22]  Bonifaz Kaufmann,et al.  Studying spatial memory and map navigation performance on projector phones with peephole interaction , 2013, CHI.

[23]  Patrick Baudisch,et al.  Halo: a technique for visualizing off-screen objects , 2003, CHI '03.

[24]  Carl Gutwin,et al.  Wedge: clutter-free visualization of off-screen locations , 2008, CHI.

[25]  Kenton O'Hara,et al.  Supporting memory for spatial location while reading from small displays , 1999, CHI EA '99.

[26]  Roman Rädle,et al.  An Experimental Comparison of Vertical and Horizontal Dynamic Peephole Navigation , 2015, CHI.

[27]  Heinrich Hußmann,et al.  Indirect 2D Touch Panning: How Does It Affect Spatial Memory and Navigation Performance? , 2016, CHI.

[28]  Harald Reiterer,et al.  Does (multi-)touch aid users' spatial memory and navigation in 'panning' and in 'zooming & panning' UIs? , 2012, AVI.

[29]  Catherine Plaisant,et al.  Navigation patterns and usability of zoomable user interfaces with and without an overview , 2002, TCHI.

[30]  Carl Gutwin,et al.  Supporting and Exploiting Spatial Memory in User Interfaces , 2013, Found. Trends Hum. Comput. Interact..

[31]  Benjamin B. Bederson,et al.  A review of overview+detail, zooming, and focus+context interfaces , 2009, CSUR.