Command memorization: spatial positions versus directional gestures

To execute a command, a user can make a selection in a menu using pointing actions, or, for example, use shortcuts such as gestures. To go faster, she can learn the positions to point or gestures to perform. In this paper, we present a study comparing learning of positions or directions to select commands. The results obtained reveal similar recall rates, with a slight advantage for positions. The qualitative results suggest an advantage of positions over directions for physical and mental demands. Finally, the study of memorization strategies developed by the subjects provides mnemonic methods that can be useful for designers and users.

[1]  Ravin Balakrishnan,et al.  Simple vs. compound mark hierarchical marking menus , 2004, UIST '04.

[2]  Per Ola Kristensson,et al.  Memorability of pre-designed and user-defined gesture sets , 2013, CHI.

[3]  Olivier Chapuis,et al.  Designing Coherent Gesture Sets for Multi-scale Navigation on Tabletops , 2018, CHI.

[4]  Mary Czerwinski,et al.  Data mountain: using spatial memory for document management , 1998, UIST '98.

[5]  Joanna Bergstrom-Lehtovirta,et al.  Placing and Recalling Virtual Items on the Skin , 2017, CHI.

[6]  Carl Gutwin,et al.  Faster command selection on tablets with FastTap , 2014, CHI.

[7]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[8]  Carl Gutwin,et al.  Improving list revisitation with ListMaps , 2006, AVI '06.

[9]  Carl Gutwin,et al.  The Effects of Artificial Landmarks on Learning and Performance in Spatial-Memory Interfaces , 2017, CHI.

[10]  Shumin Zhai,et al.  Hard lessons: effort-inducing interfaces benefit spatial learning , 2007, CHI.

[11]  Olivier Chapuis,et al.  Impact of semantic aids on command memorization for on-body interaction and directional gestures , 2018, AVI.

[12]  J. Williamson,et al.  The art of memory , 2019, The Lancet Neurology.

[13]  Shumin Zhai,et al.  Using strokes as command shortcuts: cognitive benefits and toolkit support , 2009, CHI.

[14]  Neil Burgess,et al.  Distinct error-correcting and incidental learning of location relative to landmarks and boundaries , 2008, Proceedings of the National Academy of Sciences.

[15]  J. Mandler,et al.  On the coding of spatial information , 1977, Memory & cognition.

[16]  Alan Baddeley,et al.  Essentials of Human Memory (Classic Edition) , 2013 .

[17]  A. Paivio.  Abstractness, imagery, and meaningfulness in paired-associate learning , 1965 .

[18]  William Buxton,et al.  The limits of expert performance using hierarchic marking menus , 1993, INTERCHI.

[19]  Maneesh Agrawala,et al.  Zone and polygon menus: using relative position to increase the breadth of multi-stroke marking menus , 2006, CHI.

[20]  Gilles Bailly,et al.  Leaf Menus: Linear Menus with Stroke Shortcuts for Small Handheld Devices , 2009, INTERACT.

[21]  Olivier Chapuis,et al.  How Memorizing Positions or Directions Affects Gesture Learning? , 2018, ISS.

[22]  Shengdong Zhao,et al.  Physical Loci: Leveraging Spatial, Object and Semantic Memory for Command Selection , 2015, CHI.

[23]  G. Bower,et al.  Hierarchical retrieval schemes in recall of categorized word lists , 1969 .

[24]  Brian D. Ehret,et al.  Learning where to look: location learning in graphical user interfaces , 2002, CHI.

[25]  Carl Gutwin,et al.  Improving command selection with CommandMaps , 2012, CHI.

[26]  Gilles Bailly,et al.  Flower menus: a new type of marking menu with large menu breadth, within groups and efficient expert mode memorization , 2008, AVI '08.

[27]  Carl Gutwin,et al.  Testing the robustness and performance of spatially consistent interfaces , 2013, CHI.

[28]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[29]  Olivier Chapuis,et al.  MarkPad: Augmenting Touchpads for Command Selection , 2017, CHI.

[30]  M. Chun,et al.  Contextual Cueing: Implicit Learning and Memory of Visual Context Guides Spatial Attention , 1998, Cognitive Psychology.

[31]  Olivier Bau,et al.  OctoPocus: a dynamic guide for learning gesture-based command sets , 2008, UIST '08.

[32]  BaillyGilles,et al.  Visual Menu Techniques , 2016 .

[33]  Carol A. Seger,et al.  Implicit learning. , 1994, Psychological bulletin.