Physical Loci: Leveraging Spatial, Object and Semantic Memory for Command Selection

Physical Loci, a technique based on an ancient memory technique, allows users to quickly learn a large command set by leveraging spatial, object and verbal/semantic memory to create a cognitive link between individual commands and nearby physical objects in a room (called loci). We first report on an experiment that showed that for learning 25 items Physical Loci outperformed a mid-air Marking Menu baseline. A long-term retention experiment with 48 items then showed that recall was nearly perfect one week later and, surprisingly, independent of whether the command/locus mapping was one's own choice or somebody else's. A final study suggested that recall performance is robust to alterations of the learned mapping, whether systematic or random.

[1]  Hongtu Zhu,et al.  A slice of π : An exploratory neuroimaging study of digit encoding and retrieval in a superior memorist , 2009, Neurocase.

[2]  Ravin Balakrishnan,et al.  Simple vs. compound mark hierarchical marking menus , 2004, UIST '04.

[3]  Per Ola Kristensson,et al.  Memorability of pre-designed and user-defined gesture sets , 2013, CHI.

[4]  Jasmin Cloutier,et al.  The feeling of choosing: Self-involvement and the cognitive status of things past , 2008, Consciousness and Cognition.

[5]  G. Bower,et al.  Hierarchical retrieval schemes in recall of categorized word lists , 1969 .

[6]  Walter F. Bischof,et al.  Learning and performance with gesture guides , 2013, CHI.

[7]  Carl Gutwin,et al.  Improving list revisitation with ListMaps , 2006, AVI '06.

[8]  Mary Czerwinski,et al.  Data mountain: using spatial memory for document management , 1998, UIST '98.

[9]  Shumin Zhai,et al.  Representation Matters: The Effect of 3D Objects and a Spatial Metaphor in a Graphical User Interface , 1998, BCS HCI.

[10]  G. Mandler Organization and Memory , 1967 .

[11]  Yasushi Ikei,et al.  Spatial Electronic Mnemonics: A Virtual Memory Interface , 2007, HCI.

[12]  Marcos Serrano,et al.  Bezel-Tap gestures: quick activation of commands from sleep mode on tablets , 2013, CHI.

[13]  P. Meudell,et al.  Short Report: Is Spatial Information Encoded Automatically in Memory? , 1993, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[14]  Steven A. Shafer,et al.  XWand: UI for intelligent spaces , 2003, CHI '03.

[15]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[16]  Alan Baddeley,et al.  Essentials of Human Memory (Classic Edition) , 2013 .

[17]  E. Maguire,et al.  Routes to remembering: the brains behind superior memory , 2003, Nature Neuroscience.

[18]  Carl Gutwin,et al.  Faster command selection on tablets with FastTap , 2014, CHI.

[19]  D. Perkins Your Memory: How It Works and How to Improve It by Kenneth L. Higbee, The Psychology of Memory by Alan D. Baddeley (review) , 2017 .

[20]  Khai N. Truong,et al.  Virtual shelves: interactions with orientation aware devices , 2009, UIST '09.

[21]  Susan T. Dumais,et al.  The spatial metaphor for user interfaces: experimental tests of reference by location versus name , 1986, TOIS.

[22]  Stephen Hawkins,et al.  Bizarre images in artificial memory , 1970 .

[23]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.

[24]  William Buxton,et al.  User learning and performance with marking menus , 1994, CHI '94.

[25]  F Herbert,et al.  Memory loci in artificial memory , 1969 .

[26]  G. Bower Analysis of a mnemonic device , 1970 .

[27]  Donald A. Norman,et al.  Natural user interfaces are not natural , 2010, INTR.

[28]  Carl Gutwin,et al.  Improving command selection with CommandMaps , 2012, CHI.

[29]  Mary Czerwinski,et al.  The Contribution of Thumbnail Image, Mouse-over Text and Spatial Location Memory to Web Page Retrieval in 3D , 1999, INTERACT.

[30]  Jörg Müller,et al.  Design and evaluation of finger-count interaction: Combining multitouch gestures and menus , 2012, Int. J. Hum. Comput. Stud..

[31]  Gilles Bailly,et al.  Wave Menus: Improving the Novice Mode of Hierarchical Marking Menus , 2007, INTERACT.

[32]  Ian Oakley,et al.  Motion marking menus: An eyes-free approach to motion input for handheld devices , 2009, Int. J. Hum. Comput. Stud..

[33]  Ted Selker,et al.  Multi-finger chords for hand-held tablets: recognizable and memorable , 2014, CHI.

[34]  A BoltRichard,et al.  Put-that-there , 1980 .

[35]  Carl Gutwin,et al.  Testing the robustness and performance of spatially consistent interfaces , 2013, CHI.