Augmented letters: mnemonic gesture-based shortcuts

We propose Augmented Letters, a new technique aimed at augmenting gesture-based techniques such as Marking Menus [9] by giving them natural, mnemonic associations. Augmented Letters gestures consist of the initial of command names, sketched by hand in the Unistroke style, and affixed with a straight tail. We designed a tentative touch device interaction technique that supports fast interactions with large sets of commands, is easily discoverable, improves user's recall at no speed cost, and supports fluid transition from novice to expert mode. An experiment suggests that Augmented Letters outperform Marking Menu in terms of user recall.

[1]  I. Scott MacKenzie,et al.  Graffiti vs. unistrokes: an empirical comparison , 2008, CHI.

[2]  Yang Li Gesture search: a tool for fast mobile data access , 2010, UIST '10.

[3]  Gilles Bailly,et al.  Leaf Menus: Linear Menus with Stroke Shortcuts for Small Handheld Devices , 2009, INTERACT.

[4]  E. A. Alluisi,et al.  Some variables influencing the rate of gain of information. , 1962, Journal of experimental psychology.

[5]  F. Saussure,et al.  Course in General Linguistics , 1960 .

[6]  William Buxton,et al.  The limits of expert performance using hierarchic marking menus , 1993, INTERCHI.

[7]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[8]  R. Hyman Stimulus information as a determinant of reaction time. , 1953, Journal of experimental psychology.

[9]  Gilles Bailly,et al.  Flower menus: a new type of marking menu with large menu breadth, within groups and efficient expert mode memorization , 2008, AVI '08.

[10]  Michel Beaudouin-Lafon,et al.  Designing interaction, not interfaces , 2004, AVI.

[11]  Pierre Dragicevic,et al.  Strategies for accelerating on-line learning of hotkeys , 2007, CHI.

[12]  William Buxton,et al.  Issues in combining marking and direct manipulation techniques , 1991, UIST '91.

[13]  Gregory V. Jones Tests of the dual-mechanism theory of recall , 1982 .

[14]  B. Shneiderman,et al.  Seven plus or minus two central issues in human-computer interaction , 1986, CHI '86.

[15]  Olivier Bau,et al.  OctoPocus: a dynamic guide for learning gesture-based command sets , 2008, UIST '08.