Tilt menu: using the 3D orientation information of pen devices to extend the selection capability of pen-based user interfaces

We present a new technique called 'Tilt Menu' for better extending selection capabilities of pen-based interfaces. The Tilt Menu is implemented by using 3D orientation information of pen devices while performing selection tasks. The Tilt Menu has the potential to aid traditional one-handed techniques as it simultaneously generates the secondary input (e.g., a command or parameter selection) while drawing/interacting with a pen tip without having to use the second hand or another device. We conduct two experiments to explore the performance of the Tilt Menu. In the first experiment, we analyze the effect of parameters of the Tilt Menu, such as the menu size and orientation of the item, on its usability. Results of the first experiment suggest some design guidelines for the Tilt Menu. In the second experiment, the Tilt Menu is compared to two types of techniques while performing connect-the-dot tasks using freeform drawing mechanism. Results of the second experiment show that the Tilt Menu perform better in comparison to the Tool Palette, and is as good as the Toolglass.

[1]  Abigail Sellen,et al.  Two-handed input in a compound task , 1994, CHI Conference Companion.

[2]  Abigail Sellen,et al.  An Empirical Evaluation of Some Articulatory and Cognitive Aspects of Marking Menus , 1993, Hum. Comput. Interact..

[3]  Ravin Balakrishnan,et al.  Pressure widgets , 2004, CHI.

[4]  M. Weiser,et al.  An empirical comparison of pie vs. linear menus , 1988, CHI '88.

[5]  Ravin Balakrishnan,et al.  Pressure marks , 2007, CHI.

[6]  Ravin Balakrishnan,et al.  The role of kinesthetic reference frames in two-handed input performance , 1999, UIST '99.

[7]  Guozhong Dai,et al.  Sketch recognition with continuous feedback based on incremental intention extraction , 2005, IUI.

[8]  A. Bharath,et al.  HMM-Based Online Handwriting Recognition System for Telugu Symbols , 2007, Ninth International Conference on Document Analysis and Recognition (ICDAR 2007).

[9]  Vibha Sazawal,et al.  TiltType: accelerometer-supported text entry for very small devices , 2002, UIST '02.

[10]  Terry Winograd,et al.  Benefits of merging command selection and direct manipulation , 2005, TCHI.

[11]  James Arvo,et al.  Fluid sketches: continuous recognition and morphing of simple hand-drawn shapes , 2000, UIST '00.

[12]  Hongan Wang,et al.  The tilt cursor: enhancing stimulus-response compatibility by providing 3d orientation cue of pen , 2007, CHI.

[13]  William Buxton,et al.  The limits of expert performance using hierarchic marking menus , 1993, INTERCHI.

[14]  Katrin Franke,et al.  The influence of physical and biomechanical processes on the ink trace. Methodological foundations for the forensic analysis of signatures , 2005 .

[15]  Ravin Balakrishnan,et al.  Zliding: fluid zooming and sliding for high precision parameter manipulation , 2005, UIST.

[16]  Nicholas Chen,et al.  Phrasing techniques for multi-stroke selection gestures , 2006, Graphics Interface.

[17]  Emmanuel Barillot,et al.  Control menus: excecution and control in a single interactor , 2000, CHI Extended Abstracts.

[18]  Maneesh Agrawala,et al.  Zone and polygon menus: using relative position to increase the breadth of multi-stroke marking menus , 2006, CHI.

[19]  Daniel J. Wigdor,et al.  TiltText: using tilt for text input to mobile phones , 2003, UIST '03.

[20]  Terry Winograd,et al.  FlowMenu: combining command, text, and data entry , 2000, UIST '00.

[21]  George W. Fitzmaurice,et al.  The Rockin'Mouse: integral 3D manipulation on a plane , 1997, CHI.

[22]  William Buxton,et al.  Tracking menus , 2003, UIST '03.

[23]  Paul K. Wright,et al.  Toolglasses, Marking Menus, and Hotkeys: A Comparison of One and Two-Handed Command Selection Techniques , 2004, Graphics Interface.

[24]  Peter Tandler,et al.  Using Incremental Gesture Recognition to Provide Immediate Feedback while Drawing Pen Gestures , 2001 .

[25]  Patrick Baudisch,et al.  Hover widgets: using the tracking state to extend the capabilities of pen-operated devices , 2006, CHI.

[26]  Yang Li,et al.  Experimental analysis of mode switching techniques in pen-based user interfaces , 2005, CHI.

[27]  Tony DeRose,et al.  Toolglass and magic lenses: the see-through interface , 1993, SIGGRAPH.

[28]  Eric Saund,et al.  Stylus input and editing without prior selection of mode , 2003, UIST '03.

[29]  Robert J. K. Jacob,et al.  A software model and specification language for non-WIMP user interfaces , 1999, TCHI.

[30]  Shumin Zhai,et al.  Beyond Fitts' law: models for trajectory-based HCI tasks , 1997, CHI Extended Abstracts.