Visual Menu Techniques

Menus are used for exploring and selecting commands in interactive applications. They are widespread in current systems and used by a large variety of users. As a consequence, they have motivated many studies in Human-Computer Interaction (HCI). Facing the large variety of menus, it is difficult to have a clear understanding of the design possibilities and to ascertain their similarities and differences. In this article, we address a main challenge of menu design: the need to characterize the design space of menus. To do this, we propose a taxonomy of menu properties that structures existing work on visual menus. As properties have an impact on the performance of the menu, we start by refining performance through a list of quality criteria and by reviewing existing analytical and empirical methods for quality evaluation. This taxonomy of menu properties is a step toward the elaboration of advanced predictive models of menu performance and the optimization of menus. A key point of this work is to focus both on menus and on the properties of menus, and then enable a fine-grained analysis in terms of performance.

[1]  Tovi Grossman,et al.  The design and evaluation of multitouch marking menus , 2010, CHI.

[2]  Yang Li Gesture Search: Random Access to Smartphone Content , 2012, IEEE Pervasive Computing.

[3]  Stefan Decker,et al.  Supporting menu design with radial layouts , 2010, AVI.

[4]  Shumin Zhai,et al.  Beyond Fitts' law: models for trajectory-based HCI tasks , 1997, CHI Extended Abstracts.

[5]  Wendy E. Mackay,et al.  Which interaction technique works when?: floating palettes, marking menus and toolglasses support different task strategies , 2002, AVI '02.

[6]  Mike Sinclair,et al.  Touch-sensing input devices , 1999, CHI '99.

[7]  Aaron Marcus,et al.  Cross-GUI Handbook: For Multiplatform User Interface Design , 1994 .

[8]  Caroline Essert,et al.  HardBorders: a new haptic approach for selection tasks in 3D menus , 2009, VRST '09.

[9]  Iris van Rooij,et al.  Satisficing and the Use of Keyboard Shortcuts: Being Good Enough Is Enough? , 2013, Interact. Comput..

[10]  Jakob Nielsen,et al.  Chapter 4 – The Usability Engineering Lifecycle , 1993 .

[11]  Antti Oulasvirta,et al.  The Emergence of Interactive Behavior: A Model of Rational Menu Search , 2015, CHI.

[12]  Mike Wu,et al.  Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays , 2003, UIST '03.

[13]  George Kingsley Zipf,et al.  Human behavior and the principle of least effort , 1949 .

[14]  Neff Walker,et al.  A comparison of selection time from walking and pull-down menus , 1990, CHI '90.

[15]  Steven K. Feiner,et al.  Computer graphics: principles and practice (2nd ed.) , 1990 .

[16]  Jean-Daniel Fekete,et al.  OrthoZoom scroller: 1D multi-scale navigation , 2006, CHI.

[17]  François Guimbretière,et al.  Bimanual marking menu for near surface interactions , 2012, CHI.

[18]  Pierre Dragicevic,et al.  Strategies for accelerating on-line learning of hotkeys , 2007, CHI.

[19]  Carl Gutwin,et al.  Supporting Novice to Expert Transitions in User Interfaces , 2014, ACM Comput. Surv..

[20]  Jörg Müller,et al.  Design and evaluation of finger-count interaction: Combining multitouch gestures and menus , 2012, Int. J. Hum. Comput. Stud..

[21]  David E. Kieras,et al.  An Overview of the EPIC Architecture for Cognition and Performance With Application to Human-Computer Interaction , 1997, Hum. Comput. Interact..

[22]  Pierre Dragicevic,et al.  Earpod: eyes-free menu selection using touch input and reactive audio feedback , 2007, CHI.

[23]  Ben Shneiderman,et al.  Split menus: effectively using selection frequency to organize menus , 1994, TCHI.

[24]  B. Shneiderman,et al.  Improving the accuracy of touch screens: an experimental evaluation of three strategies , 1988, CHI '88.

[25]  Patrick Olivier,et al.  Attribute gates , 2008, UIST '08.

[26]  R. Hyman Stimulus information as a determinant of reaction time. , 1953, Journal of experimental psychology.

[27]  Joanna McGrenere,et al.  Ephemeral adaptation: the use of gradual onset to improve menu selection performance , 2009, CHI.

[28]  Antti Oulasvirta,et al.  MenuOptimizer: interactive optimization of menu systems , 2013, UIST.

[29]  T. K. Landauer,et al.  Selection from alphabetic and numeric menu trees using a touch screen: breadth, depth, and width , 1985, CHI '85.

[30]  Mary Czerwinski,et al.  Web page design: implications of memory, structure and scent for information retrieval , 1998, CHI.

[31]  David Ahlstr Modeling and Improving Selection in Cascading Pull›Down Menus Using Fitts' Law, the Steering Law and Force Fields , 2005 .

[32]  Andy Cockburn,et al.  Faster cascading menu selections with enlarged activation areas , 2006, Graphics Interface.

[33]  Gilles Bailly,et al.  Flower menus: a new type of marking menu with large menu breadth, within groups and efficient expert mode memorization , 2008, AVI '08.

[34]  Gavriel Salvendy,et al.  Hierarchical Menu Design: Breadth, Depth, and Task Complexity , 1996 .

[35]  Peter Brandl,et al.  Occlusion-aware menu design for digital tabletops , 2009, CHI Extended Abstracts.

[36]  Mikkel Rønne Jakobsen,et al.  Transient visualizations , 2007, OZCHI '07.

[37]  David Ahlström,et al.  Modeling and improving selection in cascading pull-down menus using Fitts' law, the steering law and force fields , 2005, CHI.

[38]  James R. Lewis,et al.  Using Cognitive Models to Create Menus , 1985 .

[39]  Joanna McGrenere,et al.  A comparison of static, adaptive, and adaptable menus , 2004, CHI.

[40]  Jock D. Mackinlay,et al.  The design space of input devices , 1990, CHI '90.

[41]  共立出版株式会社 コンピュータ・サイエンス : ACM computing surveys , 1978 .

[42]  Ravin Balakrishnan,et al.  The PadMouse: facilitating selection and spatial positioning for the non-dominant hand , 1998, CHI.

[43]  Donald A. Norman,et al.  Affordance, conventions, and design , 1999, INTR.

[44]  M. Haller,et al.  Improving Menu Interaction for Cluttered Tabletop Setups with User-Drawn Path Menus , 2007, Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07).

[45]  NilsenErik PERCEPTUAL-MOTOR CONTROL IN HUMAN-COMPUTER INTERACTION , 1991 .

[46]  Maneesh Agrawala,et al.  Zone and polygon menus: using relative position to increase the breadth of multi-stroke marking menus , 2006, CHI.

[47]  David Dearman,et al.  Transparency for Item Highlighting , 2003 .

[48]  Antti Oulasvirta,et al.  Toward optimal menu design , 2014, INTR.

[49]  Carl Gutwin,et al.  Promoting Hotkey use through rehearsal with ExposeHK , 2013, CHI.

[50]  Anthony J. Hornof,et al.  Cognitive modeling demonstrates how people use anticipated location knowledge of menu items , 1999, CHI '99.

[51]  Mary Beth Rosson,et al.  Paradox of the active user , 1987 .

[52]  Gilles Bailly,et al.  Gesture-aware remote controls: guidelines and interaction technique , 2011, ICMI '11.

[53]  Hongan Wang,et al.  Tilt menu: using the 3D orientation information of pen devices to extend the selection capability of pen-based user interfaces , 2008, CHI.

[54]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[55]  Gilles Bailly,et al.  Leaf Menus: Linear Menus with Stroke Shortcuts for Small Handheld Devices , 2009, INTERACT.

[56]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.

[57]  Eric S. Lee,et al.  "The Psychology of Menu Selection: Designing Cognitive Control at the Human/Computer Interface, " by Kent L. Norman (Book Review) , 1993, Int. J. Man Mach. Stud..

[58]  Jörg Müller,et al.  Cuenesics: using mid-air gestures to select items on interactive public displays , 2014, MobileHCI '14.

[59]  Ben Shneiderman,et al.  The Psychology of Menu Selection: Designing Cognitive Control at the Human/Computer Interface , 1991 .

[60]  Ravin Balakrishnan,et al.  Simple vs. compound mark hierarchical marking menus , 2004, UIST '04.

[61]  Stéphane Huot,et al.  ArchMenu et ThumbMenu: contrôler son dispositif mobile « sur le pouce » , 2007, IHM '07.

[62]  Krishna Bharat,et al.  Making computers easier for older adults to use: area cursors and sticky icons , 1997, CHI.

[63]  Lon Barfield The user interface : concepts & design , 1993 .

[64]  William L. Bewley,et al.  Human factors testing in the design of Xerox's 8010 “Star” office workstation , 1983, CHI '83.

[65]  Monica M. C. Schraefel,et al.  Bubbling menus: a selective mechanism for accessing hierarchical drop-down menus , 2007, CHI.

[66]  Xiangshi Ren,et al.  Enhancing Pie-Menu Selection with Pen Pressure , 2008, 2008 3rd International Conference on Innovative Computing Information and Control.

[67]  Gilles Bailly,et al.  Finger-count & radial-stroke shortcuts: 2 techniques for augmenting linear menus on multi-touch surfaces , 2010, CHI.

[68]  Carl Gutwin,et al.  Dips and ceilings: understanding and supporting transitions to expertise in user interfaces , 2011, CHI.

[69]  Dominique L. Scapin,et al.  Preliminary findings on the effectiveness of ergonomic criteria for the evaluation of human-computer interfaces , 1993, CHI '93.

[70]  John I. Kiger,et al.  The Depth/Breadth Trade-Off in the Design of Menu-Driven User Interfaces , 1984, Int. J. Man Mach. Stud..

[71]  Marwin Schmitt,et al.  Stacked Half-Pie menus: navigating nested menus on interactive tabletops , 2009, ITS '09.

[72]  Andrew Howes,et al.  A model of the acquisition of menu knowledge by exploration , 1994, CHI '94.

[73]  Gavriel Salvendy,et al.  Applying models of visual search to menu design , 2002, Int. J. Hum. Comput. Stud..

[74]  Michel Beaudouin-Lafon,et al.  Instrumental interaction: an interaction model for designing post-WIMP user interfaces , 2000, CHI.

[75]  Anthony J. Hornof,et al.  An active vision computational model of visual search for human-computer interaction , 2008 .

[76]  Dong-Seok Lee,et al.  Quantitative results assessing design issues of selection-supportive menus , 2004 .

[77]  John Millar Carroll Interfacing Thought: Cognitive Aspects of Human-Computer Interaction , 2003 .

[78]  Anthony J. Hornof,et al.  Cognitive modeling reveals menu search in both random and systematic , 1997, CHI.

[79]  William Buxton,et al.  A three-state model of graphical input , 1990, INTERACT.

[80]  Jun Rekimoto,et al.  PreSense: interaction techniques for finger sensing input devices , 2003, UIST '03.

[81]  Martin Hitz,et al.  Improving menu interaction: a comparison of standard, force enhanced and jumping menus , 2006, CHI.

[82]  Gordon Kurtenbach,et al.  The design and evaluation of marking menus , 1993 .

[83]  Eric Lecolinet,et al.  MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb , 2009, CHI.

[84]  Paul K. Wright,et al.  Toolglasses, Marking Menus, and Hotkeys: A Comparison of One and Two-Handed Command Selection Techniques , 2004, Graphics Interface.

[85]  Shumin Zhai,et al.  Using strokes as command shortcuts: cognitive benefits and toolkit support , 2009, CHI.

[86]  Wendy E. Mackay,et al.  Context matters: Evaluating Interaction Techniques with the CIS Model , 2004, BCS HCI.

[87]  Thomas S. Tullis,et al.  Designing a menu-based interface to an operating system , 1985, CHI '85.

[88]  Dimitre Novatchev,et al.  Chunking and Phrasing and the Design of Human-Computer Dialogues - Response , 1986, IFIP Congress.

[89]  Michael D. Byrne,et al.  ACT-R/PM and menu selection: applying a cognitive architecture to HCI , 2001, Int. J. Hum. Comput. Stud..

[90]  Doug A. Bowman,et al.  Design and evaluation of menu systems for immersive virtual environments , 2001, Proceedings IEEE Virtual Reality 2001.

[91]  Patrick Baudisch,et al.  The springboard: multiple modes in one spring-loaded control , 2006, CHI.

[92]  Terry Winograd,et al.  FlowMenu: combining command, text, and data entry , 2000, UIST '00.

[93]  Yang Li,et al.  Donuts : A Chinese Input Technique Using Pressure-Sensitive Marking Menus , 2005 .

[94]  Lon Barfield The User Interface: Concepts and Design , 2004 .

[95]  Carl Gutwin,et al.  Why it's quick to be square: modelling new and existing hierarchical menu designs , 2010, CHI.

[96]  Carl Gutwin,et al.  A Predictive Model of Human Performance With Scrolling and Hierarchical Lists , 2009, Hum. Comput. Interact..

[97]  W. E. Hick Quarterly Journal of Experimental Psychology , 1948, Nature.

[98]  Duc Nguyen,et al.  Représentation focus+contexte de listes hiérarchiques zoomables , 2006, IHM '06.

[99]  David E. Kieras,et al.  The GOMS family of user interface analysis techniques: comparison and contrast , 1996, TCHI.

[100]  James A. Landay,et al.  Voicedraw: a hands-free voice-driven drawing application for people with motor impairments , 2007, Assets '07.

[101]  Stanley R. Parkinson,et al.  Computer display menus , 1983 .

[102]  Jo W. Tombaugh,et al.  Measuring the true cost of command selection: techniques and results , 1990, CHI '90.

[103]  Jon Trinder,et al.  The Humane Interface: New Directions for Designing Interactive Systems , 2002, Interact. Learn. Environ..

[104]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[105]  Benjamin B. Bederson,et al.  Target size study for one-handed thumb use on small touchscreen devices , 2006, Mobile HCI.

[106]  Gilles Bailly,et al.  MenuInspector: Outil pour l'analyse des menus et cas d'étude , 2013, IHM.

[107]  Michael J. McGuffin,et al.  FaST Sliders: Integrating Marking Menus and the Adjustment , 2002, Graphics Interface.

[108]  Renate J. Roske-Hofstrand,et al.  The Optimal Number of Menu Options per Panel , 1986 .

[109]  Jens Rasmussen,et al.  Skills, rules, and knowledge; signals, signs, and symbols, and other distinctions in human performance models , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[110]  Shumin Zhai,et al.  Foundational Issues in Touch-Surface Stroke Gesture Design - An Integrative Review , 2012, Found. Trends Hum. Comput. Interact..

[111]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[112]  Tovi Grossman,et al.  PenLight: combining a mobile projector and a digital pen for dynamic visual overlay , 2009, CHI.

[113]  Ian Oakley,et al.  Designing Eyes-Free Interaction , 2007, HAID.

[114]  Terry Winograd,et al.  Benefits of merging command selection and direct manipulation , 2005, TCHI.

[115]  Carl Gutwin,et al.  A predictive model of menu performance , 2007, CHI.

[116]  William Buxton,et al.  Issues in combining marking and direct manipulation techniques , 1991, UIST '91.

[117]  K. Arrow,et al.  The New Palgrave Dictionary of Economics , 2020 .

[118]  Ben Shneiderman,et al.  Designing the user interface (2nd ed.): strategies for effective human-computer interaction , 1992 .

[119]  William Buxton,et al.  The limits of expert performance using hierarchic marking menus , 1993, INTERCHI.

[120]  Shengdong Zhao,et al.  earPod: Efficient Hierarchical Eyes-free Menu Selection , 2009 .

[121]  Florian Block,et al.  Touch-display keyboards: transforming keyboards into interactive surfaces , 2010, CHI.

[122]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[123]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[124]  Gilles Bailly,et al.  MultiTouch menu (MTM) , 2008, IHM '08.

[125]  Pierre Falzon,et al.  Institut national de recherche en informatique et en automatique , 1992 .

[126]  Carl Gutwin,et al.  Skillometers: reflective widgets that motivate and help users to improve performance , 2013, UIST.

[127]  Jef Raskin,et al.  The Humane Interface: New Directions for Designing Interactive Systems , 2000 .

[128]  Daniel M. Brown,et al.  Review of The humane interface , 2002 .

[129]  Steven F. Roth,et al.  On the semantics of interactive visualizations , 1996, Proceedings IEEE Symposium on Information Visualization '96.

[130]  Dominique L. Scapin,et al.  Ergonomic criteria for the evaluation of human-computer interfaces , 1993 .

[131]  Gerrit C. van der Veer,et al.  Breaking Down Usability , 1999, INTERACT.

[132]  Takeo Igarashi,et al.  Considering the direction of cursor movement for efficient traversal of cascading menus , 2003, UIST '03.

[133]  Mark S. Hancock,et al.  Improving Menu Placement Strategies for Pen Input , 2004, Graphics Interface.

[134]  Edward Cutrell,et al.  Bimanual Interaction on the Microsoft Office Keyboard , 2003, INTERACT.

[135]  James N. MacGregor,et al.  Minimizing User Search Time in Menu Retrieval Systems , 1985 .

[136]  Renaud Blanch,et al.  Semantic pointing: improving target acquisition with control-display ratio adaptation , 2004, CHI.

[137]  M. Weiser,et al.  An empirical comparison of pie vs. linear menus , 1988, CHI '88.

[138]  Yvonne Kammerer,et al.  Looking my way through the menu: the impact of menu design and multimodal input on gaze-based menu selection , 2008, ETRA.

[139]  Olivier Bau,et al.  OctoPocus: a dynamic guide for learning gesture-based command sets , 2008, UIST '08.

[140]  Panayiotis Zaphiris,et al.  Age differences and the depth - breadth tradeoff in hierarchical online information systems , 2001, HCI.

[141]  Stephen R. Ellis,et al.  Using virtual menus in a virtual environment , 1992, Electronic Imaging.

[142]  James R. Eagan,et al.  Augmented letters: mnemonic gesture-based shortcuts , 2013, CHI.

[143]  Nadine Mandran,et al.  Wavelet menus on handheld devices: stacking metaphor for novice mode and eyes-free selection for expert mode , 2010, AVI.

[144]  Emmanuel Barillot,et al.  Control menus: excecution and control in a single interactor , 2000, CHI Extended Abstracts.

[145]  James D. Foley,et al.  The human factors of computer graphics interaction techniques , 1984, IEEE Computer Graphics and Applications.

[146]  Andy Cockburn,et al.  AAMU: adaptive activation area menus for improving selection in cascading pull-down menus , 2008, CHI.

[147]  Erik Nilsen,et al.  PERCEPTUAL-MOTOR CONTROL IN HUMAN-COMPUTER INTERACTION , 1991, SGCH.

[148]  Dennis E. Egan,et al.  Handbook of Human Computer Interaction , 1988 .

[149]  Benjamin B. Bederson,et al.  Fisheye menus , 2000, UIST '00.

[150]  Michel Beaudouin-Lafon,et al.  Extending Marking Menus With Integral Dimensions: Application to the Dartboard Menu , 2009 .

[151]  Raimund Dachselt,et al.  Three-dimensional menus: A survey and taxonomy , 2007, Comput. Graph..

[152]  Mark H. Chignell,et al.  A Model for Information Exploration , 1991, Hypermedia.

[153]  Mark H. Chignell,et al.  Using glyphs to facilitate transition from hierarchical selection to gesturing , 2007, IFAC HMS.

[154]  George W. Fitzmaurice,et al.  The Hotbox: efficient access to a large number of menu-items , 1999, CHI '99.

[155]  François Guimbretière,et al.  Techniques , 2011, Laboratory Investigation.

[156]  James E. Pitkow,et al.  Characterizing Browsing Strategies in the World-Wide Web , 1995, Comput. Networks ISDN Syst..

[157]  David M. Lane,et al.  Hidden Costs of Graphical User Interfaces: Failure to Make the Transition from Menus and Icon Toolbars to Keyboard Shortcuts , 2005, Int. J. Hum. Comput. Interact..

[158]  Gilles Bailly,et al.  Wave Menus: Improving the Novice Mode of Hierarchical Marking Menus , 2007, INTERACT.

[159]  Poika Isokoski,et al.  Comparison of two touchpad-based methods for numeric entry , 2002, CHI.

[160]  Carl Gutwin,et al.  Faster command selection on tablets with FastTap , 2014, CHI.

[161]  Daniel J. Wigdor,et al.  Métamorphe: augmenting hotkey usage with actuated keys , 2013, CHI.

[162]  Gregory D. Abowd,et al.  Structuring the Space of Interactive System Properties , 1992, Engineering for Human-Computer Interaction.

[163]  William Buxton,et al.  User learning and performance with marking menus , 1994, CHI '94.

[164]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[165]  Brad A. Myers,et al.  A brief history of human-computer interaction technology , 1998, INTR.

[166]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .