Foraging-based Optimization of Menu Systems

Computational design of menu systems has been solved in limited cases such as the linear menu (list) as an assignment task, where commands are assigned to menu positions while optimizing for for users selection performance and distance of associated items. We show that this approach falls short with larger, hierarchically organized menu systems, where one must also take into account how users navigate hierarchical structures. This paper presents a novel integer programming formulation that models hierarchical menus as a combination of the exact set covering problem and the assignment problem. It organizes commands into ordered groups of ordered groups via a novel objective function based on information foraging theory. It minimizes, on the one hand, the time required to select a command whose location is known from previous usage and, on the other, the time wasted in irrelevant parts of the menu while searching for commands whose location is not known. The convergence of these two factors yields usable, well-ordered command hierarchies from a single model. In generated menus, the lead (first) elements of a group or tab are good indicators of the remaining contents, thereby facilitating the search process. In a controlled usability evaluation, the performance of computationally designed menus was 25 faster than existing commercial designs with respect to selection time. The algorithm is efficient for large, representative instances of the problem. We further show applications in personalization and adaptation of menu systems.

[1]  Mikhail V. Goubko,et al.  Semantic-aware optimization of user interface menus , 2013, Autom. Remote. Control..

[2]  Antti Oulasvirta,et al.  The Emergence of Interactive Behavior: A Model of Rational Menu Search , 2015, CHI.

[3]  Joseph L. Balintfy Menu planning by computer , 1964, CACM.

[4]  John R. Anderson,et al.  ACT-R: A Theory of Higher Level Cognition and Its Relation to Visual Attention , 1997, Hum. Comput. Interact..

[5]  Andrew Howes,et al.  Good Enough But I'll Just Check: Web-page Search as Attentional Refocusing , 2004, ICCM.

[6]  Wai-Tat Fu,et al.  SNIF-ACT: A Model of Information Foraging on the World Wide Web , 2003, User Modeling.

[7]  H. B. Mann,et al.  On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other , 1947 .

[8]  Nancy J. Cooke,et al.  Design of Menus , 1997 .

[9]  Antti Oulasvirta,et al.  Computational Support for Functionality Selection in Interaction Design , 2017, ACM Trans. Comput. Hum. Interact..

[10]  Antti Oulasvirta,et al.  MenuOptimizer: interactive optimization of menu systems , 2013, UIST.

[11]  Miguel F. Anjos,et al.  Mathematical optimization approaches for facility layout problems: The state-of-the-art and future research directions , 2017, Eur. J. Oper. Res..

[12]  Erik Nilsen,et al.  PERCEPTUAL-MOTOR CONTROL IN HUMAN-COMPUTER INTERACTION , 1991, SGCH.

[13]  John R. Anderson,et al.  Eye tracking the visual search of click-down menus , 1999, CHI '99.

[14]  James E. McDonald,et al.  Searching for Items in Menus: The Effects of Organization and Type of Target , 1983 .

[15]  Luigi Troiano,et al.  Optimization of Menu Layouts by Means of Genetic Algorithms , 2008, EvoCOP.

[16]  Antti Oulasvirta,et al.  Combinatorial Optimization for User Interface Design , 2018 .

[17]  Michael D. Byrne,et al.  ACT-R/PM and menu selection: applying a cognitive architecture to HCI , 2001, Int. J. Hum. Comput. Stud..

[18]  Antti Oulasvirta,et al.  Model of visual search and selection time in linear menus , 2014, CHI.

[19]  Victor J. Rayward-Smith,et al.  The next release problem , 2001, Inf. Softw. Technol..

[20]  Gilles Bailly,et al.  Effects of Frequency Distribution on Linear Menu Performance , 2017, CHI.

[21]  Ben Shneiderman,et al.  The Psychology of Menu Selection: Designing Cognitive Control at the Human/Computer Interface , 1991 .

[22]  P. Pirolli Information Foraging Theory: Adaptive Interaction with Information , 2007 .

[23]  Mikhail Goubko,et al.  Mathematical model of hierarchical menu structure optimization , 2012 .

[24]  Mikhail V. Goubko,et al.  An automated routine for menu structure optimization , 2010, EICS '10.

[25]  Wai-Tat Fu,et al.  SNIF-ACT: A Cognitive Model of User Navigation on the World Wide Web , 2007, Hum. Comput. Interact..

[26]  Ali Kashif Bashir,et al.  Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , 2013, ICIRA 2013.

[27]  Carl Gutwin,et al.  A predictive model of menu performance , 2007, CHI.

[28]  Gilles Bailly,et al.  Visual Menu Techniques , 2016, ACM Comput. Surv..

[29]  Luigi Troiano,et al.  Genetic algorithms supporting generative design of user interfaces: Examples , 2014, Inf. Sci..

[30]  Henri Pierreval,et al.  Facility layout problems: A survey , 2007, Annu. Rev. Control..

[31]  Seiji Yamada,et al.  Optimizing hierarchical menus by genetic algorithm and simulated annealing , 2008, GECCO '08.

[32]  Brad Mehlenbacher,et al.  Finding Information on a Menu: Linking Menu Organization to the User's Goals , 1989, Hum. Comput. Interact..

[33]  John A. W. McCall,et al.  Evolving interface designs to minimize user task times as simulated in a cognitive architecture , 2010, IEEE Congress on Evolutionary Computation.

[34]  Peter Pirolli,et al.  Information Foraging , 2009, Encyclopedia of Database Systems.

[35]  David Ahlström,et al.  Modeling and improving selection in cascading pull-down menus using Fitts' law, the steering law and force fields , 2005, CHI.

[36]  Allen Newell,et al.  The keystroke-level model for user performance time with interactive systems , 1980, CACM.

[37]  Anthony J. Hornof,et al.  Cognitive modeling reveals menu search in both random and systematic , 1997, CHI.

[38]  Carl Gutwin,et al.  A Predictive Model of Human Performance With Scrolling and Hierarchical Lists , 2009, Hum. Comput. Interact..

[39]  Luigi Troiano,et al.  Searching optimal menu layouts by linear genetic programming , 2016, J. Ambient Intell. Humaniz. Comput..

[40]  George B. Dantzig,et al.  The Diet Problem , 1990 .

[41]  James N. MacGregor,et al.  Minimizing User Search Time in Menu Retrieval Systems , 1985 .

[42]  Mitsuo Gen,et al.  Facility Layout Design Problems , 2007 .

[43]  Lilly M. Lancaster,et al.  The history of the application of mathematical programming to menu planning , 1992 .

[44]  Antti Oulasvirta,et al.  Combinatorial Optimization of Graphical User Interface Designs , 2020, Proceedings of the IEEE.

[45]  Kalyanmoy Deb,et al.  A Comparative Analysis of Selection Schemes Used in Genetic Algorithms , 1990, FOGA.

[46]  Antti Oulasvirta,et al.  Improvements to keyboard optimization with integer programming , 2014, UIST.

[47]  Ben Shneiderman,et al.  Split menus: effectively using selection frequency to organize menus , 1994, TCHI.