Computational Support for Functionality Selection in Interaction Design

Designing interactive technology entails several objectives, one of which is identifying and selecting appropriate functionality. Given candidate functionalities such as “print,” “bookmark,” and “share,” a designer has to choose which functionalities to include and which to leave out. Such choices critically affect the acceptability, productivity, usability, and experience of the design. However, designers may overlook reasonable designs because there is an exponential number of functionality sets and multiple factors to consider. This article is the first to formally define this problem and propose an algorithmic method to support designers to explore alternative functionality sets in early stage design. Based on interviews of professional designers, we mathematically define the task of identifying functionality sets that strike the best balance among four objectives: usefulness, satisfaction, ease of use, and profitability. We develop an integer linear programming solution that can efficiently solve very large instances (set size over 1,300) on a regular computer. Further, we build on techniques of robust optimization to search for diverse and surprising functionality designs. Empirical results from a controlled study and field deployment are encouraging. Most designers rated computationally created sets to be of the comparable or superior quality than their own. Designers reported gaining better understanding of available functionalities and the design space.

[1]  D. Schoen,et al.  The Reflective Practitioner: How Professionals Think in Action , 1985 .

[2]  Yvonne Rogers,et al.  New theoretical approaches for human-computer interaction , 2005, Annu. Rev. Inf. Sci. Technol..

[3]  Erik Stolterman,et al.  Design research at CHI and its applicability to design practice , 2013, CHI.

[4]  G. Nemhauser,et al.  Integer Programming , 2020 .

[5]  Jonas Löwgren,et al.  Thoughtful Interaction Design: A Design Perspective on Information Technology , 2004 .

[6]  Joseph Naor,et al.  A Tight Linear Time (1/2)-Approximation for Unconstrained Submodular Maximization , 2015, SIAM J. Comput..

[7]  Joseph Naor,et al.  A Tight Linear Time (1/2)-Approximation for Unconstrained Submodular Maximization , 2012, 2012 IEEE 53rd Annual Symposium on Foundations of Computer Science.

[8]  Aaron Hertzmann,et al.  DesignScape: Design with Interactive Layout Suggestions , 2015, CHI.

[9]  Krzysztof Z. Gajos,et al.  SUPPLE: automatically generating user interfaces , 2004, IUI '04.

[10]  Patrick R. McMullen,et al.  Optimal product design using a colony of virtual ants , 2007, Eur. J. Oper. Res..

[11]  Satoru Iwata,et al.  A combinatorial strongly polynomial algorithm for minimizing submodular functions , 2001, JACM.

[12]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[13]  Marisa E. Campbell,et al.  Conference preview: HCI 2000: usability or else! , 2000, INTR.

[14]  Karl T. Ulrich,et al.  Special Issue on Design and Development: Product Development Decisions: A Review of the Literature , 2001, Manag. Sci..

[15]  Nigan Bayazit,et al.  Investigating Design: A Review of Forty Years of Design Research , 2004, Design Issues.

[16]  Shumin Zhai,et al.  Performance Optimization of Virtual Keyboards , 2002 .

[17]  James B. Orlin,et al.  A faster strongly polynomial minimum cost flow algorithm , 1993, STOC '88.

[18]  Donald L. Fisher,et al.  Optimal Performance Engineering: Good, Better, Best , 1993 .

[19]  Jakob Nielsen,et al.  Chapter 4 – The Usability Engineering Lifecycle , 1993 .

[20]  John M. Carroll,et al.  Human-computer interaction: psychology as a science of design , 1997, Int. J. Hum. Comput. Stud..

[21]  Dan Saffer,et al.  Designing for Interaction: Creating Innovative Applications and Devices , 2009 .

[22]  Jean Vanderdonckt,et al.  Applying model-based techniques to the development of UIs for mobile computers , 2001, IUI '01.

[23]  Jock D. Mackinlay,et al.  Automating the design of graphical presentations of relational information , 1986, TOGS.

[24]  John S. Gero,et al.  Drawings and the design process , 1998 .

[25]  Peter G. Anderson,et al.  Designing better keyboards via simulated annealing , 2016 .

[26]  Paul A. Beardsley,et al.  Design galleries: a general approach to setting parameters for computer graphics and animation , 1997, SIGGRAPH.

[27]  Rainer E. Burkard,et al.  Entwurf von Schreibmaschinentastaturen mittels quadratischer Zuordnungsprobleme , 1977, Math. Methods Oper. Res..

[28]  Yvonne Rogers,et al.  NEW THEORETICAL APPROACHES FOR HCI , 2004 .

[29]  Chun-Chih Chen,et al.  Integrating the Kano model into a robust design approach to enhance customer satisfaction with product design , 2008 .

[30]  Antti Oulasvirta,et al.  MenuOptimizer: interactive optimization of menu systems , 2013, UIST.

[31]  R. J. Bogumil,et al.  The reflective practitioner: How professionals think in action , 1985, Proceedings of the IEEE.

[32]  Marshall L. Fisher,et al.  Demand Estimation and Assortment Optimization Under Substitution: Methodology and Application , 2007, Oper. Res..

[33]  Daniel Tunkelang,et al.  Design for interaction , 2009, SIGMOD Conference.

[34]  D. Thompson,et al.  The Social Utility of Feature Creep , 2011 .

[35]  Antti Oulasvirta,et al.  Improvements to keyboard optimization with integer programming , 2014, UIST.

[36]  Louis L. Bucciarelli,et al.  Designing Engineers , 1994 .

[37]  Dan R. Olsen,et al.  User Interface Management Systems: Models and Algorithms , 1991 .

[38]  N. Cross Designerly ways of knowing , 2006 .

[39]  Angel R. Puerta,et al.  A Model-Based Interface Development Environment , 1997, IEEE Softw..

[40]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[41]  N. Kano,et al.  Attractive Quality and Must-Be Quality , 1984 .

[42]  Nigel Cross,et al.  Design Thinking: Understanding How Designers Think and Work , 2011 .

[43]  Bernhard Sendhoff,et al.  Robust Optimization - A Comprehensive Survey , 2007 .

[44]  Stefan Holmlid,et al.  Interaction design and service design: Expanding a comparison of design disciplines , 2007, Nordes 2007: Design Inquiries.

[45]  Elizabeth D. Mynatt,et al.  Variation in element and action: supporting simultaneous development of alternative solutions , 2004, CHI.

[46]  Jerry Alan Fails,et al.  Interactive machine learning , 2003, IUI '03.

[47]  Victor J. Rayward-Smith,et al.  The next release problem , 2001, Inf. Softw. Technol..

[48]  Ranjitha Kumar,et al.  Data-driven Web Design , 2012, ICML.

[49]  Antti Oulasvirta,et al.  User Interface Design with Combinatorial Optimization , 2017, Computer.

[50]  Marco Lützenberger,et al.  Applying Model-Based Techniques to the Development of UIs for Agent Systems , 2012, PAAMS.

[51]  Alexander Schrijver,et al.  A Combinatorial Algorithm Minimizing Submodular Functions in Strongly Polynomial Time , 2000, J. Comb. Theory B.

[52]  Thomas P. Moran,et al.  Questions, Options, and Criteria: Elements of Design Space Analysis , 1991, Hum. Comput. Interact..

[53]  Allan D. Shocker,et al.  A Consumer-Based Methodology for the Identification of New Product Ideas , 1974 .

[54]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[55]  Aaron Hertzmann,et al.  Learning Layouts for Single-PageGraphic Designs , 2014, IEEE Transactions on Visualization and Computer Graphics.

[56]  W. Buxton Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[57]  Bill Buxton,et al.  Sketching User Experiences: Getting the Design Right and the Right Design , 2007 .

[58]  Nigel Cross,et al.  Creativity in the design process: co-evolution of problem–solution , 2001 .

[59]  Shumin Zhai,et al.  Performance Optimization of Virtual Keyboards , 2002, Hum. Comput. Interact..

[60]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[61]  Yvonne Rogers,et al.  Interaction Design: Beyond Human-Computer Interaction , 2002 .

[62]  Roger Jianxin Jiao,et al.  Product family design and platform-based product development: a state-of-the-art review , 2007, J. Intell. Manuf..

[63]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[64]  Nigel Cross,et al.  Expertise in Design: an overview , 2004 .

[65]  Sergio Segura,et al.  Automated analysis of feature models 20 years later: A literature review , 2010, Inf. Syst..

[66]  Ron Wakkary,et al.  Understanding interaction design practices , 2011, CHI.

[67]  Kenneth R. Koedinger,et al.  Predictive human performance modeling made easy , 2004, CHI.

[68]  John M. Carroll Human-computer interaction: psychology as a science of design. , 1997 .

[69]  Antti Oulasvirta,et al.  Sketchplore: Sketch and Explore with a Layout Optimiser , 2016, Conference on Designing Interactive Systems.

[70]  William R. King,et al.  A meta-analysis of the technology acceptance model , 2006, Inf. Manag..

[71]  Lauralee Alben,et al.  Quality of experience: defining the criteria for effective interaction design , 1996, INTR.