Incremental user-interface development for interactive multiobjective optimization

Interactive multiobjective optimization (IMO) is a subfield of multiple criteria decision making. In multiobjective optimization, the optimization problem is formulated with a mathematical model containing several conflicting objectives and constraints depending on decision variables. By using IMO methods, a decision maker progressively provides preference information in order to find the most satisfactory compromise between the conflicting objectives. In this paper, we consider implementation challenges of IMO methods. In particular, we consider what kind of interaction techniques can support the decision making process and information exchange between IMO methods and the decision maker. The implementation of an IMO method called Pareto Navigator is used as an example to demonstrate concrete challenges of interaction design. This paper focuses on describing the incremental development of the user interface for Pareto Navigator including empirical validation by user testing evaluation.

[1]  Barbara Mirel,et al.  Interaction Design for Complex Problem Solving: Developing Useful and Usable Software , 2003 .

[2]  Thomas A. Schwandt.  Dictionary of qualitative inquiry , 2001 .

[3]  Jyrki Wallenius,et al.  Multiple Criteria Decision Making: From Early History to the 21st Century , 2011 .

[4]  Andrzej Osyczka,et al.  Multicriteria Design Optimization: Procedures and Applications , 1990 .

[5]  Pekka Korhonen,et al.  A pareto race , 1988 .

[6]  Kristin A. Cook,et al.  Illuminating the Path: The Research and Development Agenda for Visual Analytics , 2005 .

[7]  Theodor J. Stewart,et al.  Multiple criteria decision analysis - an integrated approach , 2001 .

[8]  Kathrin Klamroth,et al.  Pareto navigator for interactive nonlinear multiobjective optimization , 2010, OR Spectr..

[9]  Jakob Nielsen,et al.  Estimating the number of subjects needed for a thinking aloud test , 1994, Int. J. Hum. Comput. Stud..

[10]  Peter G. Polson,et al.  Theory-Based Design for Easily Learned Interfaces , 1990, Hum. Comput. Interact..

[11]  Cathleen Wharton,et al.  Testing a walkthrough methodology for theory-based design of walk-up-and-use interfaces , 1990, CHI '90.

[12]  Ignacy Kaliszewski,et al.  Out of the mist--towards decision-maker-friendly multiple criteria decision making support , 2004, Eur. J. Oper. Res..

[13]  Joseph F. Dumas,et al.  A Practical Guide to Usability Testing , 1993 .

[14]  Peter Filzmoser,et al.  Uncertainty‐Aware Exploration of Continuous Parameter Spaces Using Multivariate Prediction , 2011, Comput. Graph. Forum.

[15]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[16]  Kaisa Miettinen,et al.  Global formulation for interactive multiobjective optimization , 2011, OR Spectr..

[17]  Kaisa Miettinen,et al.  Introduction to Multiobjective Optimization: Noninteractive Approaches , 2008, Multiobjective Optimization.

[18]  Robin Jeffries,et al.  Applying cognitive walkthroughs to more complex user interfaces: experiences, issues, and recommendations , 1992, CHI.

[19]  Daniel A. Keim,et al.  Challenges in Visual Data Analysis , 2006, Tenth International Conference on Information Visualisation (IV'06).

[20]  Peter Draper,et al.  Dictionary of Qualitative Inquiry, 2nd edition , 2002 .

[21]  J. Popay,et al.  Rationale and Standards for the Systematic Review of Qualitative Literature in Health Services Research , 1998, Qualitative health research.

[22]  Dorothy Horsburgh,et al.  Evaluation of qualitative research. , 2003, Journal of clinical nursing.

[23]  Kathleen M. Eisenhardt,et al.  Theory Building From Cases: Opportunities And Challenges , 2007 .

[24]  M. Myers.  Qualitative Research and the Generalizability Question: Standing Firm with Proteus , 2000 .

[25]  D. Norman.  Emotional design : why we love (or hate) everyday things , 2004 .

[26]  Theodor J. Stewart,et al.  Real-World Applications of Multiobjective Optimization , 2008, Multiobjective Optimization.

[27]  Heinz Roland Weistroffer,et al.  A flexible method for nonlinear multicriteria decision-making problems , 1989, IEEE Trans. Syst. Man Cybern..

[28]  Kaisa Miettinen,et al.  Synchronous approach in interactive multiobjective optimization , 2006, Eur. J. Oper. Res..

[29]  Jean-Charles Pomerol,et al.  Scenario development and practical decision making under uncertainty , 1999, Decis. Support Syst..

[30]  Cathleen Wharton,et al.  The cognitive walkthrough method: a practitioner's guide , 1994 .

[31]  Patrick A. Holleran,et al.  A methodological note on pitfalls in usability testing , 1991 .

[32]  Sang M. Lee,et al.  An exploratory cognitive DSS for strategic decision making , 2003, Decis. Support Syst..

[33]  Steve Higgins,et al.  Computer-Aided Qualitative Analysis of Interview Data: Some Recommendations for Collaborative Working , 2000 .

[34]  Kaisa Miettinen,et al.  IND-NIMBUS for Demanding Interactive Multiobjective Optimization , 2006 .

[35]  Kaisa Miettinen,et al.  Survey of methods to visualize alternatives in multiple criteria decision making problems , 2012, OR Spectrum.

[36]  Theodor J. Stewart,et al.  Multiple Criteria Decision Analysis , 2001 .

[37]  Tamara Munzner,et al.  A Nested Model for Visualization Design and Validation , 2009, IEEE Transactions on Visualization and Computer Graphics.

[38]  A. Heinzl,et al.  Positive emotions in IS , 2014 .

[39]  Jakob Nielsen,et al.  A mathematical model of the finding of usability problems , 1993, INTERCHI.

[40]  Kaisa Miettinen,et al.  Introduction to Multiobjective Optimization: Interactive Approaches , 2008, Multiobjective Optimization.

[41]  James J. Thomas,et al.  Defining Insight for Visual Analytics , 2009, IEEE Computer Graphics and Applications.

[42]  C. Hwang.  Multiple Objective Decision Making - Methods and Applications: A State-of-the-Art Survey , 1979 .

[43]  G. Bonanno,et al.  Emotions : current issues and future directions , 2001 .

[44]  William Buxton,et al.  Usability evaluation considered harmful (some of the time) , 2008, CHI.

[45]  Jean Scholtz,et al.  Beyond Usability: Evaluation Aspects of Visual Analytic Environments , 2006, 2006 IEEE Symposium On Visual Analytics Science And Technology.

[46]  Kaisa Miettinen,et al.  Wastewater treatment: New insight provided by interactive multiobjective optimization , 2011, Decis. Support Syst..

[47]  Natalia Juristo Juzgado,et al.  Guidelines for Eliciting Usability Functionalities , 2007, IEEE Transactions on Software Engineering.

[48]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[49]  Tamara Munzner,et al.  Process and Pitfalls in Writing Information Visualization Research Papers , 2008, Information Visualization.