Quantitative support for UX methods identification: how can multiple criteria decision making help?

This paper presents views on how quantitative multiple criteria decision-making (MCDM) approaches may be applied to certain aspects of user experience design and evaluation (D&E) methods identification, emphasizing its strengths and weaknesses for this task. Often D&E methods need to be applied in contexts different of those they had been applied before and as such must be transferred to those new contexts. This work presents a model for the quantitative method matching step of the transfer process, describes how different MCDM methods can be applied to this task, and discusses the results of an experience that tried to apply a couple of MCDM procedures to method selection.

[1]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[2]  Valerie Belton,et al.  A Framework for Group Decision Using a MCDA Model: Sharing, Aggregating or Comparing Individual Information? , 1997 .

[3]  Kasper Hornbæk,et al.  Ingredients and Meals Rather Than Recipes: A Proposal for Research That Does Not Treat Usability Evaluation Methods as Indivisible Wholes , 2011, Int. J. Hum. Comput. Interact..

[4]  Eleni Stroulia,et al.  Structural and Semantic Matching for Assessing Web-service Similarity , 2005, Int. J. Cooperative Inf. Syst..

[5]  Karen Holtzblatt,et al.  Contextual design: an emergent view of system design , 1990, CHI '90.

[6]  Catarina Ferreira Da Silva,et al.  The Semantic Side of Service-Oriented Architectures , 2010 .

[7]  Jean Pierre Brans,et al.  HOW TO SELECT AND HOW TO RANK PROJECTS: THE PROMETHEE METHOD , 1986 .

[8]  Julie A. Jacko,et al.  A systematic examination of universal design resources: part 1, heuristic evaluation , 2008, Universal Access in the Information Society.

[9]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[10]  Virpi Roto,et al.  Identifying hedonic factors in long-term user experience , 2011, DPPI.

[11]  Kaisa Miettinen,et al.  On scalarizing functions in multiobjective optimization , 2002, OR Spectr..

[12]  Y. De Smet,et al.  Visual PROMETHEE: Developments of the PROMETHEE & GAIA multicriteria decision aid methods , 2009, 2009 IEEE International Conference on Industrial Engineering and Engineering Management.

[13]  G. Mentzas,et al.  Semantic Enterprise Application Integration for Business Processes: Service-Oriented Frameworks , 2009 .

[14]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[15]  Shu-Cherng Fang,et al.  A genetic-based framework for solving (multi-criteria) weighted matching problems , 2003, Eur. J. Oper. Res..

[16]  Tsvi Kopelowitz,et al.  Property matching and weighted matching , 2006, Theor. Comput. Sci..

[17]  Xavier Ferré,et al.  Usability Planner: A Tool to Support the Process of Selecting Usability Methods , 2011, INTERACT.

[18]  Y. Rogers.  The psychology of human-computer interaction: S.K. Card, T.P. Moran and A. Newell Lawrence Erlbaum Associates, London, pp 469 + xiii, £27.50 (hardback) , 1984 .

[19]  Ward Edwards,et al.  How to Use Multiattribute Utility Measurement for Social Decisionmaking , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[20]  Xavier Gandibleux,et al.  Multiple Criteria Optimization: State of the Art Annotated Bibliographic Surveys , 2013 .

[21]  Leila Zemmouchi-Ghomari,et al.  A Comparative Study: Syntactic versus Semantic Matching Systems , 2009, 2009 International Conference on Complex, Intelligent and Software Intensive Systems.

[22]  Risto Lahdelma,et al.  SMAA-2: Stochastic Multicriteria Acceptability Analysis for Group Decision Making , 2001, Oper. Res..

[23]  Matthias Ehrgott,et al.  Multiple criteria decision analysis: state of the art surveys , 2005 .

[24]  Jakob Nielsen,et al.  SunWeb: User Interface Design for Sun Microsystem's Internal Web , 1995, Comput. Networks ISDN Syst..

[25]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[26]  G. Norman.  Likert scales, levels of measurement and the “laws” of statistics , 2010, Advances in health sciences education : theory and practice.