Beyond Usability: An Alternative Usability Evaluation Method, PUT-Q2

Usability can be thought of as a measure or degree to which a system satisfies the needs of the human. Usability is a quality inherent to any given system, which assists in determining the efficiency, effectiveness and satisfaction levels of those involved in the interaction. Everyday we are bombarded with interactions and experiences that shape our thoughts, values, and judgments as well as test our limits of interaction with technology. These interactions have progressed at such an intense pace that humans have become practically slaves to technological innovation. Humans are forced to conform with needs of technology, rather then technology conforming to human needs. This fact must be rectified and becomes the primary focus of this thesis. Current models in usability evaluation methods (UEMs) analyze the quantitative data collected during testing. These statistical studies provide insight into limited aspects of usability, and most overlook human dimensions, including perception and affective responses; thus leaving a glaring pitfall in the overall analysis of system usability. By analyzing a new qualitative channel of data, this research attempts to explain these human-dimensional factors. Up to this point no evaluation model has been largely accepted which attempts to fuse both qualitative and quantitative data. This research proposes an alternative UEM, incorporating both qualitative and quantitative data, called the Perception and Usability Testing combining Qualitative and Quantitative data, or PUT-Q2. This new usability evaluation method presents complex qualitative and quantitative data in graphical visualizations and matrices that assist the usability expert in uncovering additional correlations and usability issues with their system.

[1]  B. Skinner,et al.  Giving up the ghost , 1981, Behavioral and Brain Sciences.

[2]  Abbas Tashakkori,et al.  Foundations of Mixed Methods Research: Integrating Quantitative and Qualitative Approaches in the Social and Behavioral Sciences , 2008 .

[3]  Neville A. Stanton,et al.  People and computers VII: Proceedings of the HCI'92 Conference, Septembr 1992 A Monk, D Diaper and M D Harrison, (eds) Cambridge University Press, Cambridge (1992) £40.00, 534 pp., ISBN 0 521 44591 4 , 1993 .

[4]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[5]  A. Karlsen.  [Selection by consequences]. , 1992, Tidsskrift for den Norske laegeforening : tidsskrift for praktisk medicin, ny raekke.

[6]  S. Halling,et al.  Existential-Phenomenological Perspectives in Psychology , 1989 .

[7]  Amaresh Chakrabarti,et al.  Design for Emotions , 2007 .

[8]  M. Manen.  Researching Lived Experience: Human Science for an Action Sensitive Pedagogy , 1990 .

[9]  Wayne D. Gray,et al.  Damaged Merchandise? A Review of Experiments That Compare Usability Evaluation Methods , 1998, Hum. Comput. Interact..

[10]  R. Bogdan.  Qualitative research for education : an introduction to theory and methods / by Robert C. Bogdan and Sari Knopp Biklen , 1997 .

[11]  Jan Gulliksen,et al.  People and Computers XIX - The Bigger Picture, Proceedings of BCS HCI 2005, Napier University, Edinburgh, UK, 5-9 September 2005 , 2006, BCS HCI.

[12]  Barney,et al.  Theoretical Coding : Text Analysis in Grounded Theory , 2004 .

[13]  Spike Cramphorn.  Blink: The Power of Thinking without Thinking / Strangers to Ourselves: Discovering the Adaptive Unconscious , 2006, Journal of Advertising Research.

[14]  Michael E. Atwood,et al.  What is gained and lost when using evaluation methods other than empirical testing , 1993 .

[15]  P. Desmet,et al.  Framework of product experience , 2007 .

[16]  Victor J. Papanek,et al.  Design for the Real World: Human Ecology and Social Change , 1972 .

[17]  John C. McCarthy,et al.  Technology as experience , 2004, INTR.

[18]  H. Hill.  Poetry and Experience , 1966 .

[19]  R. Plutchik.  Emotion, a psychoevolutionary synthesis , 1980 .

[20]  P. Schofield.  A Companion to Qualitative Research , 2005 .

[21]  A. Ortony,et al.  What's basic about basic emotions? , 1990, Psychological review.

[22]  M. Csíkszentmihályi.  Finding Flow: The Psychology of Engagement with Everyday Life , 1997 .

[23]  The design of emotion , 2003 .

[24]  Arthur Asa Berger,et al.  Clotaire Rapaille, The Culture Code: An Ingenious Way to Understand Why People Around the World Live and Buy as They Do , 2008 .

[25]  Elizabeth B.-N. Sanders,et al.  Virtuosos of the Experience Domain , 2001 .

[26]  John Morgan,et al.  See What I Mean: An Introduction to Visual Communication , 1986 .

[27]  D. Norman.  Emotional design : why we love (or hate) everyday things , 2004 .

[28]  P. Atkinson,et al.  Making Sense of Qualitative Data: Complementary Research Strategies , 1996 .

[29]  Janice M. Morse,et al.  Reasons for Rejection/Reasons for Acceptance , 2007 .

[30]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[31]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[32]  Ivan E. Sutherland,et al.  Sketchpad a Man-Machine Graphical Communication System , 1899, Outstanding Dissertations in the Computer Sciences.

[33]  Robert A. Virzi,et al.  Refining the Test Phase of Usability Evaluation: How Many Subjects Is Enough? , 1992 .

[34]  Vannevar Bush,et al.  As we may think , 1945, INTR.

[35]  C. Don.  Looking for Spinoza: Joy, Sorrow, and the Feeling Brain , 2004 .

[36]  John Thackara,et al.  In the Bubble: Designing in a Complex World , 2005 .

[37]  Michael Quinn Patton,et al.  How to use qualitative methods in evaluation , 1987 .

[38]  J. Warren.  Synaptic Self: How our Brains Become who we Are , 2002 .

[39]  D. Jonassen.  Evaluating constructivistic learning , 1991 .

[40]  Steven J. Taylor.  Introduction to qualitative research methods : the search for meanings / by Steven J. Taylor, Robert Bogdan , 1984 .

[41]  J. Creswell.  Qualitative inquiry and research design: choosing among five traditions. , 1998 .

[42]  P. Atkinson,et al.  Making sense of qualitative data , 1996 .

[43]  John Millar Carroll.  HCI Models, Theories, and Frameworks: Toward a Multidisciplinary Science , 2003 .

[44]  C. Moustakas.  Phenomenological Research Methods , 1994 .

[45]  V. Vroom.  Work and motivation , 1964 .

[46]  P. Hekkert,et al.  Design and emotion : the experience of everyday things , 2004 .

[47]  Richard E. Boyatzis,et al.  Transforming Qualitative Information: Thematic Analysis and Code Development , 1998 .

[48]  Jonathan Grudin,et al.  A historical and intellectual perspective , 1995 .

[49]  Clifford Nass,et al.  Emotion in human-computer interaction , 2002 .

[50]  D. Padgett.  Qualitative Methods in Social Work Research: Challenges and Rewards , 1998 .

[51]  Ray Henjum.  Bogdan, Robert & Biklen, Sari K. Qualitative Research for Education: An Introduction to Theory and Methods , second edition. , 1993 .

[52]  A. Strauss,et al.  Basics of qualitative research: Grounded theory procedures and techniques. , 1992 .

[53]  Richard Buchanan,et al.  Design Research and the New Learning , 2001, Design Issues.

[54]  Sean A. Spence,et al.  Descartes' Error: Emotion, Reason and the Human Brain , 1995 .

[55]  Kasper Hornbæk,et al.  Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? , 2000, CHI.

[56]  Chaomei Chen,et al.  Visualizing the Evolution of HCI , 2005, BCS HCI.