Reconstructing experiences with iScale

We present iScale, a survey tool for the retrospective elicitation of longitudinal user experience data. iScale aims to minimize retrospection bias and employs graphing to impose a process during the reconstruction of one's experiences. Two versions, the constructive and the value-account iScale, were motivated by two distinct theories on how people reconstruct emotional experiences from memory. These two versions were tested in two separate studies. Study 1 aimed at providing qualitative insight into the use of iScale and compared its performance to that of free-hand graphing. Study 2 compared the two versions of iScale to free recall, a control condition that does not impose structure on the reconstruction process. Overall, iScale resulted in an increase in the amount, the richness, and the test-retest consistency of recalled information as compared to free recall. These results provide support for the viability of retrospective techniques as a cost-effective alternative to longitudinal studies.

[1]  Bo Edvardsson,et al.  Critical incident techniques: Towards a framework for analysing the criticality of critical incidents , 2001 .

[2]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[3]  Stephanie Rosenbaum,et al.  Best practices in longitudinal research , 2009, CHI Extended Abstracts.

[4]  E. Tulving.  [Episodic memory: from mind to brain]. , 2004, Revue neurologique.

[5]  J. C. Flanagan.  Psychological Bulletin THE CRITICAL INCIDENT TECHNIQUE , 2022 .

[6]  T. J. Reynolds,et al.  Laddering theory, method, analysis, and interpretation. , 2001 .

[7]  U. Neisser.  John Dean's memory: A case study , 1981, Cognition.

[8]  Donald A. Norman,et al.  THE WAY I SEE ITMemory is more important than actuality , 2009, INTR.

[9]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[10]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[11]  N. Schwarz.  Global and Episodic Reports of Hedonic Experience , 2006 .

[12]  Shawn A. Ross,et al.  Survey Methodology , 2005, The SAGE Encyclopedia of the Sociology of Religion.

[13]  Daniel Ullrich,et al.  To do or not to do: Differences in user experience and retrospective judgments depending on the presence or absence of instrumental goals , 2007, Interact. Comput..

[14]  Barbara Means,et al.  Autobiographical memory for health-related events , 1989 .

[15]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[16]  Virpi Roto,et al.  UX Curve: A method for evaluating long-term user experience , 2011, Interact. Comput..

[17]  A. Koriat,et al.  Toward a psychology of memory accuracy. , 2000, Annual review of psychology.

[18]  Wolmet Barendregt,et al.  Identifying usability and fun problems in a computer game during first use and after some practice , 2006, Int. J. Hum. Comput. Stud..

[19]  Marc Hassenzahl,et al.  Capturing Design Space From a User Perspective: The Repertory Grid Technique Revisited , 2000, Int. J. Hum. Comput. Interact..

[20]  Harald Reiterer,et al.  Longitudinal evaluation methods in human-computer studies and visual analytics , 2007 .

[21]  D. Kahneman,et al.  Well-being : the foundations of hedonic psychology , 1999 .

[22]  J. Gutman.  A Means-End Chain Model Based on Consumer Categorization Processes , 1982 .

[23]  L. Barsalou.  The content and organization of autobiographical memories , 1988 .

[24]  Ann Light,et al.  Adding method to meaning: A technique for exploring peoples' experience with technology , 2006, Behav. Inf. Technol..

[25]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[26]  Ulric Neisser,et al.  Remembering Reconsidered: Ecological and Traditional Approaches to the Study of Memory , 1990 .

[27]  Russell Beale,et al.  Longitudinal usability data collection: art versus science? , 2008, CHI Extended Abstracts.

[28]  Erkki Sutinen,et al.  Effects of Experience on Gaze Behavior during Program Animation , 2005, PPIG.

[29]  Jochen Prümper,et al.  Some surprising differences between novice and expert errors in computerized office work , 1992 .

[30]  Michael D. Robinson,et al.  Belief and feeling: evidence for an accessibility model of emotional self-report. , 2002, Psychological bulletin.

[31]  G. Goldschmidt.  The dialectics of sketching , 1991 .

[32]  D. Kahneman,et al.  Patients' memories of painful medical treatments: real-time and retrospective evaluations of two minimally invasive procedures , 1996, Pain.

[33]  V. Reyna,et al.  Development of Gist Versus Verbatim Memory in Sentence Recognition: Effects of Lexical Familiarity, Semantic Content, Encoding Instructions, and Retention Interval , 1994 .

[34]  Thomas Erickson.  The design and long-term use of a personal electronic notebook: a reflective analysis , 1996, CHI '96.

[35]  M. Csíkszentmihályi,et al.  Experience Sampling Method: Measuring the Quality of Everyday Life , 2006 .

[36]  Paul Hekkert,et al.  Shifts in sensory dominance between various stages of user-product interactions. , 2010, Applied ergonomics.

[37]  Marc Hassenzahl,et al.  The Interplay of Beauty, Goodness, and Usability in Interactive Products , 2004, Hum. Comput. Interact..

[38]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[39]  M. Conway,et al.  The construction of autobiographical memories in the self-memory system. , 2000, Psychological review.

[40]  Jodi Forlizzi,et al.  Understanding experience in interactive systems , 2004, DIS '04.

[41]  Peter J. M. Sonnemans,et al.  Quality and Reliability Problems from a Consumer's Perspective: an Increasing Problem Overlooked by Businesses? , 2006, Qual. Reliab. Eng. Int..

[42]  Evangelos Karapanos,et al.  User experience over time , 2008, CHI Extended Abstracts.

[43]  Jan Stage,et al.  A longitudinal study of usability in health care: Does time heal? , 2010, Int. J. Medical Informatics.

[44]  J. Fleiss,et al.  Statistical methods for rates and proportions , 1973 .

[45]  N. Frijda,et al.  The structure of subjective emotional intensity , 1994 .

[46]  B. Everitt,et al.  Statistical methods for rates and proportions , 1973 .

[47]  Stephen J. Anderson,et al.  Investigating the structure of autobiographical memories , 1993 .

[48]  D. Kahneman,et al.  A Survey Method for Characterizing Daily Life Experience: The Day Reconstruction Method , 2004, Science.

[49]  John Zimmerman,et al.  User experience over time: an initial framework , 2009, CHI.

[50]  H. Plessner,et al.  PERSONALITY AND SOCIAL PSYCHOLOGY BULLETIN Betsch et al. / IMPLICIT ATTITUDE FORMATION I Like It but I Don’t Know Why: A Value-Account Approach to Implicit Attitude Formation , 2022 .

[51]  N. Hoffart.  Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory , 2000 .

[52]  Richard Bell,et al.  A manual for repertory grid technique , 1977 .

[53]  V. Reyna,et al.  Development of Gist versus Verbatim Memory in Sentence Recognition: Effects of Lexical Familiarity, Semantic Content, Encoding Instructions, and Retention Interval. , 1994 .