The construal of experience in HCI: Understanding self-reports

Abstract Design is driven by our understanding of users’ experiences. This understanding rests primarily upon users’ reports of their experiences, in the moment, after the fact, or ahead of time. In this paper we ask how the study of and design for experience might be better informed by attending more carefully to differences between these reports. Based on a broad and interdisciplinary literature review, we develop a conceptual framework of multiple selves, each representing a stage in the consolidation of experience accessed by self-report. We explore the use of this framework to support the interpretation of user experience, provide insight into users’ evaluations of their own experiences, and emphasise the importance of design for experience as lived and reflected upon. We discuss the implications of this framing of experience for design, particularly in the case of systems to support self-knowledge, wellbeing, behaviour change, reflection, and decision making.

[1]  N. Bolger,et al.  Diary methods: capturing life as it is lived. , 2003, Annual review of psychology.

[2]  Virpi Roto,et al.  Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI , 2005, CHI.

[3]  Nancy Staggers,et al.  Mental Models: Concepts for Human-Computer Interaction Research , 1993, Int. J. Man Mach. Stud..

[4]  S. Shiffman,et al.  Capturing momentary, self-report data: A proposal for reporting guidelines , 2002, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[5]  G. Miller,et al.  Science Perspectives on Psychological the Smartphone Psychology Manifesto on Behalf Of: Association for Psychological Science the Smartphone Psychology Manifesto Previous Research Using Mobile Electronic Devices What Smartphones Can Do Now and Will Be Able to Do in the near Future , 2022 .

[6]  Artie Konrad,et al.  Change of Heart: Emotion Tracking to Promote Behavior Change , 2015, CHI.

[7]  Den Dolech,et al.  From Perception to Experience, from Affordances to Irresistibles , 2003 .

[8]  Antti Oulasvirta,et al.  Field Experiments in HCI: Promises and Challenges , 2009 .

[9]  Edward R. Watkins,et al.  Ruminative Self-Focus and Negative Affect , 2008, Journal of abnormal psychology.

[10]  Ross Wilson,et al.  Self-Defining Memory Cues: Creative Expression and Emotional Meaning , 2015, CHI Extended Abstracts.

[11]  Richard Harper,et al.  Fixity: Identity, Time and Dur on Facebook , 2012 .

[12]  Norbert Schwarz,et al.  Why researchers should think "real-time": A cognitive rationale. , 2012 .

[13]  Panos Markopoulos,et al.  Things That Make Us Reminisce: Everyday Memory Cues as Opportunities for Interaction Design , 2015, CHI.

[14]  Joseph E. Schwartz,et al.  The accuracy of pain and fatigue items across different reporting periods , 2008, PAIN.

[15]  K. Radzeviciute.  Behaviour Research and Therapy-Predictors of Obsessive Compulsive Disorder: A Preliminary Investigation , 2017 .

[16]  Dan Cosley,et al.  Pensieve: supporting everyday reminiscence , 2010, CHI.

[17]  John L. Florell,et al.  Sharing , 1979 .

[18]  Julian Frommel,et al.  Integrated Questionnaires: Maintaining Presence in Game Environments for Self-Reported Data Acquisition , 2015, CHI PLAY.

[19]  Massimo Magni,et al.  'To play or not to play': A cross-temporal investigation using hedonic and instrumental perspectives to explain user intentions to explore a technology , 2010, Int. J. Hum. Comput. Stud..

[20]  Jodi Forlizzi,et al.  Understanding experience in interactive systems , 2004, DIS '04.

[21]  Celso Augusto de Matos,et al.  Service Recovery Paradox: A Meta-Analysis , 2007 .

[22]  M. Conway,et al.  The remembering–imagining system , 2016 .

[23]  David W. McDonald,et al.  Theory-driven design strategies for technologies that support behavior change in everyday life , 2009, CHI.

[24]  Virgílio A. F. Almeida,et al.  Dawn of the Selfie Era: The Whos, Wheres, and Hows of Selfies on Instagram , 2015, COSN.

[25]  V. Busacchi,et al.  ON NARRATIVE IDENTITY , 2018, 5th SGEM International Multidisciplinary Scientific Conferences on SOCIAL SCIENCES and ARTS SGEM2018, Ancience Science.

[26]  E. Beurs,et al.  Self-monitoring of panic attacks and retrospective estimates of panic: discordant findings. , 1992, Behaviour research and therapy.

[27]  Paul A. Cairns,et al.  Attention, time perception and immersion in games , 2013, CHI Extended Abstracts.

[28]  Remus Ilies,et al.  Understanding the dynamic relationships among personality, mood, and job satisfaction: A field experience sampling study , 2002 .

[29]  R. Calvo,et al.  Positive Computing: Technology for Wellbeing and Human Potential , 2014, Psychology Teaching Review.

[30]  Connor Graham,et al.  A Review of Mobile HCI Research Methods , 2003, Mobile HCI.

[31]  L. F. Barrett,et al.  Trends in ambulatory self-report: the role of momentary experience in psychosomatic medicine. , 2012, Psychosomatic medicine.

[32]  Sharon L. Oviatt,et al.  Human-centered design meets cognitive load theory: designing interfaces that help people think , 2006, MM '06.

[33]  Mark Begale,et al.  Purple: A Modular System for Developing and Deploying Behavioral Intervention Technologies , 2014, Journal of medical Internet research.

[34]  David R. Millen,et al.  Identity management: multiple presentations of self in facebook , 2007, GROUP.

[35]  Daniel J. Beal,et al.  Methods of Ecological Momentary Assessment in Organizational Research , 2003 .

[36]  Sherry Turkle,et al.  Constructions and reconstructions of self in virtual reality: Playing in the MUDs , 1994 .

[37]  Willem-Paul Brinkman.  Design of a Questionnaire Instrument , 2009 .

[38]  Pieter Desmet,et al.  Designing Products with Added Emotional Value: Development and Appllcation of an Approach for Research through Design , 2001 .

[39]  Steve Whittaker,et al.  Echoes from the past: how technology mediated reflection improves well-being , 2013, CHI.

[40]  Facilitative and rememberative: novel incentive structures for increased exercise in interactive media , 2014, CSOC.

[41]  Deborah Estrin,et al.  AndWellness: an open mobile system for activity and experience sampling , 2010, Wireless Health.

[42]  D. Kahneman.  Thinking, Fast and Slow , 2011 .

[43]  Carl Gutwin,et al.  Peak-End Effects on Player Experience in Casual Games , 2016, CHI.

[44]  Paul Dourish,et al.  Affect: from information to interaction , 2005, Critical Computing.

[45]  E.A.W.H. van den Hoven,et al.  A future-proof past: Designing for remembering experiences: , 2014 .

[46]  E. Deci,et al.  The "What" and "Why" of Goal Pursuits: Human Needs and the Self-Determination of Behavior , 2000 .

[47]  Jordan Beck,et al.  Slow change interaction design , 2014, INTR.

[48]  Sari Kujala,et al.  Lost in time: the meaning of temporal aspects in user experience , 2013, CHI Extended Abstracts.

[49]  Shelly Chaiken,et al.  The Heuristic-Systematic Model of Social Information Processing , 2002 .

[50]  Leysia Palen,et al.  Chatting with teenagers: Considering the place of chat technologies in teen life , 2006, TCHI.

[51]  Abigail Durrant,et al.  Fitter, happier, more productive , 2016, Interactions.

[52]  Wei Dong,et al.  Who am I on twitter?: a cross-country comparison , 2014, WWW '14 Companion.

[53]  Steve Howard,et al.  Designing for Flow in a Complex Activity , 2004, APCHI.

[54]  Patrick Olivier,et al.  Designing for mental wellbeing: towards a more holistic approach in the treatment and prevention of mental illness , 2015, BCS HCI.

[55]  A. Shachak,et al.  The impact of electronic medical records on patient-doctor communication during consultation: a narrative literature review. , 2009, Journal of evaluation in clinical practice.

[56]  M. Conway,et al.  Remembering and imagining: The role of the self , 2011, Consciousness and Cognition.

[57]  L. Carstensen,et al.  Taking time seriously. A theory of socioemotional selectivity. , 1999, The American psychologist.

[58]  Lena Mamykina,et al.  MAHI: investigation of social scaffolding for reflective thinking in diabetes management , 2008, CHI.

[59]  John Zimmerman,et al.  Measuring the dynamics of remembered experience over time , 2010, Interact. Comput..

[60]  Donald A. Norman,et al.  THE WAY I SEE ITMemory is more important than actuality , 2009, INTR.

[61]  H. Markus,et al.  THE DYNAMIC SELF-CONCEPT: A Social Psychological Perspective , 1987 .

[62]  David W. McDonald,et al.  Activity sensing in the wild: a field trial of ubifit garden , 2008, CHI.

[63]  D. Kahneman,et al.  Well-being : the foundations of hedonic psychology , 1999 .

[64]  Lucienne Blessing,et al.  User Experience Lifecycle Model ContinUE [ Continuous User Experience ] , 2010 .

[65]  Erika D Peterson,et al.  Temporal Adjustments in the Evaluation of Events: The "Rosy View" , 1997, Journal of experimental social psychology.

[66]  Leaf Van Boven,et al.  To do or to have? That is the question. , 2003, Journal of personality and social psychology.

[67]  Predrag V. Klasnja,et al.  Mind the theoretical gap: interpreting, using, and developing behavioral theory in HCI research , 2013, CHI.

[68]  Daniel Kahneman,et al.  Living, and thinking about it: two perspectives on life , 2005 .

[69]  S. Hormuth.  The sampling of experiences in situ , 1986 .

[70]  D. Mostofsky.  The Handbook of Behavioral Medicine , 2014 .

[71]  W. Agras,et al.  Panic Attacks in the Natural Environmet , 1987, The Journal of nervous and mental disease.

[72]  J. Teasdale,et al.  Adaptive and maladaptive self-focus in depression. , 2004, Journal of affective disorders.

[73]  Tracy K. Witte,et al.  Variability in suicidal ideation: a better predictor of suicide attempts than intensity or duration of ideation? , 2005, Journal of affective disorders.

[74]  L. F. Barrett,et al.  A Practical Guide to Experience-Sampling Procedures , 2003 .

[75]  Jodi Forlizzi,et al.  The building blocks of experience: an early framework for interaction designers , 2000, DIS '00.

[76]  T. Trull,et al.  Ecological momentary assessment of mood disorders and mood dysregulation. , 2009, Psychological assessment.

[77]  Mark D. Dunlop,et al.  Toward a Multidisciplinary Model of Context to Support Context-Aware Computing , 2005, Hum. Comput. Interact..

[78]  William D. Barta,et al.  Measurement reactivity in diary research. , 2012 .

[79]  Abigail Sellen,et al.  Beyond total capture , 2010, Commun. ACM.

[80]  N. Nicolson,et al.  Effects of antidepressant treatment on the quality of daily life: an experience sampling study. , 2002, The Journal of clinical psychiatry.

[81]  Thomas Erickson.  Creating kairos , 2015, Interactions.

[82]  J. G. Holmes,et al.  Reconstruction of Relationship Memories: A Mental Models Approach , 1994 .

[83]  Alex Pentland,et al.  The social fMRI: measuring, understanding, and designing social mechanisms in the real world , 2011, UbiComp '11.

[84]  D. Kahneman,et al.  When More Pain Is Preferred to Less: Adding a Better End , 1993 .

[85]  John Zimmerman,et al.  User experience over time: an initial framework , 2009, CHI.

[86]  John Zimmerman,et al.  An analysis and critique of Research through Design: towards a formalization of a research approach , 2010, Conference on Designing Interactive Systems.

[87]  S. Shiffman,et al.  Ecological momentary assessment. , 2008, Annual review of clinical psychology.

[88]  T. Trull,et al.  Clinical assessment of affective instability: comparing EMA indices, questionnaire reports, and retrospective recall. , 2009, Psychological assessment.

[89]  L. F. Barrett,et al.  Experience Sampling Methods: A Modern Idiographic Approach to Personality Research. , 2009, Social and personality psychology compass.

[90]  T. Kubiak,et al.  Trait anger moderates the impact of anger-associated rumination on social well-being☆ , 2011 .

[91]  John T. Cacioppo,et al.  The Elaboration Likelihood Model of Persuasion , 1986, Advances in Experimental Social Psychology.

[92]  James M. Boyle,et al.  A systematic literature review of empirical evidence on computer games and serious games , 2012, Comput. Educ..

[93]  Michael F. Armey,et al.  Changes in ecological momentary assessment reported affect associated with episodes of nonsuicidal self-injury. , 2011, Behavior therapy.

[94]  John C. McCarthy,et al.  Technology as experience , 2004, INTR.

[95]  M. Murphy,et al.  Experience-Sampling Research Methods and Their Potential for Education Research , 2015 .

[96]  Carl Gutwin,et al.  Examining the Peak-End Effects of Subjective Experience , 2015, CHI.

[97]  M Ross,et al.  Women's theories of menstruation and biases in recall of menstrual symptoms. , 1989, Journal of personality and social psychology.

[98]  Celine Latulipe,et al.  Love, hate, arousal and engagement: exploring audience responses to performing arts , 2011, CHI.

[99]  N. McGlynn.  Thinking fast and slow. , 2014, Australian veterinary journal.

[100]  Leslie Haddon,et al.  Design and the domestication of information and communication technologies: technical change and everyday life , 1996 .

[101]  Martin A. Conway,et al.  The Self and Autobiographical Memory: Correspondence and Coherence , 2004 .

[102]  Stephen A. Rains,et al.  The Social Dimension of Blogging about Health: Health Blogging, Social Support, and Well-being , 2011 .

[103]  Yanqing Cui,et al.  Motivations for accessing social networking services on mobile devices , 2012, AVI.

[104]  Erik Stolterman,et al.  How interactive artifacts "change" over time: a visual analysis , 2012, NordiCHI.

[105]  Justin Kruger,et al.  What to Do on Spring Break? , 2003, Psychological science.

[106]  Elena Karahanna,et al.  Time Flies When You're Having Fun: Cognitive Absorption and Beliefs About Information Technology Usage , 2000, MIS Q..

[107]  David C. Rubin,et al.  A Tale of Three Functions: The Self-Reported Uses of Autobiographical Memory. , 2005 .

[108]  Martin A. Conway,et al.  Remembering, imagining, false memories & personal meanings , 2015, Consciousness and Cognition.

[109]  Daniel J. Barrett,et al.  An Introduction to Computerized Experience Sampling in Psychology , 2001 .

[110]  C. Dweck,et al.  A social-cognitive approach to motivation and personality , 1988 .

[111]  T. Trull,et al.  Ambulatory Assessment : An Innovative and Promising Approach for Clinical Psychology , 2009 .

[112]  Natasha Dow Schll.  Addiction by Design: Machine Gambling in Las Vegas , 2012 .

[113]  Alan Cooper,et al.  About Face 3: the essentials of interaction design , 1995 .

[114]  T. Trull,et al.  Experience sampling methods in clinical psychology , 2013 .

[115]  Patricia A. Chalmers,et al.  The role of cognitive theory in human-computer interface , 2003, Comput. Hum. Behav..

[116]  S. Shiffman,et al.  A comparison of coping assessed by ecological momentary assessment and retrospective recall. , 1998, Journal of personality and social psychology.

[117]  Stefan Rennick Egglestone,et al.  Health Technologies 'In the Wild': Experiences of Engagement with Computerised CBT , 2016, CHI.

[118]  Michael E. Labhard,et al.  Mobile Therapy: Case Study Evaluations of a Cell Phone Application for Emotional Self-Awareness , 2010, Journal of medical Internet research.

[119]  Yaacov Trope,et al.  Temporal construal. , 2003, Psychological review.

[120]  Stanley Presser,et al.  The Open and Closed Question , 1979 .

[121]  Timothy D. Wilson,et al.  Miswanting: Some Problems in the Forecasting of Future Affective States , 2000 .

[122]  David Jones,et al.  Know thyself! , 1992, Nature.

[123]  R. Belk.  Sharing: Table 1 , 2010 .

[124]  Johan Redström,et al.  Slow Technology – Designing for Reflection , 2001, Personal and Ubiquitous Computing.

[125]  E. Diener,et al.  Experience Sampling: Promises and Pitfalls, Strengths and Weaknesses , 2003 .

[126]  Andreas Möller,et al.  Investigating self-reporting behavior in long-term studies , 2013, CHI.