The Experience Sampling Method on Mobile Devices

The Experience Sampling Method (ESM) is used by scientists from various disciplines to gather insights into the intra-psychic elements of human life. Researchers have used the ESM in a wide variety of studies, with the method seeing increased popularity. Mobile technologies have enabled new possibilities for the use of the ESM, while simultaneously leading to new conceptual, methodological, and technological challenges. In this survey, we provide an overview of the history of the ESM, usage of this methodology in the computer science discipline, as well as its evolution over time. Next, we identify and discuss important considerations for ESM studies on mobile devices, and analyse the particular methodological parameters scientists should consider in their study design. We reflect on the existing tools that support the ESM methodology and discuss the future development of such tools. Finally, we discuss the effect of future technological developments on the use of the ESM and identify areas requiring further investigation.

[1]  Lu Bai,et al.  OSN mood tracking: exploring the use of online social network activity as an indicator of mood changes , 2016, UbiComp Adjunct.

[2]  Mattias Linnap,et al.  The effectiveness of centralised management for reducing wasted effort in participatory sensing , 2014, 2014 IEEE International Conference on Pervasive Computing and Communication Workshops (PERCOM WORKSHOPS).

[3]  Stephanie Rosenthal,et al.  Using Decision-Theoretic Experience Sampling to Build Personalized Mobile Phone Interruption Models , 2011, Pervasive.

[4]  Tara Matthews,et al.  Location disclosure to social relations: why, when, & what people want to share , 2005, CHI.

[5]  Weiping Zhu,et al.  CircleSense: A pervasive computing system for recognizing social activities , 2013, 2013 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[6]  Anind K. Dey,et al.  Understanding and Using Context , 2001, Personal and Ubiquitous Computing.

[7]  Dan Xu,et al.  Understanding the Dynamic Relationships among Interpersonal Personality Characteristics, Loneliness, and Smart-Phone Use: Evidence from Experience Sampling , 2015, 2015 International Conference on Computer Science and Mechanical Automation (CSMA).

[8]  Mirco Musolesi,et al.  InterruptMe: designing intelligent prompting mechanisms for pervasive applications , 2014, UbiComp.

[9]  R. Kessler,et al.  Measuring daily events and experiences: decisions for the researcher. , 1991, Journal of personality.

[10]  Paul Lukowicz,et al.  Smartphone based experience sampling of stress-related events , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[11]  Andrew T. Campbell,et al.  Next-generation psychiatric assessment: Using smartphone sensors to monitor behavior and mental health. , 2015, Psychiatric rehabilitation journal.

[12]  Carolyn E. Schwartz,et al.  Exploring response shift in longitudinal data , 2004 .

[13]  Oscar Mayora-Ibarra,et al.  Correlation of significant places with self-reported state of bipolar disorder patients , 2014, 2014 4th International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare Through Innovations in Mobile and Wireless Technologies (MOBIHEALTH).

[14]  Aaron J. Quigley,et al.  Jeeves - A visual programming environment for mobile experience sampling , 2015, 2015 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC).

[15]  Alex Pentland,et al.  Using Social Sensing to Understand the Links between Sleep, Mood, and Sociability , 2011, 2011 IEEE Third International Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third International Conference on Social Computing.

[16]  Cecilia Mascolo,et al.  Contextual dissonance: design bias in sensor-based experience sampling methods , 2013, UbiComp.

[17]  M. Weippert,et al.  24-Hour ambulatory monitoring of complex physiological parameters with a wireless health system: Feasibility, user compliance and application , 2012, International Multi-Conference on Systems, Sygnals & Devices.

[18]  J. Smyth,et al.  Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. , 2010, British journal of health psychology.

[19]  Nicu Sebe,et al.  The SocioMetric Badges Corpus: A Multilevel Behavioral Dataset for Social Behavior in Complex Organizations , 2012, 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Confernece on Social Computing.

[20]  Mary Czerwinski,et al.  Notification, Disruption, and Memory: Effects of Messaging Interruptions on Memory and Performance , 2001, INTERACT.

[21]  Panos Markopoulos,et al.  An experience sampling study into awareness needs of busy families , 2009, 2009 2nd Conference on Human System Interactions.

[22]  Predrag V. Klasnja,et al.  Using wearable sensors and real time inference to understand human recall of routine activities , 2008, UbiComp.

[23]  Sukeshini A. Grandhi,et al.  Knock, knock! who's there? Putting the user in control of managing interruptions , 2015, Int. J. Hum. Comput. Stud..

[24]  Fabio Pianesi,et al.  Ego-centric Graphlets for Personality and Affective States Recognition , 2013, 2013 International Conference on Social Computing.

[25]  Jorge Gonçalves,et al.  A Systematic Assessment of Smartphone Usage Gaps , 2016, CHI.

[26]  Takuya Maekawa,et al.  How Well Can a User’s Location Privacy Preferences be Determined Without Using GPS Location Data? , 2017, IEEE Transactions on Emerging Topics in Computing.

[27]  Adams Js Towards an understanding of inequity , 1963 .

[28]  Peter Lynn The Impact of Incentives on Response Rates to Personal Interview Surveys: Role and Perceptions of Interviewers , 2001 .

[29]  Linda M Collins,et al.  The effect of the timing and spacing of observations in longitudinal studies of tobacco and other drug use: temporal design considerations. , 2002, Drug and alcohol dependence.

[30]  H. Okada,et al.  Development of real-time biological data collection system using a cellular phone , 2007, SICE Annual Conference 2007.

[31]  Gregory D. Abowd,et al.  Prototypes and paratypes: designing mobile and ubiquitous computing applications , 2005, IEEE Pervasive Computing.

[32]  Alexander De Luca,et al.  It's a Hard Lock Life: A Field Study of Smartphone (Un)Locking Behavior and Risk Perception , 2014, SOUPS.

[33]  Rodrigo de Oliveira,et al.  What's up with whatsapp?: comparing mobile instant messaging behaviors with traditional SMS , 2013, MobileHCI '13.

[34]  Matthew B. Weinger,et al.  Development of a hand-held computer platform for real-time behavioral assessment of physicians and nurses , 2010, J. Biomed. Informatics.

[35]  Alex 'Sandy' Pentland,et al.  Sleep, mood and sociability in a healthy population , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[36]  Octav Chipara,et al.  Evaluating auditory contexts and their impacts on hearing aid outcomes with mobile phones , 2014, PervasiveHealth.

[37]  Robert H. Guest,et al.  The Foreman on the Assembly Line , 1959 .

[38]  Matt Jones,et al.  Pico-ing into the future of mobile projection and contexts , 2011, Personal and Ubiquitous Computing.

[39]  J. Haas,et al.  Measurement of compliance with hand hygiene. , 2007, The Journal of hospital infection.

[40]  James A. Landay,et al.  MyExperience: a system for in situ tracing and capturing of user feedback on mobile phones , 2007, MobiSys '07.

[41]  Mor Naaman,et al.  Social Inference Risk Modeling in Mobile and Social Applications , 2009, 2009 International Conference on Computational Science and Engineering.

[42]  M. Csíkszentmihályi,et al.  Experience Sampling Method: Measuring the Quality of Everyday Life , 2006 .

[43]  Gerhard Weiss,et al.  Network Analysis of Ecological Momentary Assessment Data for Monitoring and Understanding Eating Behavior , 2015, ICSH.

[44]  Nuria Oliver,et al.  A large-scale study of daily information needs captured in situ , 2014, TCHI.

[45]  M. Moreno,et al.  "Facebook depression?" social networking site use and depression in older adolescents. , 2012, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[46]  Katarzyna Wac,et al.  Individuals’ Stress Assessment Using Human-Smartphone Interaction Analysis , 2018, IEEE Transactions on Affective Computing.

[47]  Yvonne Rogers,et al.  From spaces to places: emerging contexts in mobile privacy , 2009, UbiComp.

[48]  Bert Arnrich,et al.  Utilizing Emoticons on Mobile Devices within ESM studies to Measure Emotions in the Field , 2009 .

[49]  Rosalind W. Picard,et al.  FEEL: A System for Frequent Event and Electrodermal Activity Labeling , 2014, IEEE Journal of Biomedical and Health Informatics.

[50]  E. Diener,et al.  Experience Sampling: Promises and Pitfalls, Strengths and Weaknesses , 2003 .

[51]  Evangelos Karapanos,et al.  Footprint tracker: supporting diary studies with lifelogging , 2013, CHI.

[52]  Fehmi Ben Abdesslem,et al.  Mobile experience sampling: Reaching the parts of Facebook other methods cannot reach , 2010 .

[53]  Anthony Faiola,et al.  Extreme mediation: observing mental and physical health in everyday life , 2014, UbiComp Adjunct.

[54]  Denzil Ferreira,et al.  Understanding the Challenges of Mobile Phone Usage Data , 2015, MobileHCI.

[55]  Nikhil Sharma,et al.  Photographing information needs: the role of photos in experience sampling method-style research , 2014, CHI.

[56]  Elisabeth Pergler,et al.  A Context-Sensitive Tool to Support Mobile Technology Acceptance Research , 2014, 2014 47th Hawaii International Conference on System Sciences.

[57]  Steve Whittaker,et al.  Echoes from the past: how technology mediated reflection improves well-being , 2013, CHI.

[58]  Kristin E Heron,et al.  Is providing mobile interventions "just-in-time" helpful? an experimental proof of concept study of just-in-time intervention for stress management , 2016, 2016 IEEE Wireless Health (WH).

[59]  Sameer Patil,et al.  Interrupt Now or Inform Later?: Comparing Immediate and Delayed Privacy Feedback , 2015, CHI.

[60]  Konrad P. Körding,et al.  The relationship between clinical, momentary, and sensor-based assessment of depression , 2015, 2015 9th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth).

[61]  L. Martens,et al.  Quantifying QoE of mobile video consumption in a real-life setting drawing on objective and subjective parameters , 2011, 2011 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[62]  M. Csíkszentmihályi,et al.  The Experience Sampling Method , 2014 .

[63]  Jorge Gonçalves,et al.  Gamification of Mobile Experience Sampling Improves Data Quality and Quantity , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[64]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[65]  Jennifer Mankoff,et al.  When participants do the capturing: the role of media in diary studies , 2005, CHI.

[66]  Matthew Kay,et al.  Researcher-Centered Design of Statistics: Why Bayesian Statistics Better Fit the Culture and Incentives of HCI , 2016, CHI.

[67]  Martin Pielot,et al.  An in-situ study of mobile phone notifications , 2014, MobileHCI '14.

[68]  Simon Folkard,et al.  In situ repeated measures of affect and cognitive performance facilitated by use of a hand-held computer , 1992 .

[69]  Kazuo Yano,et al.  Predicting flow state in daily work through continuous sensing of motion rhythm , 2009, 2009 Sixth International Conference on Networked Sensing Systems (INSS).

[70]  Daniel J. Barrett,et al.  An Introduction to Computerized Experience Sampling in Psychology , 2001 .

[71]  Martin Pielot,et al.  I'll be there for you: Quantifying Attentiveness towards Mobile Messaging , 2015, MobileHCI.

[72]  Oscar Mayora-Ibarra,et al.  Correlation between self-reported mood states and objectively measured social interactions at work: A pilot study , 2011, 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[73]  N. Bolger,et al.  Intensive Longitudinal Methods: An Introduction to Diary and Experience Sampling Research , 2013 .

[74]  Kelly Caine,et al.  Local Standards for Sample Size at CHI , 2016, CHI.

[75]  Masumi Iida,et al.  Using diary methods in psychological research. , 2012 .

[76]  Zheng Wang,et al.  A dynamic longitudinal examination of social media use, needs, and gratifications among college students , 2012, Comput. Hum. Behav..

[77]  L. Wheeler,et al.  Self‐Recording of Everyday Life Events: Origins, Types, and Uses , 1991 .

[78]  D. Kahneman,et al.  A Survey Method for Characterizing Daily Life Experience: The Day Reconstruction Method , 2004, Science.

[79]  William G. Griswold,et al.  Usability and Feasibility of PmEB: A Mobile Phone Application for Monitoring Real Time Caloric Balance , 2006, 2006 Pervasive Health Conference and Workshops.

[80]  Scott E. Hudson,et al.  Using visualizations to increase compliance in experience sampling , 2008, UbiComp.

[81]  Christian Poellabauer,et al.  Human Factors in the Design of Longitudinal Smartphone-based Wellness Surveys , 2016, 2016 IEEE International Conference on Healthcare Informatics (ICHI).

[82]  Shion Guha,et al.  Spatial subterfuge: an experience sampling study to predict deceptive location disclosures , 2015, UbiComp.

[83]  Jeremy V. Pitt,et al.  Assessing contextual mood in public transport: a pilot study , 2013, MobileHCI '13.

[84]  Svetha Venkatesh,et al.  A Bayesian Nonparametric Framework for Activity Recognition Using Accelerometer Data , 2014, 2014 22nd International Conference on Pattern Recognition.

[85]  L. F. Barrett,et al.  A Practical Guide to Experience-Sampling Procedures , 2003 .

[86]  Geehyuk Lee,et al.  An adaptive speed-call list algorithm and its evaluation with ESM , 2010, CHI.

[87]  Mika Raento,et al.  Smartphones , 2009 .

[88]  T. Trull,et al.  Ecological momentary assessment of mood disorders and mood dysregulation. , 2009, Psychological assessment.

[89]  Sunny Consolvo,et al.  Using the Experience Sampling Method to Evaluate Ubicomp Applications , 2003, IEEE Pervasive Comput..

[90]  Martin Pielot,et al.  When attention is not scarce - detecting boredom from mobile phone usage , 2015, UbiComp.

[91]  Mirco Musolesi,et al.  My Phone and Me: Understanding People's Receptivity to Mobile Notifications , 2016, CHI.

[92]  Amy Voida,et al.  Towards personal stress informatics: comparing minimally invasive techniques for measuring daily stress in the wild , 2014, PervasiveHealth.

[93]  Berardina De Carolis,et al.  Emotions and Personality in Personalized Services: Models, Evaluation and Applications , 2016 .

[94]  Richard Ribon Fletcher,et al.  Wearable sensor platform and mobile application for use in cognitive behavioral therapy for drug addiction and PTSD , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[95]  G. Henri ter Hofte,et al.  Xensible interruptions from your mobile phone , 2007, Mobile HCI.

[96]  Jorge Gonçalves,et al.  Mobile cloud storage: a contextual experience , 2014, MobileHCI '14.

[97]  Constantino M. Lagoa,et al.  On the mathematical modeling of the effect of treatment on human physical activity , 2016, 2016 IEEE Conference on Control Applications (CCA).

[98]  Alessandra Russo,et al.  Learning to recognise disruptive smartphone notifications , 2014, MobileHCI '14.

[99]  Daniel McDuff,et al.  Wearable ESM: differences in the experience sampling method across wearable devices , 2016, MobileHCI.

[100]  Ashraf Khalil,et al.  Context-aware telephony: privacy preferences and sharing patterns , 2006, CSCW '06.

[101]  Hans Jørgen Andersen,et al.  Hybrid Cemetery Culture: Making Death Matter in Cultural Heritage Using Smart Mobile Technologies , 2015, 2015 International Conference on Culture and Computing (Culture Computing).

[102]  Konrad Tollmar,et al.  Boosting Mobile Experience Sampling with Social Media , 2015, MobileHCI.

[103]  Amy L. Gonzales,et al.  Text-based communication influences self-esteem more than face-to-face or cellphone communication , 2014, Comput. Hum. Behav..

[104]  J. Os,et al.  Experience sampling research in psychopathology: opening the black box of daily life , 2009, Psychological Medicine.

[105]  Pradipta De,et al.  Impact of experience sampling methods on tap pattern based emotion recognition , 2015, UbiComp/ISWC Adjunct.

[106]  Mariano Alcañiz Raya,et al.  Using Serious Games to Train Adaptive Emotional Regulation Strategies , 2014, HCI.

[107]  Dinh Q. Phung,et al.  Nonparametric discovery of movement patterns from accelerometer signals , 2016, Pattern Recognit. Lett..

[108]  Ilaria Liccardi,et al.  Privacy Tipping Points in Smartphones Privacy Preferences , 2015, CHI.

[109]  Tristan Henderson,et al.  Privacy in Location-Aware Computing Environments , 2007, IEEE Pervasive Computing.

[110]  Virpi Roto,et al.  Mobile questionnaires for user experience evaluation , 2010, CHI Extended Abstracts.

[111]  Eamonn O'Neill,et al.  Mobile Context Awareness , 2014, Springer London.

[112]  Ilkka Korhonen,et al.  Relationship of Psychological and Physiological Variables in Long-Term Self-Monitored Data During Work Ability Rehabilitation Program , 2009, IEEE Transactions on Information Technology in Biomedicine.

[113]  Mirco Musolesi,et al.  Designing content-driven intelligent notification mechanisms for mobile applications , 2015, UbiComp.

[114]  Erin I. Walsh,et al.  Should participants be given a mobile phone, or use their own? Effects of novelty vs utility , 2016, Telematics Informatics.

[115]  B. Oken,et al.  Ambulatory physiologic monitoring system supporting EMA with self-administered visual evoked potential recording at randomized intervals , 2011, 2011 IEEE International Instrumentation and Measurement Technology Conference.

[116]  Mikko Inkinen,et al.  CASS-methods and tools for investigating higher education knowledge practices , 2008, ICLS.

[117]  M. Csíkszentmihályi,et al.  The ecology of adolescent activity and experience , 1977, Journal of youth and adolescence.

[118]  Sameer Patil,et al.  Reflection or action?: how feedback and control affect location sharing decisions , 2014, CHI.

[119]  Sergio Galdames,et al.  School principals at their lonely work: Recording workday practices through ESM logs , 2012, Comput. Educ..

[120]  Jorge Gonçalves,et al.  Contextual experience sampling of mobile application micro-usage , 2014, MobileHCI '14.

[121]  Selim Ickin,et al.  Factors influencing quality of experience of commonly used mobile applications , 2012, IEEE Communications Magazine.

[122]  Paul J. Silvia,et al.  Palm or Cell? Comparing Personal Digital Assistants and Cell Phones for Experience Sampling Research , 2013 .

[123]  Denzil Ferreira,et al.  Securacy: an empirical investigation of Android applications' network usage, privacy and security , 2015, WISEC.

[124]  Shumin Zhai,et al.  Performance and User Experience of Touchscreen and Gesture Keyboards in a Lab Setting and in the Wild , 2015, CHI.

[125]  Starr Roxanne Hiltz,et al.  Supporting Opportunities for Context-Aware Social Matching: An Experience Sampling Study , 2016, CHI.

[126]  Chris Todd,et al.  Not another questionnaire! Maximizing the response rate, predicting non-response and assessing non-response bias in postal questionnaire studies of GPs. , 2002, Family practice.

[127]  Jorge Gonçalves,et al.  The curse of quantified-self: an endless quest for answers , 2015, UbiComp/ISWC Adjunct.

[128]  C. Korunka,et al.  Diary studies as a macro-ergonomic evaluation tool: Development of a shift diary and its application in ergonomic evaluations , 2012, 2012 Southeast Asian Network of Ergonomics Societies Conference (SEANES).

[129]  James Fogarty,et al.  Examining Unlock Journaling with Diaries and Reminders for In Situ Self-Report in Health and Wellness , 2016, CHI.

[130]  M. Mehl,et al.  Handbook of research methods for studying daily life , 2012 .

[131]  Sukeshini A. Grandhi,et al.  Technology-mediated interruption management , 2010, Int. J. Hum. Comput. Stud..

[132]  Reid G. Simmons,et al.  Smartphone Interruptibility Using Density-Weighted Uncertainty Sampling with Reinforcement Learning , 2011, 2011 10th International Conference on Machine Learning and Applications and Workshops.

[133]  Florian Alt,et al.  SnapApp: Reducing Authentication Overhead with a Time-Constrained Fast Unlock Option , 2016, CHI.

[134]  Quentin Jones,et al.  Preventing Unwanted Social Inferences with Classification Tree Analysis , 2009, 2009 21st IEEE International Conference on Tools with Artificial Intelligence.

[135]  Mike Y. Chen,et al.  Voting with your feet : An investigative study of the relationship between place visit behavior and preference , 2006 .

[136]  Evangelos Karapanos,et al.  EmoSnaps: a mobile application for emotion recall from facial expressions , 2015, Personal and Ubiquitous Computing.

[137]  Gierad Laput,et al.  Expanding the input expressivity of smartwatches with mechanical pan, twist, tilt and click , 2014, CHI.

[138]  Niels Henze,et al.  In-situ investigation of notifications in multi-device environments , 2016, UbiComp.

[139]  Joyce H. D. M. Westerink,et al.  Emotion measurement platform for daily life situations , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[140]  Steve Benford,et al.  Inferring player engagement in a pervasive experience , 2009, CHI.

[141]  S. Shiffman Ecological momentary assessment (EMA) in studies of substance use. , 2009, Psychological assessment.

[142]  Erika D Peterson,et al.  Temporal Adjustments in the Evaluation of Events: The "Rosy View" , 1997, Journal of experimental social psychology.

[143]  James D. Hollan,et al.  Engaging the Periphery for Visual Communication on Mobile Phones , 2010, 2010 43rd Hawaii International Conference on System Sciences.

[144]  Megan A. Moreno,et al.  Internet use and multitasking among older adolescents: An experience sampling approach , 2012, Comput. Hum. Behav..

[145]  Selim Ickin,et al.  QoE-based energy reduction by controlling the 3g cellular data traffic on the smartphone , 2013, 2013 22nd ITC Specialist Seminar on Energy Efficient and Green Networking (SSEEGN).

[146]  Luc Martens,et al.  Performing QoE-measurements in an actual 3G network , 2010, 2010 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[147]  Panos Markopoulos,et al.  On the Use of Personalization to Enhance Compliance in Experience Sampling , 2015, ECCE.

[148]  Katarzyna Wac,et al.  Anonymous smartphone data collection: factors influencing the users’ acceptance in mobile crowd sensing , 2015, Personal and Ubiquitous Computing.

[149]  P. Keel,et al.  Revisiting the affect regulation model of binge eating: a meta-analysis of studies using ecological momentary assessment. , 2011, Psychological bulletin.

[150]  Steve Benford,et al.  Effects of content and time of delivery on receptivity to mobile interruptions , 2010, Mobile HCI.

[151]  Antti Oulasvirta,et al.  Free-Form Gesture Authentication in the Wild , 2016, CHI.

[152]  Kent Larson,et al.  Tools for Studying Behavior and Technology in Natural Settings , 2003, UbiComp.

[153]  Anne Marie Kanstrup,et al.  Expanding the Locus of Control: Design of a Mobile Quantified Self-Tracking Application for Whiplash Patients , 2016, NordiCHI.

[154]  S. Shiffman,et al.  Capturing momentary, self-report data: A proposal for reporting guidelines , 2002, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[155]  Tianbao Yang,et al.  In-Situ Measurement and Prediction of Hearing Aid Outcomes Using Mobile Phones , 2015, 2015 International Conference on Healthcare Informatics.

[156]  Manfred Tscheligi,et al.  'Divert: mother-in-law': representing and evaluating social context on mobile devices , 2007, Mobile HCI.

[157]  J. Kenardy,et al.  The use of a real-time computer diary for data acquisition and processing. , 1990, Behaviour research and therapy.

[158]  Toru Nakamura,et al.  Psychobehavioral validity of self-reported symptoms based on spontaneous physical activity , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[159]  Patrick Baudisch,et al.  Back-of-device interaction allows creating very small touch devices , 2009, CHI.

[160]  Richard E. Ladner,et al.  Effect of MobileASL on communication among deaf users , 2011, CHI EA '11.

[161]  Alireza Sahami Shirazi,et al.  Large-scale assessment of mobile notifications , 2014, CHI.

[162]  Yves Pigneur,et al.  Privacy as a Tradeoff: Introducing the Notion of Privacy Calculus for Context-Aware Mobile Applications , 2014, 2014 47th Hawaii International Conference on System Sciences.

[163]  J. S. Adams,et al.  TOWARD AN UNDERSTANDING OF INEQUITY. , 1963, Journal of abnormal psychology.

[164]  Paolo Missier,et al.  Bootstrapping Personalised Human Activity Recognition Models Using Online Active Learning , 2015, 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing.

[165]  Jorge Gonçalves,et al.  CHI 1994-2013: mapping two decades of intellectual progress through co-word analysis , 2014, CHI.

[166]  Steve Benford,et al.  Investigating episodes of mobile phone activity as indicators of opportune moments to deliver notifications , 2011, Mobile HCI.

[167]  Elfed Lewis,et al.  FPGA based Real time 'secure' body temperature monitoring suitable for WBSN 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing , 2015 .

[168]  S. Shiffman,et al.  Ecological momentary assessment. , 2008, Annual review of clinical psychology.

[169]  James Begole,et al.  An Exploration into Activity-Informed Physical Advertising Using PEST , 2007, Pervasive.

[171]  Miguel Tavares Coimbra,et al.  Vital Analysis: Annotating sensed physiological signals with the stress levels of first responders in action , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[172]  S. Hormuth The sampling of experiences in situ , 1986 .

[173]  Andrea Gaggioli,et al.  A mobile data collection platform for mental health research , 2013, Personal and Ubiquitous Computing.

[174]  Aditya Ponnada,et al.  μEMA: Microinteraction-based ecological momentary assessment (EMA) using a smartwatch , 2016, UbiComp.

[175]  William D. Barta,et al.  Measurement reactivity in diary research. , 2012 .

[176]  Harry T. Reis,et al.  Event-sampling and other methods for studying everyday experience. , 2000 .

[177]  Denzil Ferreira,et al.  AWARE: Mobile Context Instrumentation Framework , 2015, Front. ICT.

[178]  S. Shiffman,et al.  Signaling does not adequately improve diary compliance , 2003, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[179]  Nikki S. Rickard,et al.  DEVELOPMENT AND TRIAL OF A MOBILE EXPERIENCE SAMPLING METHOD (M-ESM) FOR PERSONAL MUSIC LISTENING , 2013 .

[180]  Toru Nakamura,et al.  Covariation of Depressive Mood and Spontaneous Physical Activity in Major Depressive Disorder: Toward Continuous Monitoring of Depressive Mood , 2015, IEEE Journal of Biomedical and Health Informatics.

[181]  Octav Chipara,et al.  AudioSense: Enabling real-time evaluation of hearing aid technology in-situ , 2013, Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems.

[182]  Yan Li,et al.  The Kunming CalFit study: Modeling dietary behavioral patterns using smartphone data , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[183]  Enid Montague,et al.  Using video-based observation research methods in primary care health encounters to evaluate complex interactions. , 2014, Informatics in primary care.

[184]  Mark W. Newman,et al.  A field study comparing approaches to collecting annotated activity data in real-world settings , 2015, UbiComp.

[185]  Wijnand A. IJsselsteijn,et al.  Reconexp: a way to reduce the data loss of the experiencing sampling method , 2008, Mobile HCI.