Technological Innovations Enabling Automatic, Context-Sensitive Ecological Momentary Assessment

Health-related behavior, subjective states, cognitions, and interpersonal experiences are inextricably linked to context. Context includes information about location, time, past activities, interaction with other people and objects, and mental, physiological, and emotional states. Most real-time data collection methodologies require that subjects self-report information about contextual influences, notwithstanding the difficulty they have identifying the contextual factors that are influencing their behavior and subjective states. Often these assessment methodologies ask subjects to report on their activities or thoughts long after the actual events, thereby relying on retrospective recall and introducing memory biases. The “gold standard” alternative to these self-report instruments is direct observation. Direct observation in a laboratory setting, however, artificially constrains behavior. Direct observation is also typically too costly and invasive for long-term, large-sample-size studies of people in their natural environments. Technological innovations are creating new opportunities to capture accurate, real-time data with minimal intrusiveness using techniques such as electronic Ecological Momentary Assessment (EMA). Other chapters in this collection discuss the benefits, challenges, and versatility of electronic EMA as it is being used in current research. This chapter, however, looks toward the future. New technologies will enable two significant extensions to current EMA methodologies. First, most EMA studies to date have used intermittent collection of self-report data. New technologies will enable EMA studies that combine continuous data collection of subject activities and physiological states with intermittent self-report data collection. Second, new technologies will enable EMA studies where a computer automatically triggers context-sensitive intermittent self-reports based upon analysis of the continuous data stream. Intermittent self-reports can be tied to the observation of particular activities or states that are specified by the researcher but automatically detected by the computer.

[1]  A. Cawkell Evolution of an information society , 1987 .

[2]  M. Csíkszentmihályi,et al.  Validity and Reliability of the Experience‐Sampling Method , 1987, The Journal of nervous and mental disease.

[3]  M. Csíkszentmihályi,et al.  Validity and Reliability of the Experience‐Sampling Method , 1987, The Journal of nervous and mental disease.

[4]  R. Larson,et al.  The Experience of Psychopathology: Analyzing Experience Sampling data: a guide book for the perplexed , 1992 .

[5]  M. Csíkszentmihályi,et al.  The experience of psychopathology: Investigating mental disorders in their natural settings. , 1992 .

[6]  M. Hyland,et al.  Diary keeping in asthma: comparison of written and electronic methods. , 1993, BMJ.

[7]  S. Shiffman,et al.  Ecological Momentary Assessment (Ema) in Behavioral Medicine , 1994 .

[8]  P. Freedson,et al.  Validity of the Computer Science and Applications, Inc. (CSA) activity monitor. , 1995, Medicine and science in sports and exercise.

[9]  M. Lamb : Divergent Realities: The Emotional Lives of Mothers, Fathers and Adolescents , 1996 .

[10]  Vannevar Bush,et al.  As we may think , 1945, INTR.

[11]  J. Hollenberg,et al.  Computerized data collection in the operating room during coronary artery bypass surgery: a comparison to the hand-written anesthesia record. , 1997, Journal of cardiothoracic and vascular anesthesia.

[12]  Jennifer Healey,et al.  StartleCam: a cybernetic wearable camera , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[13]  A. Stone,et al.  Strategies for analyzing ecological momentary assessment data. , 1998, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[14]  G.E. Moore,et al.  Cramming More Components Onto Integrated Circuits , 1998, Proceedings of the IEEE.

[15]  Randy H. Katz,et al.  Next century challenges: mobile networking for “Smart Dust” , 1999, MobiCom.

[16]  J. Goodie,et al.  Validation of the Polar Heart Rate Monitor for Assessing Heart Rate During Physical and Mental Stress , 2000 .

[17]  Paramvir Bahl,et al.  RADAR: an in-building RF-based user location and tracking system , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[18]  Maribeth Gandy Coleman,et al.  The Gesture Pendant: A Self-illuminating, Wearable, Infrared Computer Vision System for Home Automation Control and Medical Monitoring , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[19]  Daniel J. Barrett,et al.  An Introduction to Computerized Experience Sampling in Psychology , 2001 .

[20]  J. Pennebaker,et al.  The Electronically Activated Recorder (EAR): A device for sampling naturalistic daily activities and conversations , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[21]  Claudio S. Pinhanez The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces , 2001, UbiComp.

[22]  T. Revenson,et al.  Handbook of Health Psychology , 2001 .

[23]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques with Java implementations , 2002, SGMD.

[24]  Xiaoyi Ma,et al.  Eliciting user preferences using image-based experience sampling and reflection , 2002, CHI Extended Abstracts.

[25]  Albrecht Schmidt,et al.  Multi-sensor context aware clothing , 2002, Proceedings. Sixth International Symposium on Wearable Computers,.

[26]  Gordon Bell,et al.  MyLifeBits: fulfilling the Memex vision , 2002, MULTIMEDIA '02.

[27]  Thad Starner Wearable Computers: No Longer Science Fiction , 2002, IEEE Pervasive Comput..

[28]  Gregory J. Welk,et al.  Physical Activity Assessments for Health-Related Research , 2002 .

[29]  S. Intille,et al.  Just-In-Time Context-Sensitive Questioning for Preventative Health Care , 2002 .

[30]  S. Shiffman,et al.  Reactivity to ecological momentary assessment: an example using undergraduate problem drinkers. , 2002, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[31]  Ronald Neville,et al.  Mobile phone text messaging can help young people manage asthma , 2002, BMJ : British Medical Journal.

[32]  Da‐hong Wang,et al.  Validity and reliability of a dietary assessment method: the application of a digital camera with a mobile phone card attachment. , 2002, Journal of nutritional science and vitaminology.

[33]  Stephen S. Intille,et al.  Designing a Home of the Future , 2002, IEEE Pervasive Comput..

[34]  Brian Patrick Clarkson,et al.  Life patterns : structure from wearable sensors , 2002 .

[35]  S. Shiffman,et al.  Patient non-compliance with paper diaries , 2002, BMJ : British Medical Journal.

[36]  S. Shiffman,et al.  Signaling does not adequately improve diary compliance , 2003, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[37]  Emmanuel,et al.  Activity recognition in the home setting using simple and ubiquitous sensors , 2003 .

[38]  H Harry Asada,et al.  Mobile monitoring with wearable photoplethysmographic biosensors. , 2003, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[39]  Claudio S. Pinhanez,et al.  Ubiquitous Computing in the Living Room: Concept Sketches and an Implementation of a Persistent User Interface , 2003 .

[40]  R. L. Collins,et al.  The feasibility of using cellular phones to collect ecological momentary assessment data: application to alcohol consumption. , 2003, Experimental and clinical psychopharmacology.

[41]  Rosalind W. Picard Affective computing: challenges , 2003, Int. J. Hum. Comput. Stud..

[42]  Eric Horvitz,et al.  Learning and reasoning about interruption , 2003, ICMI '03.

[43]  Albrecht Schmidt,et al.  Multi-sensor Activity Context Detection for Wearable Computing , 2003, EUSAI.

[44]  S. Bauer,et al.  Use of text messaging in the aftercare of patients with bulimia nervosa , 2003 .

[45]  Henry A. Kautz,et al.  Guide: Towards Understanding Daily Life via Auto- Identification and Statistical Analysis , 2003 .

[46]  Kent Larson,et al.  Tools for Studying Behavior and Technology in Natural Settings , 2003, UbiComp.

[47]  Alex Pentland,et al.  Social Network Computing , 2003, UbiComp.

[48]  K. Kario,et al.  Ambulatory blood pressure monitoring for cardiovascular medicine , 2003, IEEE Engineering in Medicine and Biology Magazine.

[49]  Ling Bao,et al.  A context-aware experience sampling tool , 2003, CHI Extended Abstracts.

[50]  P. Bonato,et al.  Wearable sensors/systems and their impact on biomedical engineering , 2003, IEEE Engineering in Medicine and Biology Magazine.

[51]  Christopher G. Atkeson,et al.  Predicting human interruptibility with sensors: a Wizard of Oz feasibility study , 2003, CHI '03.

[52]  V. Franklin,et al.  "Sweet Talk": text messaging support for intensive insulin therapy for young people with diabetes. , 2003, Diabetes technology & therapeutics.

[53]  Stephen S. Intille,et al.  A new research challenge: persuasive technology to motivate healthy aging , 2004, IEEE Transactions on Information Technology in Biomedicine.

[54]  R. Friedman Automated Telephone Conversations to Assess Health Behavior and Deliver Behavioral Interventions , 1998, Journal of Medical Systems.

[55]  H. Harry Asada,et al.  Measurement of finger posture and three-axis fingertip touch force using fingernail sensors , 2004, IEEE Transactions on Robotics and Automation.

[56]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[57]  W. Mow,et al.  Initial experience with wireless capsule enteroscopy in the diagnosis and management of inflammatory bowel disease. , 2004, Clinical gastroenterology and hepatology : the official clinical practice journal of the American Gastroenterological Association.

[58]  Joyce Ho,et al.  Using context-aware computing to reduce the perceived burden of interruptions from mobile devices , 2005, CHI.

[59]  Mohammad Ilyas,et al.  Smart Dust , 2006 .