Longitudinal Validity and Reliability of Brief Smartphone Self-Monitoring of Diet, Stress, and Physical Activity in a Diverse Sample of Mothers

Background Multiple strategies can be used when self-monitoring diet, physical activity, and perceived stress, but no gold standards are available. Although self-monitoring is a core element of self-management and behavior change, the success of mHealth behavioral tools depends on their validity and reliability, which lack evidence. African American and Latina mothers in the United States are high-priority populations for apps that can be used for self-monitoring of diet, physical activity, and stress because the body mass index (BMI) of mothers typically increases for several years after childbirth and the risks of obesity and its’ sequelae diseases are elevated among minority populations. Objective To examine the intermethod reliability and concurrent validity of smartphone-based self-monitoring via ecological momentary assessments (EMAs) and use of daily diaries for diet, stress, and physical activity compared with brief recall measures, anthropometric biomeasures, and bloodspot biomarkers. Methods A purposive sample (n=42) of primarily African American (16/42, 39%) and Latina (18/42, 44%) mothers was assigned Android smartphones for using Ohmage apps to self-monitor diet, perceived stress, and physical activity over 6 months. Participants were assessed at 3- and 6-month follow-ups. Recall measures included brief food frequency screeners, physical activity assessments adapted from the National Health and Nutrition Examination Survey, and the nine-item psychological stress measure. Anthropometric biomeasures included BMI, body fat, waist circumference, and blood pressure. Bloodspot assays for Epstein–Barr virus and C-reactive protein were used as systemic load and stress biomarkers. EMAs and daily diary questions assessed perceived quality and quantity of meals, perceived stress levels, and moderate, vigorous, and light physical activity. Units of analysis were follow-up assessments (n=29 to n=45 depending on the domain) of the participants (n=29 with sufficient data for analyses). Correlations, R2 statistics, and multivariate linear regressions were used to assess the strength of associations between variables. Results Almost all participants (39/42, 93%) completed the study. Intermethod reliability between smartphone-based EMAs and diary reports and their corresponding recall reports was highest for stress and diet; correlations ranged from .27 to .52 (P<.05). However, it was unexpectedly low for physical activity; no significant associations were observed. Concurrent validity was demonstrated for diet EMAs and diary reports on systolic blood pressure (r=−.32), C-reactive protein level (r=−.34), and moderate and vigorous physical activity recalls (r=.35 to.48), suggesting a covariation between healthy diet and physical activity behaviors. EMAs and diary reports on stress were not associated with Epstein–Barr virus and C-reactive protein level. Diary reports on moderate and vigorous physical activity were negatively associated with BMI and body fat (r=−.35 to −.44, P<.05). Conclusions Brief smartphone-based EMA use may be valid and reliable for long-term self-monitoring of diet, stress, and physical activity. Lack of intermethod reliability for physical activity measures is consistent with prior research, warranting more research on the efficacy of smartphone-based self-monitoring of self-management and behavior change support.

[1]  Nithya Ramanathan,et al.  Adherence to self-monitoring healthy lifestyle behaviours through mobile phone-based ecological momentary assessments and photographic food records over 6 months in mostly ethnic minority mothers , 2017, Public Health Nutrition.

[2]  Fengqing Zhang,et al.  Return of the JITAI: Applying a Just-in-Time Adaptive Intervention Framework to the Development of m-Health Solutions for Addictive Behaviors , 2017, International Journal of Behavioral Medicine.

[3]  J. Kiecolt-Glaser,et al.  Inflammation: depression fans the flames and feasts on the heat. , 2015, The American journal of psychiatry.

[4]  W Scott Comulada,et al.  Compliance to Cell Phone-Based EMA Among Latino Youth in Outpatient Treatment , 2015, Journal of ethnicity in substance abuse.

[5]  C. Worthman,et al.  The signs of stress: embodiments of biosocial stress among type 2 diabetic women in New Delhi, India. , 2015, Social science & medicine.

[6]  Nicholas D. Gilson,et al.  Measuring and Influencing Physical Activity with Smartphone Technology: A Systematic Review , 2014, Sports Medicine.

[7]  Audie A Atienza,et al.  Mobile health technology evaluation: the mHealth evidence workshop. , 2013, American journal of preventive medicine.

[8]  C. Abraham,et al.  The Behavior Change Technique Taxonomy (v1) of 93 Hierarchically Clustered Techniques: Building an International Consensus for the Reporting of Behavior Change Interventions , 2013, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[9]  Shyamasree Ghosh,et al.  C-reactive protein and the biology of disease , 2013, Immunologic Research.

[10]  T. McDade,et al.  Biological Markers of Stress in Pregnancy: Associations with Chronic Placental Inflammation at Delivery , 2012, American Journal of Perinatology.

[11]  Margaret Allman-Farinelli,et al.  Development of Smartphone Applications for Nutrition and Physical Activity Behavior Change , 2012, JMIR research protocols.

[12]  G. Miller The Smartphone Psychology Manifesto , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[13]  Bonnie Spring,et al.  Healthy Lifestyle Through Young Adulthood and the Presence of Low Cardiovascular Disease Risk Profile in Middle Age: The Coronary Artery Risk Development in (Young) Adults (CARDIA) Study , 2012, Circulation.

[14]  Michael Eid,et al.  Compliance to a cell phone-based ecological momentary assessment study: the effect of time and personality characteristics. , 2012, Psychological assessment.

[15]  E. Costello,et al.  Cumulative Depression Episodes Predict Later C-Reactive Protein Levels: A Prospective Analysis , 2012, Biological Psychiatry.

[16]  L. Arab,et al.  Validity of a multipass, web-based, 24-hour self-administered recall for assessment of total energy intake in blacks and whites. , 2011, American journal of epidemiology.

[17]  Richard P Troiano,et al.  Self-reported and objectively measured activity related to biomarkers using NHANES. , 2011, Medicine and science in sports and exercise.

[18]  H. Kolb,et al.  The global diabetes epidemic as a consequence of lifestyle-induced low-grade inflammation , 2010, Diabetologia.

[19]  L. Sharp,et al.  The relationship between self-report and biomarkers of stress in low-income reproductive-age women. , 2010, American journal of obstetrics and gynecology.

[20]  S. Michie,et al.  Using the Internet to Promote Health Behavior Change: A Systematic Review and Meta-analysis of the Impact of Theoretical Basis, Use of Behavior Change Techniques, and Mode of Delivery on Efficacy , 2010, Journal of medical Internet research.

[21]  J. Smyth,et al.  Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. , 2010, British journal of health psychology.

[22]  T. Trull,et al.  Clinical assessment of affective instability: comparing EMA indices, questionnaire reports, and retrospective recall. , 2009, Psychological assessment.

[23]  U. Ekelund,et al.  A comparison of questionnaire, accelerometer, and pedometer: measures in older people. , 2009, Medicine and science in sports and exercise.

[24]  Shaun Treweek,et al.  Making trials matter: pragmatic and explanatory trials and the problem of applicability , 2009, Trials.

[25]  A. Lombardi,et al.  From chronic overnutrition to insulin resistance: the role of fat-storing capacity and inflammation. , 2009, Nutrition, metabolism, and cardiovascular diseases : NMCD.

[26]  S. Marshall,et al.  The prevalence of sedentary behavior and physical activity in leisure time: A study of Scottish adolescents using ecological momentary assessment. , 2009, Preventive medicine.

[27]  D. Mozaffarian,et al.  Heart disease and stroke statistics--2009 update: a report from the American Heart Association Statistics Committee and Stroke Statistics Subcommittee. , 2009, Circulation.

[28]  D. Mozaffarian,et al.  Heart disease and stroke statistics--2009 update: a report from the American Heart Association Statistics Committee and Stroke Statistics Subcommittee. , 2009, Circulation.

[29]  L. Lemyre,et al.  Psychological stress measure (PSM-9): Integration of an evidence-based approach to assessment, monitoring, and evaluation of stress in physical therapy practice , 2009, Physiotherapy theory and practice.

[30]  K. Muller,et al.  An R2 statistic for fixed effects in the linear mixed model , 2008, Statistics in medicine.

[31]  M. Tremblay,et al.  A comparison of direct versus self-report measures for assessing physical activity in adults: a systematic review , 2008, The international journal of behavioral nutrition and physical activity.

[32]  W. Rathmann,et al.  Low-grade inflammation, obesity, and insulin resistance in adolescents. , 2007, The Journal of clinical endocrinology and metabolism.

[33]  Charles E Matthews,et al.  The role of measurement error in estimating levels of physical activity. , 2007, American journal of epidemiology.

[34]  K. Courneya,et al.  Randomized controlled trial of the effects of print materials and step pedometers on physical activity and quality of life in breast cancer survivors. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[35]  D. Jacobs,et al.  Physical activity in young adults and incident hypertension over 15 years of follow-up: the CARDIA study. , 2007, American journal of public health.

[36]  D. Alley,et al.  Socioeconomic status and C-reactive protein levels in the US population: NHANES IV , 2006, Brain, Behavior, and Immunity.

[37]  R. Fagard Effects of exercise, diet and their combination on blood pressure , 2005, Journal of Human Hypertension.

[38]  Joseph E. Schwartz,et al.  Variability of Momentary Pain Predicts Recall of Weekly Pain: A Consequence of the Peak (or Salience) Memory Heuristic , 2005, Personality & social psychology bulletin.

[39]  J. Kiecolt-Glaser,et al.  Stress-induced immune dysfunction: implications for health , 2005, Nature Reviews Immunology.

[40]  M. Elia,et al.  Bioelectrical impedance analysis-part II: utilization in clinical practice. , 2004, Clinical nutrition.

[41]  M. Elia,et al.  Bioelectrical impedance analysis--part I: review of principles and methods. , 2004, Clinical nutrition.

[42]  M. Goldstein,et al.  Multiple behavioral risk factor interventions in primary care. Summary of research evidence. , 2004, American journal of preventive medicine.

[43]  V. Burley,et al.  Food-frequency questionnaires: a review of their design, validation and utilisation , 2004, Nutrition Research Reviews.

[44]  C. Lewis,et al.  Excess gains in weight and waist circumference associated with childbearing: The Coronary Artery Risk Development in Young Adults Study (CARDIA) , 2004, International Journal of Obesity.

[45]  P. Black The inflammatory response is an integral part of the stress response: Implications for atherosclerosis, insulin resistance, type II diabetes and metabolic syndrome X , 2003, Brain, Behavior, and Immunity.

[46]  David A Padgett,et al.  How stress influences the immune response. , 2003, Trends in immunology.

[47]  M. Kaplan,et al.  The psychosocial determinants of hypertension. , 2003, Nutrition, metabolism, and cardiovascular diseases : NMCD.

[48]  Gary L Myers,et al.  Markers of inflammation and cardiovascular disease: application to clinical and public health practice: A statement for healthcare professionals from the Centers for Disease Control and Prevention and the American Heart Association. , 2003, Circulation.

[49]  Edward T H Yeh,et al.  Coming of age of C-reactive protein: using inflammation markers in cardiology. , 2003, Circulation.

[50]  C. Tudor-Locke,et al.  Pedometer-determined ambulatory activity in individuals with type 2 diabetes. , 2002, Diabetes research and clinical practice.

[51]  C. Worthman,et al.  Culture change and stress in Western Samoan youth: Methodological issues in the cross‐cultural study of stress and immune function , 2000, American journal of human biology : the official journal of the Human Biology Council.

[52]  J. Cacioppo,et al.  Epstein-Barr Virus Antibodies in Whole Blood Spots: A Minimally Invasive Method for Assessing an Aspect of Cell-Mediated Immunity , 2000, Psychosomatic medicine.

[53]  Elizabeth J. Mayer-Davis,et al.  Validity and reproducibility of a food frequency interview in a Multi-Cultural Epidemiology Study. , 1999, Annals of epidemiology.

[54]  A. Kristal,et al.  Associations of race/ethnicity, education, and dietary intervention with the validity and reliability of a food frequency questionnaire: the Women's Health Trial Feasibility Study in Minority Populations. , 1997, American journal of epidemiology.

[55]  C. Worthman,et al.  Hormone measures in finger-prick blood spot samples: new field methods for reproductive endocrinology. , 1997, American journal of physical anthropology.

[56]  G Cutter,et al.  A study of the reliability and comparative validity of the cardia dietary history. , 1994, Ethnicity & disease.

[57]  T. Baranowski,et al.  Social support for exercise: relationship to physical activity in young adults. , 1991, Preventive medicine.

[58]  D. Blockley Making , 2020, The Hidden History of the Smock Frock.

[59]  G. Dunton Ecological Momentary Assessment in Physical Activity Research , 2017, Exercise and sport sciences reviews.

[60]  M. Hutchesson,et al.  Self-monitoring of dietary intake by young women: online food records completed on computer or smartphone are as accurate as paper-based food records but more acceptable. , 2015, Journal of the Academy of Nutrition and Dietetics.

[61]  M. Sevick,et al.  Self-monitoring in weight loss: a systematic review of the literature. , 2011, Journal of the American Dietetic Association.

[62]  Deborah Estrin,et al.  Evaluating Participation and Performance in Participatory Sensing , 2008 .

[63]  S. Shiffman,et al.  Introduction to the special section: Ecological momentary assessment in health psychology. , 1998 .

[64]  T. Lohman,et al.  Anthropometric Standardization Reference Manual , 1988 .