Let's get Physiqual - An intuitive and generic method to combine sensor technology with ecological momentary assessments

The emergence of wearables and smartwatches is making sensors a ubiquitous technology to measure daily rhythms in physiological measures, such as movement and heart rate. An integration of sensor data from wearables and self-report questionnaire data about cognition, behaviors, and emotions can provide new insights into the interaction of mental and physiological processes in daily life. Hitherto no method existed that enables an easy-to-use integration of sensor and self-report data. To fill this gap, we present 'Physiqual', a platform for researchers that gathers and integrates data from commercially available sensors and service providers into one unified format for use in Ecological Momentary Assessments (EMA) or Experience Sampling Methods (ESM), and Quantified Self (QS). Physiqual currently supports sensor data provided by two well-known service providers and therewith a wide range of smartwatches and wearables. To demonstrate the features of Physiqual, we conducted a case study in which we assessed two subjects by means of data from an EMA study combined with sensor data as aggregated and exported by Physiqual. To the best of our knowledge, the Physiqual platform is the first platform that allows researchers to conveniently aggregate and integrate physiological sensor data with EMA studies.

[1]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[2]  J. Rosmalen,et al.  How to assess stress biomarkers for idiographic research? , 2015, Psychoneuroendocrinology.

[3]  Marco Aiello,et al.  HowNutsAreTheDutch: Personalized Feedback on a National Scale , 2014, AAAI Fall Symposia.

[4]  Peter de Jonge,et al.  Cortisol and α-Amylase Secretion Patterns between and within Depressed and Non-Depressed Individuals , 2015, PloS one.

[5]  Rik Leemans,et al.  An Integrated Coral Reef Ecosystem Model to Support Resource Management under a Changing Climate , 2015, PloS one.

[6]  James Dunbar,et al.  Waste the waist: a pilot randomised controlled trial of a primary care based intervention to support lifestyle change in people with high cardiovascular risk , 2015, International Journal of Behavioral Nutrition and Physical Activity.

[7]  Marco Aiello,et al.  Automating Vector Autoregression on Electronic Patient Diary Data , 2016, IEEE Journal of Biomedical and Health Informatics.

[8]  Fernando Martín-Sánchez,et al.  The use of self-quantification systems for personal health information: big data management activities and prospects , 2015, Health Information Science and Systems.

[9]  Audie A Atienza,et al.  Mobile health technology evaluation: the mHealth evidence workshop. , 2013, American journal of preventive medicine.

[10]  Robert J. Kauffman,et al.  Understanding the paradigm shift to computational social science in the presence of big data , 2014, Decis. Support Syst..

[11]  Minh Hoai Nguyen,et al.  Personalized Stress Detection from Physiological Measurements , 2010 .

[12]  Guang-Zhong Yang,et al.  From Wearable Sensors to Smart Implants-–Toward Pervasive and Personalized Healthcare , 2015, IEEE Transactions on Biomedical Engineering.

[13]  C. Granger Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[14]  M. aan het Rot,et al.  Mood disorders in everyday life: a systematic review of experience sampling and ecological momentary assessment studies. , 2012, Clinical psychology review.

[15]  Andrew Baum,et al.  Ecological Momentary Assessment: A New Tool for Behavioral Medicine Research , 1998 .

[16]  Thea J. M. Kooiman,et al.  Reliability and validity of ten consumer activity trackers , 2015, BMC Sports Science, Medicine and Rehabilitation.

[17]  Johannes Wagner,et al.  Smart sensor integration: A framework for multimodal emotion recognition in real-time , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[18]  Ellen L. Hamaker,et al.  Why researchers should think "within-person": A paradigmatic rationale. , 2012 .

[19]  P. Molenaar A Manifesto on Psychology as Idiographic Science: Bringing the Person Back Into Scientific Psychology, This Time Forever , 2004 .

[20]  Ellen M.J. Witteveen,et al.  Meten is weten , 2013 .

[21]  Andrea Gaggioli,et al.  An Open Source Mobile Platform for Psychophysiological Self Tracking , 2012, MMVR.

[22]  Lina A. Colucci,et al.  The quantified patient of the future: Opportunities and challenges. , 2015, Healthcare.

[23]  Serge Mankovskii,et al.  Service Oriented Architecture , 2009, Encyclopedia of Database Systems.

[24]  Natalia Romero Herrera,et al.  ESTHER: a portable sensor toolkit to collect and monitor total hip replacement patient data , 2013, MobileHealth '13.

[25]  Jangho Park,et al.  Wearable Sensing of In-Ear Pressure for Heart Rate Monitoring with a Piezoelectric Sensor , 2015, Sensors.

[26]  T. Trull,et al.  Using experience sampling methods/ecological momentary assessment (ESM/EMA) in clinical assessment and clinical research: introduction to the special section. , 2009, Psychological assessment.

[27]  J. Farey,et al.  Esther , 2013, Vol. 2 The Babylonian Esther Midrash: A Critical Commentary.

[28]  M. Swan Health 2050: The Realization of Personalized Medicine through Crowdsourcing, the Quantified Self, and the Participatory Biocitizen , 2012, Journal of personalized medicine.

[29]  Tim Olds,et al.  The validity of consumer-level, activity monitors in healthy adults worn in free-living conditions: a cross-sectional study , 2015, International Journal of Behavioral Nutrition and Physical Activity.

[30]  C. Granger Investigating Causal Relations by Econometric Models and Cross-Spectral Methods , 1969 .

[31]  M. Myrtek,et al.  Heart and Emotion: Ambulatory Monitoring Studies in Everyday Life , 2004 .

[32]  Klaas J Wardenaar,et al.  HowNutsAreTheDutch (HoeGekIsNL): A crowdsourcing study of mental symptoms and strengths. , 2016, International journal of methods in psychiatric research.

[33]  B. Silverman Density estimation for statistics and data analysis , 1986 .

[34]  C. Sims MACROECONOMICS AND REALITY , 1977 .

[35]  Stephen S. Intille,et al.  Technological Innovations Enabling Automatic, Context-Sensitive Ecological Momentary Assessment , 2007 .

[36]  Lian van der Krieke,et al.  Temporal Dynamics of Health and Well-Being: A Crowdsourcing Approach to Momentary Assessments and Automated Generation of Personalized Feedback , 2016, Psychosomatic medicine.

[37]  Paul J Rathouz,et al.  Self-Reported and Measured Sleep Duration: How Similar Are They? , 2008, Epidemiology.

[38]  Christian Montag,et al.  Psycho-informatics: Big Data shaping modern psychometrics. , 2014, Medical hypotheses.