Analysis of Personal Health Monitoring Data for Physical Activity Recognition and Assessment of Energy Expenditure, Mental Load and Stress: Dissertation

Personal health monitoring refers to the long-term health monitoring that is performed in uncontrolled environments instead of a laboratory, for example, at home or by using wearable sensors. The monitoring is done by individuals alone, usually without guidance from health care professionals. Data produced by personal health monitoring (for example, actigraphy, heart rate, etc.) are currently used more in personal wellness monitoring rather than in clinical decisionmaking, because of challenges in the interpretation of the long-term and possibly unreliable data. Automatic analysis of long-term personal health monitoring data could be used for the continuous recognition of changes in individual’s behavior and health status, and to point out which everyday selections have a negative effect on health and which have a positive effect. This can not be achieved by using sparse measurements in controlled environments. In this thesis, data analysis was carried out for the recognition of physical and mental load using data from wearable sensors and other self-measurements. Large, annotated data libraries were collected in real-life or realistic laboratory conditions for the purpose of the development of practical algorithms and the identification of the most information-rich sensors and signal interpretation methods. Time and frequency domain features were computed from raw sensor data for the correlation analysis and the automatic classification of the personal health monitoring data. The decision tree, artificial neural network, K-Nearest Neighbor and a hybrid of a decision tree and artificial neural network classifiers were used. Automatic activity recognition aims at recognizing individual’s activities and postures using data from unobtrusive, wearable sensors. Similarly, the unobtrusive, wearable sensors can be used for the assessment of energy expenditure.

[1]  Kenji Mase,et al.  Activity and Location Recognition Using Wearable Sensors , 2002, IEEE Pervasive Comput..

[2]  E. J. Paavonen,et al.  Sleep and psychiatric symptoms in school-age children. , 2000, Journal of the American Academy of Child and Adolescent Psychiatry.

[3]  Guang-Zhong Yang,et al.  Real-Time Pervasive Monitoring for Postoperative Care , 2007, BSN.

[4]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[5]  Scott E Crouter,et al.  Validity of 10 electronic pedometers for measuring steps, distance, and energy cost. , 2003, Medicine and science in sports and exercise.

[6]  L. V. van Amelsvoort,et al.  Occupational determinants of heart rate variability , 2000, International archives of occupational and environmental health.

[7]  S. Voutilainen,et al.  Fungal thermostable cellobiohydrolases. Characterization and protein engineering studies: Dissertation , 2010 .

[8]  P.H. Veltink,et al.  Towards a new method for kinematic quantification of bradykinesia in patients with Parkinson's disease using triaxial accelerometry , 1995, Proceedings of 17th International Conference of the Engineering in Medicine and Biology Society.

[9]  J. Shore,et al.  Which is the better entropy expression for speech processing: -S log S or log S? , 1984 .

[10]  J. Tukey,et al.  An algorithm for the machine calculation of complex Fourier series , 1965 .

[11]  A. Yli-Hankala,et al.  Description of the EntropyTM algorithm as applied in the Datex-Ohmeda S / 5 TM Entropy Module , 2004 .

[12]  Guang-Zhong Yang,et al.  Sensor Placement for Activity Detection Using Wearable Accelerometers , 2010, 2010 International Conference on Body Sensor Networks.

[13]  D. Fotiadis,et al.  An integrated telemedicine platform for the assessment of affective physiological states , 2006, Diagnostic pathology.

[14]  P. Williams-Russo,et al.  The case for more active policy attention to health promotion. , 2002, Health affairs.

[15]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[16]  H. Nieminen,et al.  Estimating Intensity of Physical Activity: A Comparison of Wearable Accelerometer and Gyro Sensors and 3 Sensor Locations , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  G. Breart,et al.  Fall-related factors and risk of hip fracture: the EPIDOS prospective study , 1996, The Lancet.

[18]  K. Patrick,et al.  Physical Activity and Public Health: A Recommendation From the Centers for Disease Control and Prevention and the American College of Sports Medicine , 1995 .

[19]  Klaas R. Westerterp,et al.  Pattern and intensity of physical activity , 2001, Nature.

[20]  G. Jean-Louis,et al.  Determination of sleep and wakefulness with the actigraph data analysis software (ADAS). , 1996, Sleep.

[21]  P. Bonato,et al.  Identification of Tasks Performed by Stroke Patients Using a Mobility Assistive Device , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[22]  S. Chastin,et al.  Methods for objective measure, quantification and analysis of sedentary behaviour and inactivity. , 2010, Gait & posture.

[23]  K. Aminian,et al.  Physical activity monitoring based on accelerometry: validation and comparison with video observation , 1999, Medical & Biological Engineering & Computing.

[24]  S. Jackson,et al.  The Measurement of experienced burnout , 1981 .

[25]  B. Kudielka,et al.  Cortisol in burnout and vital exhaustion: an overview. , 2006, Giornale italiano di medicina del lavoro ed ergonomia.

[26]  B E Ainsworth,et al.  Quantifying energy expenditure and physical activity in the context of dose response. , 2001, Medicine and science in sports and exercise.

[27]  Andreas Lymberis,et al.  Research and development of smart wearable health applications: the challenge ahead. , 2004, Studies in health technology and informatics.

[28]  J. Karemaker,et al.  Heart rate variability: a telltale of health or disease. , 2000, European heart journal.

[29]  L. Mâsse,et al.  Physical activity in the United States measured by accelerometer. , 2008, Medicine and science in sports and exercise.

[30]  A. Shirom,et al.  Burnout as a predictor of all-cause mortality among industrial employees: a 10-year prospective register-linkage study. , 2010, Journal of psychosomatic research.

[31]  Maria Antikainen Facilitating Customer Involvement in Collaborative Online Innovation Communities , 2011 .

[32]  Claude Bouchard,et al.  Physical Activity, Fitness, and Health , 1997 .

[33]  N. Saranummi,et al.  In the Spotlight: Health Information Systems — PHR and Value Based Healthcare \hfill , 2009, IEEE Reviews in Biomedical Engineering.

[34]  Juha Pärkkä,et al.  Automatic feature selection for context recognition in mobile devices , 2010, Pervasive Mob. Comput..

[35]  A. Rigby,et al.  Noninvasive home telemonitoring for patients with heart failure at high risk of recurrent admission and death: the Trans-European Network-Home-Care Management System (TEN-HMS) study. , 2005, Journal of the American College of Cardiology.

[36]  G. Schuler,et al.  Physical Activity , 2005, International Journal of Obesity.

[37]  Tatsuo Nakajima,et al.  Feature Selection and Activity Recognition from Wearable Sensors , 2006, UCS.

[38]  D Shapiro,et al.  Striking a chord: moods, blood pressure, and heart rate in everyday life. , 2001, Psychophysiology.

[39]  R P Tonino,et al.  Effect of physical training on the insulin resistance of aging. , 1989, The American journal of physiology.

[40]  D. Brunenberg,et al.  Self-Measurement of Blood Pressure at Home Reduces the Need for Antihypertensive Drugs: A Randomized, Controlled Trial , 2007, Hypertension.

[41]  Erkki Isometsä,et al.  The association between burnout and physical illness in the general population--results from the Finnish Health 2000 Study. , 2006, Journal of psychosomatic research.

[42]  R. Lippmann Pattern classification using neural networks , 1989, IEEE Communications Magazine.

[43]  Merryn J Mathie,et al.  Accelerometry: providing an integrated, practical method for long-term, ambulatory monitoring of human movement , 2004, Physiological measurement.

[44]  Chantal Brisson,et al.  Effects of job strain on blood pressure: a prospective study of male and female white-collar workers. , 2006, American journal of public health.

[45]  M. Granat,et al.  Compliance with physical activity guidelines in a group of UK-based postal workers using an objective monitoring technique , 2009, European Journal of Applied Physiology.

[46]  A. Hahn,et al.  Signal processing for estimating energy expenditure of elite athletes using triaxial accelerometers , 2005, IEEE Sensors, 2005..

[47]  Mark S Tremblay,et al.  Physical activity and inactivity profiling: the next generation. , 2007, Canadian journal of public health = Revue canadienne de sante publique.

[48]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[49]  Ben Fletcher,et al.  An Empirical Study of Occupational Stress Transmission in Working Couples , 1993 .

[50]  M I Woodward,et al.  Skeletal Accelerations Measured during Different Exercises , 1993, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[51]  M Sun,et al.  A method for measuring mechanical work and work efficiency during human activities. , 1993, Journal of biomechanics.

[52]  R O Pihl,et al.  Validation of the Derogatis Stress Profile using laboratory and real world data. , 1991, Psychotherapy and psychosomatics.

[53]  B. Ainsworth How do I measure physical activity in my patients? Questionnaires and objective methods , 2008, British Journal of Sports Medicine.

[54]  Ilkka Korhonen,et al.  Detection of Daily Activities and Sports With Wearable Sensors in Controlled and Uncontrolled Conditions , 2008, IEEE Transactions on Information Technology in Biomedicine.

[55]  K. Aminian,et al.  Temporal feature estimation during walking using miniature accelerometers: an analysis of gait improvement after hip arthroplasty , 1999, Medical & Biological Engineering & Computing.

[56]  Eliathamby Ambikairajah,et al.  Classification of a known sequence of motions and postures from accelerometry data using adapted Gaussian mixture models. , 2006, Physiological measurement.

[57]  L. Derogatis,et al.  The Derogatis Stress Profile (DSP): quantification of psychological stress. , 1987, Advances in psychosomatic medicine.

[58]  Marja-Liisa Kinnunen Allostatic load in relation to psychosocial stressors and health , 2005 .

[59]  M Partinen,et al.  Sleep disorders and stress. , 1994, Journal of psychosomatic research.

[60]  Margaret L Fruin,et al.  Validity of a multi-sensor armband in estimating rest and exercise energy expenditure. , 2004, Medicine and science in sports and exercise.

[61]  S. Michie,et al.  Air pollution study confirms concerns over childhood rickets , 2003, Occupational and environmental medicine.

[62]  Jukka Kääriäinen Towards an application lifecycle management framework , 2011 .

[63]  J S Arora,et al.  Accelerographic analysis of several types of walking. , 1971, American Journal of Physical Medicine.

[64]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[65]  Ilkka Korhonen,et al.  Health monitoring in the home of the future. , 2003, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[66]  Catrine Tudor-Locke,et al.  Manpo-Kei: The Art and Science of Step Counting: How to Be Naturally Active and Lose Weight , 2006 .

[67]  B E Ainsworth,et al.  Compendium of physical activities: an update of activity codes and MET intensities. , 2000, Medicine and science in sports and exercise.

[68]  M. Leavitt,et al.  Department of Health and Human Services , 2007, Disaster Medicine and Public Health Preparedness.

[69]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[70]  Jeen-Shing Wang,et al.  Using acceleration measurements for activity recognition: An effective learning algorithm for constructing neural classifiers , 2008, Pattern Recognit. Lett..

[71]  C. Bouchard,et al.  Physical Activity and Health , 2006 .

[72]  Kristina Höök,et al.  Mind the body!: designing a mobile stress management application encouraging personal reflection , 2010, Conference on Designing Interactive Systems.

[73]  Gerhard Tröster,et al.  What Does Your Chair Know About Your Stress Level? , 2010, IEEE Transactions on Information Technology in Biomedicine.

[74]  Friedrich Foerster,et al.  Motion pattern and posture: Correctly assessed by calibrated accelerometers , 2000, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[75]  Gerhard Tröster,et al.  Discriminating Stress From Cognitive Load Using a Wearable EDA Device , 2010, IEEE Transactions on Information Technology in Biomedicine.

[76]  J. D. Janssen,et al.  Assessment of energy expenditure for physical activity using a triaxial accelerometer. , 1994, Medicine and science in sports and exercise.

[77]  Blake Hannaford,et al.  A Hybrid Discriminative/Generative Approach for Modeling Human Activities , 2005, IJCAI.

[78]  M. Lafortune Three-dimensional acceleration of the tibia during walking and running. , 1991, Journal of biomechanics.

[79]  C. Caspersen,et al.  Physical activity, exercise, and physical fitness: definitions and distinctions for health-related research. , 1985, Public health reports.

[80]  T. Åkerstedt,et al.  Report on methods and classification of stress, inattention and emotional states , 2004 .

[81]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[82]  G. Jean-Louis,et al.  Sleep estimation from wrist movement quantified by different actigraphic modalities , 2001, Journal of Neuroscience Methods.

[83]  Susan Redline,et al.  Validity of activity-based devices to estimate sleep. , 2010, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[84]  A. Yli-Hankala,et al.  Assessment of surgical stress during general anaesthesia. , 2007, British journal of anaesthesia.

[85]  John G. Webster,et al.  Medical Instrumentation: Application and Design , 1997 .

[86]  Alan V. Oppenheim,et al.  Discrete-time Signal Processing. Vol.2 , 2001 .

[87]  T. Åkerstedt,et al.  Microarousals During Sleep Are Associated With Increased Levels of Lipids, Cortisol, and Blood Pressure , 2004, Psychosomatic medicine.

[88]  Tiina Apilo,et al.  A model for corporate renewal. Requirements for innovation management: Dissertation , 2010 .

[89]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques with Java implementations , 2002, SGMD.

[90]  Steven Swiryn,et al.  Accelerometer-based body-position sensing for ambulatory electrocardiographic monitoring. , 2003, Biomedical instrumentation & technology.

[91]  J F Sallis,et al.  Compendium of physical activities: classification of energy costs of human physical activities. , 1993, Medicine and science in sports and exercise.

[92]  R E LaPorte,et al.  Assessment of physical activity in epidemiologic research: problems and prospects. , 1985, Public health reports.

[93]  Pirjo Näkki,et al.  Social media for citizen participation: Report on the Somus project , 2011 .

[94]  P H Veltink,et al.  Detection of static and dynamic activities using uniaxial accelerometers. , 1996, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[95]  Frank H Wilhelm,et al.  Circadian affective, cardiopulmonary, and cortisol variability in depressed and nondepressed individuals at risk for cardiovascular disease. , 2008, Journal of psychiatric research.

[96]  Frank H. Wilhelm,et al.  Continuous electronic data capture of physiology, behavior and experience in real life: towards ecological momentary assessment of emotion , 2006, Interact. Comput..

[97]  Paul Lukowicz,et al.  From Backpacks to Smartphones: Past, Present, and Future of Wearable Computers , 2009, IEEE Pervasive Computing.

[98]  Ilkka Korhonen,et al.  Mobile Diary for Wellness Management—Results on Usage and Usability in Two User Studies , 2008, IEEE Transactions on Information Technology in Biomedicine.

[99]  Kristof Van Laerhoven,et al.  What shall we teach our pants? , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[100]  Rosalind W. Picard,et al.  A Wearable Sensor for Unobtrusive, Long-Term Assessment of Electrodermal Activity , 2010, IEEE Transactions on Biomedical Engineering.

[101]  I. Korhonen,et al.  Long-Term Subjective and Objective Sleep Analysis of Total Sleep Time and Sleep Quality in Real Life Settings , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[102]  Sakari Stenudd Using machine learning in the adaptive control of a smart environment: Master's thesis , 2010 .

[103]  Luc Cluitmans,et al.  Advancing from offline to online activity recognition with wearable sensors , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[104]  J. Tuomilehto,et al.  Low physical activity as a predictor for total and cardiovascular disease mortality in middle-aged men and women in Finland. , 2004, European heart journal.

[105]  Nigel H. Lovell,et al.  Using information technology to improve the management of chronic disease , 2003, The Medical journal of Australia.

[106]  David W. Bates,et al.  White Paper: Personal Health Records: Definitions, Benefits, and Strategies for Overcoming Barriers to Adoption , 2006, J. Am. Medical Informatics Assoc..

[107]  Ilkka Korhonen,et al.  Long‐term Self‐monitoring of Weight: A Case Study , 2005, Cognitive behaviour therapy.

[108]  Kent Larson,et al.  Tools for Studying Behavior and Technology in Natural Settings , 2003, UbiComp.

[109]  T. Tuomisto,et al.  Diurnal and weekly rhythms of health-related variables in home recordings for two months , 2006, Physiology & Behavior.

[110]  Gaetano Borriello,et al.  A Practical Approach to Recognizing Physical Activities , 2006, Pervasive.

[111]  M. Mathie,et al.  Detection of daily physical activities using a triaxial accelerometer , 2003, Medical and Biological Engineering and Computing.

[112]  H. Nagaraja,et al.  How accurately does wrist actigraphy identify the states of sleep and wakefulness? , 2001, Sleep.

[113]  S. Martin,et al.  Self-monitoring of blood glucose in type 2 diabetes and long-term outcome: an epidemiological cohort study , 2006, Diabetologia.

[114]  J. Fahrenberg,et al.  Assessment of posture and motion by multichannel piezoresistive accelerometer recordings. , 1997, Psychophysiology.

[115]  S. Haynes,et al.  Clinical assessment applications of ambulatory biosensors. , 2007, Psychological assessment.

[116]  H. Busser,et al.  Ambulatory monitoring of physical activity in working situations, a validation study. , 1998, Journal of medical engineering & technology.

[117]  Kenneth Meijer,et al.  Activity identification using body-mounted sensors—a review of classification techniques , 2009, Physiological measurement.

[118]  Shekhar Saxena,et al.  Promoting mental health: concepts, emerging evidence, practice: a report of the World Health Organization, Department of Mental Health and Substance Abuse in collaboration with the Victorian Health Promotion Foundation and the University of Melbourne. , 2005 .

[119]  Petteri Alahuhta,et al.  Technologies in mobile terminals enabling ubiquitous services , 2011 .

[120]  Jukka-Tapani Mäkinen,et al.  Concurrent engineering approach to plastic optics design , 2010 .

[121]  Daniel P. Siewiorek,et al.  Activity recognition and monitoring using multiple sensors on different body positions , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[122]  M. van Gils,et al.  ASSOCIATIONS OF PSYCHOLOGICAL SELF-ASSESSMENTS AND HRV IN LONG-TERM MEASUREMENTS AT HOME , 2005 .

[123]  Martin A. Riedmiller,et al.  A direct adaptive method for faster backpropagation learning: the RPROP algorithm , 1993, IEEE International Conference on Neural Networks.

[124]  Gerhard Tröster,et al.  Analysis of Heart Stress Response for a Public Talk Assistant System , 2008, AmI.

[125]  M. Verduin,et al.  Effects of placement and orientation of body-fixed accelerometers on the assessment of energy expenditure during walking , 2006, Medical and Biological Engineering and Computing.

[126]  Friedrich Foerster,et al.  Detection of posture and motion by accelerometry : a validation study in ambulatory monitoring , 1999 .

[127]  Dick F. Swaab,et al.  Gravitational artefact in frequency spectra of movement acceleration: implications for actigraphy in young and elderly subjects , 1996, Journal of Neuroscience Methods.

[128]  Janet E. Fulton,et al.  2008 physical activity guidelines for Americans; be active, healthy, and happy! , 2008 .

[129]  Anthony Rowe,et al.  Location and Activity Recognition Using eWatch: A Wearable Sensor Platform , 2006, Ambient Intelligence in Everyday.

[130]  C. Guilleminault,et al.  Comparison of actigraphic, polysomnographic, and subjective assessment of sleep parameters in sleep-disordered patients. , 2001, Sleep medicine.

[131]  J. Bussmann,et al.  Analysis and decomposition of signals obtained by thigh-fixed uni-axial accelerometry during normal walking , 2000, Medical and Biological Engineering and Computing.

[132]  J. D. Janssen,et al.  A triaxial accelerometer and portable data processing unit for the assessment of daily physical activity , 1997, IEEE Transactions on Biomedical Engineering.

[133]  Johannes Peltola,et al.  Activity classification using realistic data from wearable sensors , 2006, IEEE Transactions on Information Technology in Biomedicine.

[134]  R. V. Emmerik,et al.  Dynamics of movement coordination and tremor during gait in Parkinson's disease , 1996 .

[135]  S. Huffel,et al.  Influence of Mental Stress on Heart Rate and Heart Rate Variability , 2009 .

[136]  A. Barreto,et al.  Stress Detection in Computer Users Based on Digital Signal Processing of Noninvasive Physiological Variables , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[137]  Seppo Koskinen,et al.  HEALTH AND FUNCTIONAL CAPACITY IN FINLAND Baseline Results of the Health 2000 Health Examination Survey , 2004 .

[138]  M. Fukakusa,et al.  [Use of an accelerometer to measure coughing]. , 1998, Nihon Kokyuki Gakkai zasshi = the journal of the Japanese Respiratory Society.

[139]  Alberto G Bonomi,et al.  Estimation of Free‐Living Energy Expenditure Using a Novel Activity Monitor Designed to Minimize Obtrusiveness , 2010, Obesity.

[140]  Arie Shirom,et al.  Reflections on the study of burnout , 2005 .

[141]  J. Salonen,et al.  Projected effects of high-risk versus population-based prevention strategies in coronary heart disease. , 1985, American journal of epidemiology.

[142]  T Togawa,et al.  Classification of waist-acceleration signals in a continuous walking record. , 2000, Medical engineering & physics.

[143]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[144]  David Simons,et al.  Continua: An Interoperable Personal Healthcare Ecosystem , 2007, IEEE Pervasive Computing.

[145]  Kamiar Aminian,et al.  Capturing human motion using body‐fixed sensors: outdoor measurement and clinical applications , 2004, Comput. Animat. Virtual Worlds.

[146]  Nigel H. Lovell,et al.  Implementation of a real-time human movement classifier using a triaxial accelerometer for ambulatory monitoring , 2006, IEEE Transactions on Information Technology in Biomedicine.

[147]  K. Lorig,et al.  Effect of a self-management program on patients with chronic disease. , 2001, Effective clinical practice : ECP.

[148]  M. Lemke,et al.  Motor activity and perception of sleep in depressed patients. , 1999, Journal of psychiatric research.

[149]  I. Vuori,et al.  Physical Activity Pie: A Graphical Presentation Integrating Recommendations for Fitness and Health , 2005 .

[150]  Tomi Haatainen Stamp fabrication by step and stamp nanoimprinting: Dissertation , 2011 .

[151]  Scott E Crouter,et al.  A novel method for using accelerometer data to predict energy expenditure. , 2006, Journal of applied physiology.

[152]  N. Owen,et al.  Sedentary behaviour and biomarkers of cardiometabolic health risk in adolescents: an emerging scientific and public health issue. , 2010, Revista espanola de cardiologia.

[153]  G. Faccio Discovery of oxidative enzymes for food engineering : Tyrosinase and sulfhydryl oxidase , 2011 .

[154]  S. Linton,et al.  Does work stress predict insomnia? A prospective study. , 2004, British journal of health psychology.

[155]  Richard Lippmann,et al.  Practical Characteristics of Neural Network and Conventional Pattern Classifiers on Artificial and Speech Problems , 1989, NIPS.

[156]  A. Wayne Whitney,et al.  A Direct Method of Nonparametric Measurement Selection , 1971, IEEE Transactions on Computers.