Multiple density maps information fusion for effectively assessing intensity pattern of lifelogging physical activity

Physical activity (PA) measurement is a crucial task in healthcare technology aimed at monitoring the progression and treatment of many chronic diseases. Traditional lifelogging PA measures require relatively high cost and can only be conducted in controlled or semi-controlled environments, though they exhibit remarkable precision of PA monitoring outcomes. Recent advancement of commercial wearable devices and smartphones for recording one’s lifelogging PA has popularized data capture in uncontrolled environments. However, due to diverse life patterns and heterogeneity of connected devices as well as the PA recognition accuracy, lifelogging PA data measured by wearable devices and mobile phones contains much uncertainty thereby limiting their adoption for healthcare studies. To improve the feasibility of PA tracking datasets from commercial wearable/mobile devices, this paper proposes a lifelogging PA intensity pattern decision making approach for lifelong PA measures. The method is to firstly remove some irregular uncertainties (IU) via an Ellipse fitting model, and then construct a series of monthly based hour-day density map images for representing PA intensity patterns with regular uncertainties (RU) on each month. Finally it explores Dempster-Shafer theory of evidence fusing information from these density map images for generating a decision making model of a final personal lifelogging PA intensity pattern. The approach has significantly reduced the uncertainties and incompleteness of datasets from third party devices. Two case studies on a mobile personalized healthcare platform MHA [1] connecting the mobile app Moves are carried out. The results indicate that the proposed approach can improve effectiveness of PA tracking devices or apps for various types of people who frequently use them as a healthcare indicator.

[1]  Davide Anguita,et al.  Transition-Aware Human Activity Recognition Using Smartphones , 2016, Neurocomputing.

[2]  Andrew W. Fitzgibbon,et al.  Direct Least Square Fitting of Ellipses , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Paul J. M. Havinga,et al.  A Survey of Online Activity Recognition Using Mobile Phones , 2015, Sensors.

[4]  Tae-Seong Kim,et al.  Depth video-based human activity recognition system using translation and scaling invariant features for life logging at smart home , 2012, IEEE Transactions on Consumer Electronics.

[5]  Cathal Gurrin,et al.  The smartphone as a platform for wearable cameras in health research. , 2013, American journal of preventive medicine.

[6]  Jun Yang,et al.  Toward physical activity diary: motion recognition using simple acceleration features with mobile phones , 2009, IMCE '09.

[7]  Lorenzo Bruzzone,et al.  Image fusion techniques for remote sensing applications , 2002, Inf. Fusion.

[8]  Po Yang,et al.  A Survey of Physical Activity Monitoring and Assessment Using Internet of Things Technology , 2015, 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing.

[9]  Dorin Comaniciu,et al.  Robust anisotropic Gaussian fitting for volumetric characterization of Pulmonary nodules in multislice CT , 2005, IEEE Transactions on Medical Imaging.

[10]  Alan F. Smeaton,et al.  Passively recognising human activities through lifelogging , 2011, Comput. Hum. Behav..

[11]  Wei Zhang,et al.  Hybrid human detection and recognition in surveillance , 2016, Neurocomputing.

[12]  Zhihan Lv,et al.  Bigdata Oriented Multimedia Mobile Health Applications , 2016, Journal of Medical Systems.

[13]  Manolis Tsiknakis,et al.  MyHealthAvatar: Personalized and empowerment health services through Internet of Things technologies , 2014, 2014 4th International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare Through Innovations in Mobile and Wireless Technologies (MOBIHEALTH).

[14]  Po Yang,et al.  Improving the Validity of Lifelogging Physical Activity Measures in an Internet of Things Environment , 2015, 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing.

[15]  W. Gander,et al.  Fitting of circles and ellipses least squares solution , 1995 .

[16]  Xiaohong Yuan,et al.  Engine fault diagnosis based on multi-sensor information fusion using Dempster-Shafer evidence theory , 2007, Inf. Fusion.

[17]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[18]  Ana M. Bernardos,et al.  Activity logging using lightweight classification techniques in mobile devices , 2012, Personal and Ubiquitous Computing.

[19]  Isabelle Bloch Information combination operators for data fusion: a comparative review with classification , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[20]  Majid Sarrafzadeh,et al.  Toward Unsupervised Activity Discovery Using Multi-Dimensional Motif Detection in Time Series , 2009, IJCAI.

[21]  Kevin Norton,et al.  Position statement on physical activity and exercise intensity terminology. , 2010, Journal of science and medicine in sport.

[22]  Yaxin Bi,et al.  Using the Dempster–Shafer Theory of Evidence With a Revised Lattice Structure for Activity Recognition , 2011, IEEE Transactions on Information Technology in Biomedicine.

[23]  Xia Zhao,et al.  Life-Logging Data Aggregation Solution for Interdisciplinary Healthcare Research and Collaboration , 2015, 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing.

[24]  Jianxiong Zhou,et al.  A Low-Power and Portable Biomedical Device for Respiratory Monitoring with a Stable Power Source , 2015, Sensors.

[25]  Zhihan Lv,et al.  Evaluation of Kinect2 based balance measurement , 2016, Neurocomputing.

[26]  Gwenn Englebienne,et al.  Accurate activity recognition in a home setting , 2008, UbiComp.

[27]  Sean A. Munson,et al.  Taming data complexity in lifelogs: exploring visual cuts of personal informatics data , 2014, Conference on Designing Interactive Systems.

[28]  Wojciech Pieczynski,et al.  Multisensor image segmentation using Dempster-Shafer fusion in Markov fields context , 2001, IEEE Trans. Geosci. Remote. Sens..

[29]  Chelsea Dobbins,et al.  Advanced artificial neural network classification for detecting preterm births using EHG records , 2016, Neurocomputing.

[30]  Shuang Wang,et al.  Activity Density Map Visualization and Dissimilarity Comparison for Eldercare Monitoring , 2012, IEEE Transactions on Information Technology in Biomedicine.

[31]  Alan F. Smeaton,et al.  Using visual lifelogs to automatically characterize everyday activities , 2013, Inf. Sci..

[32]  Zhihan Lv,et al.  Game On, Science - How Video Game Technology May Help Biologists Tackle Visualization Challenges , 2013, PloS one.

[33]  W. Gander,et al.  Least-squares fitting of circles and ellipses , 1994 .

[34]  C. Caspersen,et al.  Physical activity, exercise, and physical fitness: definitions and distinctions for health-related research. , 1985, Public health reports.

[35]  Minsoo Kang,et al.  Development and validation of a movement and activity in physical space score as a functional outcome measure. , 2011, Archives of physical medicine and rehabilitation.

[36]  Hiroshi Akima,et al.  A New Method of Interpolation and Smooth Curve Fitting Based on Local Procedures , 1970, JACM.