A Multiple Source Framework for the Identification of Activities of Daily Living Based on Mobile Device Data

Most mobile devices include motion, magnetic, acoustic, and location sensors. They allow the implementation of a framework for the recognition of Activities of Daily Living (ADL) and its environments, composed by the acquisition, processing, fusion, and classification of data. This study compares different implementations of artificial neural networks, concluding that the obtained results were 85.89% and 100% for the recognition of standard ADL. Additionally, for the identification of standing activities with Deep Neural Networks (DNN) respectively, and 86.50% for the identification of the environments with Feedforward Neural Networks. Numerical results illustrate that the proposed framework can achieve robust performance from the data fusion of off-the-shelf mobile devices.

[1]  Chris Van Hoof,et al.  Self-calibration of walking speed estimations using smartphone sensors , 2014, 2014 IEEE International Conference on Pervasive Computing and Communication Workshops (PERCOM WORKSHOPS).

[2]  Nuno M. Garcia,et al.  Pattern Recognition Techniques for the Identification of Activities of Daily Living using Mobile Device Accelerometer , 2017, PeerJ Prepr..

[3]  Diane J. Cook,et al.  Simple and Complex Activity Recognition through Smart Phones , 2012, 2012 Eighth International Conference on Intelligent Environments.

[4]  A. Ng.  Feature selection, L1 vs. L2 regularization, and rotational invariance , 2004, Twenty-first international conference on Machine learning - ICML '04.

[5]  Stefan Poslad,et al.  LALS: A Low Power Accelerometer Assisted Location Sensing technique for smartphones , 2013, 2013 IEEE Global Communications Conference (GLOBECOM).

[6]  N. Garcia,et al.  Multi-sensor data fusion techniques for the identification of activities of daily living using mobile devices , 2015 .

[7]  Ehsan Valavi,et al.  Microsoft Word-Final.docx , 2010 .

[8]  Thinagaran Perumal,et al.  Activity recognition based on accelerometer sensor using combinational classifiers , 2015, 2015 IEEE Conference on Open Systems (ICOS).

[9]  Nuno M. Garcia,et al.  Identification of Activities of Daily Living Using Sensors Available in off-the-shelf Mobile Devices: Research and Hypothesis , 2016, ISAmI.

[10]  Nuno M. Garcia,et al.  From Data Acquisition to Data Fusion: A Comprehensive Review and a Roadmap for the Identification of Activities of Daily Living Using Mobile Devices , 2016, Sensors.

[11]  Yufei Chen,et al.  On motion-sensor behavior analysis for human-activity recognition via smartphones , 2016, 2016 IEEE International Conference on Identity, Security and Behavior Analysis (ISBA).

[12]  Hakob Sarukhanyan,et al.  Accelerometer and GPS sensor combination based system for human activity recognition , 2013, Ninth International Conference on Computer Science and Information Technologies Revised Selected Papers.

[13]  Thomas George,et al.  An effective approach for human activity recognition on smartphone , 2015, 2015 IEEE International Conference on Engineering and Technology (ICETECH).

[14]  Yi-Leh Wu,et al.  Activity Recognition with sensors on mobile devices , 2014, 2014 International Conference on Machine Learning and Cybernetics.

[15]  W. Wagner,et al.  Improving runoff prediction through the assimilation of the ASCAT soil moisture product , 2010 .

[16]  Gabi Nakibly,et al.  Mobile Device Identification via Sensor Fingerprinting , 2014, ArXiv.

[17]  Nuno M. Garcia,et al.  Identification of activities of daily living through data fusion on motion and magnetic sensors embedded on mobile devices , 2018, Pervasive Mob. Comput..

[18]  Ye Li,et al.  Fall detection by built-in tri-accelerometer of smartphone , 2012, Proceedings of 2012 IEEE-EMBS International Conference on Biomedical and Health Informatics.

[19]  Sonja Meyer,et al.  Battery-Efficient Transportation Mode Detection on Mobile Devices , 2015, 2015 16th IEEE International Conference on Mobile Data Management.

[20]  Hakob Sarukhanyan,et al.  Multithreaded signal preprocessing approach for inertial sensors of smartphone , 2015, 2015 Computer Science and Information Technologies (CSIT).

[21]  Sara Saeedi,et al.  A Context-aware Recommendation System using smartphone sensors , 2016, 2016 IEEE 7th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON).

[22]  Riccardo Bellazzi,et al.  Out-of-Home Activity Recognition from GPS Data in Schizophrenic Patients , 2016, 2016 IEEE 29th International Symposium on Computer-Based Medical Systems (CBMS).

[23]  Fu-Shan Jaw,et al.  Smartphone-based fall detection algorithm using feature extraction , 2016, 2016 9th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI).

[24]  Hamed Haddadi,et al.  SensingKit: Evaluating the Sensor Power Consumption in iOS Devices , 2016, 2016 12th International Conference on Intelligent Environments (IE).

[25]  Christiane Gresse von Wangenheim,et al.  A Systematic Literature Review on Usability Heuristics for Mobile Phones , 2013, Int. J. Mob. Hum. Comput. Interact..

[26]  Arun Ross,et al.  Score normalization in multimodal biometric systems , 2005, Pattern Recognit..

[27]  Nirvana Meratnia,et al.  RoVi: Continuous transport infrastructure monitoring framework for preventive maintenance , 2017, 2017 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[28]  Nuno M. Garcia,et al.  Data Fusion on Motion and Magnetic Sensors embedded on Mobile Devices for the Identification of Activities of Daily Living , 2017, ArXiv.

[29]  Edward D. Lemaire,et al.  Change-of-state determination to recognize mobility activities using a BlackBerry smartphone , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[30]  Nuno M. Garcia,et al.  User Environment Detection with Acoustic Sensors Embedded on Mobile Devices for the Recognition of Activities of Daily Living , 2017, ArXiv.

[31]  Alfonso E. Romero,et al.  Recognising lifestyle activities of diabetic patients with a smartphone , 2015, 2015 9th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth).

[32]  DeLiang Wang,et al.  Pattern recognition: neural networks in perspective , 1993, IEEE Expert.

[33]  Nuno M. Garcia.  A Roadmap to the Design of a Personal Digital Life Coach , 2015, ICT Innovations.

[34]  Paul J. M. Havinga,et al.  Towards Physical Activity Recognition Using Smartphone Sensors , 2013, 2013 IEEE 10th International Conference on Ubiquitous Intelligence and Computing and 2013 IEEE 10th International Conference on Autonomic and Trusted Computing.

[35]  Héctor Pomares,et al.  On the Use of Sensor Fusion to Reduce the Impact of Rotational and Additive Noise in Human Activity Recognition , 2012, Sensors.

[36]  K. Doya,et al.  Exciting Time for Neural Networks , 2015 .