Co-MEAL: Cost-Optimal Multi-Expert Active Learning Architecture for Mobile Health Monitoring

Mobile health monitoring plays a central role in a variety of health-care applications. Using mobile technology, health-care providers can access clinical information and communicate with subjects in real-time. Due to the sensitive nature of health-care applications, these systems need to process physiological signals highly accurately. However, as mobile devices are employed in dynamic environments, the accuracy of a machine learning model drops whenever a change in configuration of the system occurs. Therefore, data mining and machine learning techniques that specifically address challenges associated with dynamic environments (e.g. different users, signal heterogeneity) are needed. In this paper, using active learning as an organizing principle, we propose a cost-optimal multiple-expert architecture to adapt a machine learning model (e.g. classifier) developed in a given context to a new context or configuration. More specifically, in our architecture, a system's machine learning model learns from experts available to the system (e.g. another mobile device, human annotator) while minimizing the cost of data labeling. Our architecture also exploits collaboration between experts to enrich their knowledge which in turn decreases both cost and uncertainty of data labeling in future steps. We demonstrate the efficacy of the architecture using a publicly available dataset on human activity. We show that the accuracy of activity recognition reaches over 85% by labeling only 15% of unlabeled data. At the same time, the number of queries from human expert is reduced by up to 82%.

[1]  Illhoi Yoo,et al.  A Systematic Review of Healthcare Applications for Smartphones , 2012, BMC Medical Informatics and Decision Making.

[2]  Timo Sztyler,et al.  On-body localization of wearable devices: An investigation of position-aware activity recognition , 2016, 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[3]  Hassan Ghasemzadeh,et al.  Transfer learning algorithms for autonomous reconfiguration of wearable systems , 2016, 2016 IEEE International Conference on Big Data (Big Data).

[4]  Hassan Ghasemzadeh,et al.  Smart-Cuff: A wearable bio-sensing platform with activity-sensitive information quality assessment for monitoring ankle edema , 2015, 2015 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[5]  Sunita Sarawagi,et al.  Domain Adaptation of Conditional Probability Models Via Feature Subsetting , 2007, PKDD.

[6]  Yufei Chen,et al.  Performance Analysis of Smartphone-Sensor Behavior for Human Activity Recognition , 2017, IEEE Access.

[7]  J. Millán,et al.  A Probabilistic Approach to Handle Missing Data for Multi-Sensory Activity Recognition , 2010, Ubicomp 2010.

[8]  Enamul Hoque,et al.  AALO: Activity recognition in smart homes using Active Learning in the presence of Overlapped activities , 2012, 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[9]  Andreas Holzinger,et al.  Interactive machine learning for health informatics: when do we need the human-in-the-loop? , 2016, Brain Informatics.

[10]  M. Schwab,et al.  Data collection as a barrier to personalized medicine. , 2015, Trends in pharmacological sciences.

[11]  Stefan Poslad,et al.  Improved Use of Foot Force Sensors and Mobile Phone GPS for Mobility Activity Recognition , 2014, IEEE Sensors Journal.

[12]  H. Ghasemzadeh,et al.  Wireless Medical-Embedded Systems: A Review of Signal-Processing Techniques for Classification , 2013, IEEE Sensors Journal.

[13]  Diane J. Cook,et al.  Designing and evaluating active learning methods for activity recognition , 2014, UbiComp Adjunct.

[14]  Bo Wang,et al.  Dynamic Label Propagation for Semi-supervised Multi-class Multi-label Classification , 2013, ICCV.

[15]  Javad Birjandtalab,et al.  Automated seizure detection using limited-channel EEG and non-linear dimension reduction , 2017, Comput. Biol. Medicine.

[16]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[17]  Carla E. Brodley,et al.  Active Class Selection , 2007, ECML.

[18]  Laura Cercenelli,et al.  Multi-Sense CardioPatch: A Wearable Patch for Remote Monitoring of Electro-Mechanical Cardiac Activity , 2017, ASAIO journal.

[19]  Qiang Yang,et al.  Cross-domain activity recognition , 2009, UbiComp.

[20]  Paul Lukowicz,et al.  From Active Learning to Dedicated Collaborative Interactive Learning , 2016 .

[21]  A. Haines,et al.  The Effectiveness of Mobile-Health Technologies to Improve Health Care Service Delivery Processes: A Systematic Review and Meta-Analysis , 2013, PLoS medicine.

[22]  Di Tore,et al.  Situation awareness and complexity: the role of wearable technologies in sports science , 2015 .

[23]  L. Benini,et al.  Activity recognition from on-body sensors by classifier fusion: sensor scalability and robustness , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[24]  Hassan Ghasemzadeh,et al.  An Energy-Efficient Computational Model for Uncertainty Management in Dynamically Changing Networked Wearables , 2016, ISLPED.

[25]  GhasemzadehHassan,et al.  Older People with Access to Hand-Held Devices: Who Are They? , 2015 .

[26]  Antonio Ortega,et al.  Active semi-supervised learning using sampling theory for graph signals , 2014, KDD.

[27]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[28]  Hassan Ghasemzadeh,et al.  Energy-Efficient Information-Driven Coverage for Physical Movement Monitoring in Body Sensor Networks , 2009, IEEE Journal on Selected Areas in Communications.

[29]  Yi Yang,et al.  Multi-Class Active Learning by Uncertainty Sampling with Diversity Maximization , 2015, International Journal of Computer Vision.

[30]  Mikkel Baun Kjærgaard,et al.  Smart Devices are Different: Assessing and MitigatingMobile Sensing Heterogeneities for Activity Recognition , 2015, SenSys.

[31]  Hassan Ghasemzadeh,et al.  Personalization without User Interruption: Boosting Activity Recognition in New Subjects Using Unlabeled Data , 2017, 2017 ACM/IEEE 8th International Conference on Cyber-Physical Systems (ICCPS).

[32]  Carla Kmett Danielson,et al.  Mobile devices for the remote acquisition of physiological and behavioral biomarkers in psychiatric clinical research. , 2017, Journal of psychiatric research.

[33]  Hassan Ghasemzadeh,et al.  Older People with Access to Hand-Held Devices: Who Are They? , 2015, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[34]  Paul Lukowicz,et al.  Using acceleration signatures from everyday activities for on-body device location , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[35]  Lihong Li,et al.  Unbiased online active learning in data streams , 2011, KDD.

[36]  Mark Craven,et al.  Active Learning with Real Annotation Costs , 2008 .

[37]  Hugh S Markus,et al.  Personalized medicine: risk prediction, targeted therapies and mobile health technology , 2014, BMC Medicine.

[38]  Hassan Ghasemzadeh,et al.  Plug-n-learn: Automatic learning of computational algorithms in human-centered Internet-of-Things applications , 2016, 2016 53nd ACM/EDAC/IEEE Design Automation Conference (DAC).

[39]  Deborah Estrin,et al.  Improving activity classification for health applications on mobile devices using active and semi-supervised learning , 2010, 2010 4th International Conference on Pervasive Computing Technologies for Healthcare.

[40]  Hassan Ghasemzadeh,et al.  Patient-centric on-body sensor localization in smart health systems , 2014, 2014 48th Asilomar Conference on Signals, Systems and Computers.

[41]  Diane J. Cook,et al.  Heterogeneous transfer learning for activity recognition using heuristic search techniques , 2014, Int. J. Pervasive Comput. Commun..