Share-n-Learn

Wearable sensors utilize machine learning algorithms to infer important events such as the behavioral routine and health status of their end users from time-series sensor data. A major obstacle in large-scale utilization of these systems is that the machine learning algorithms cannot be shared among users or reused in contexts different from the setting in which the training data are collected. As a result, the algorithms need to be retrained from scratch in new sensor contexts, such as when the on-body location of the wearable sensor changes or when the system is utilized by a new user. The retraining process places significant burden on end users and system designers to collect and label large amounts of training sensor data. In this article, we challenge the current algorithm training paradigm and introduce Share-n-Learn to automatically detect and learn physical sensor contexts from a repository of shared expert models without collecting any new labeled training data. Share-n-Learn enables system designers and end users to seamlessly share and reuse machine learning algorithms that are trained under different contexts and data collection settings. We develop algorithms to autonomously identify sensor contexts and propose a gating function to automatically activate the most accurate machine learning model among the set of shared expert models. We assess the performance of Share-n-Learn for activity recognition when a dynamic sensor constantly migrates from one body location to another. Our analysis based on real data collected with human subjects on three datasets demonstrates that Share-n-Learn achieves, on average, 68.4% accuracy in detecting physical activities with context-varying wearables. This accuracy performance is about 19% more than ‘majority voting,’ 10% more than the state-of-the-art transfer learning, and only 8% less than the experimental upper bound.

[1]  Jadwiga Indulska,et al.  Adaptive activity learning with dynamically available context , 2016, 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[2]  Rayid Ghani,et al.  Analyzing the effectiveness and applicability of co-training , 2000, CIKM '00.

[3]  T. Gomes,et al.  We-care: An IoT-based health care system for elderly people , 2017, 2017 IEEE International Conference on Industrial Technology (ICIT).

[4]  Estevam R. Hruschka,et al.  Coupled semi-supervised learning for information extraction , 2010, WSDM '10.

[5]  Hassan Ghasemzadeh,et al.  Autonomous sensor-context learning in dynamic human-centered Internet-of-Things environments , 2016, 2016 IEEE/ACM International Conference on Computer-Aided Design (ICCAD).

[6]  Paul Lukowicz,et al.  Towards recognising collaborative activities using multiple on-body sensors , 2016, UbiComp Adjunct.

[7]  Shiliang Sun,et al.  A survey of multi-view machine learning , 2013, Neural Computing and Applications.

[8]  Panagiotis G. Ipeirotis,et al.  Get another label? improving data quality and data mining using multiple, noisy labelers , 2008, KDD.

[9]  Hussein A. Abbass,et al.  A novel mixture of experts model based on cooperative coevolution , 2006, Neurocomputing.

[10]  Albert C. Esterline,et al.  Behavioral Modeling Intrusion Detection System (BMIDS) Using Internet of Things (IoT) Behavior-Based Anomaly Detection via Immunity-Inspired Algorithms , 2016, 2016 25th International Conference on Computer Communication and Networks (ICCCN).

[11]  Paul Lukowicz,et al.  The OPPORTUNITY Framework and Data Processing Ecosystem for Opportunistic Activity and Context Recognition , 2012 .

[12]  Hassan Ghasemzadeh,et al.  Synchronous Dynamic View Learning: A Framework for Autonomous Training of Activity Recognition Models Using Wearable Sensors , 2017, 2017 16th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[13]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[14]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[15]  Masashi Sugiyama,et al.  Active Learning with Model Selection in Linear Regression , 2008, SDM.

[16]  Diane J. Cook,et al.  Transfer learning for activity recognition: a survey , 2013, Knowledge and Information Systems.

[17]  Simo Hosio,et al.  Are Smartphones Ubiquitous?: An in-depth survey of smartphone adoption by seniors , 2017, IEEE Consumer Electronics Magazine.

[18]  Jason Nolan,et al.  Sousveillance: Inventing and Using Wearable Computing Devices for Data Collection in Surveillance Environments. , 2002 .

[19]  Hassan Ghasemzadeh,et al.  Personalized Human Activity Recognition Using Convolutional Neural Networks , 2018, AAAI.

[20]  John A. Stankovic,et al.  Research Directions for the Internet of Things , 2014, IEEE Internet of Things Journal.

[21]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[22]  Cem Ersoy,et al.  Using Active Learning to Allow Activity Recognition on a Large Scale , 2011, AmI.

[23]  G. Englebienne,et al.  Transferring Knowledge of Activity Recognition across Sensor Networks , 2010, Pervasive.

[24]  Min Chen,et al.  Smart Clothing: Connecting Human with Clouds and Big Data for Sustainable Health Monitoring , 2016, Mobile Networks and Applications.

[25]  Reza Ebrahimpour,et al.  Mixture of experts: a literature survey , 2014, Artificial Intelligence Review.

[26]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[27]  Hassan Ghasemzadeh,et al.  Plug-n-learn: Automatic learning of computational algorithms in human-centered Internet-of-Things applications , 2016, 2016 53nd ACM/EDAC/IEEE Design Automation Conference (DAC).

[28]  Geraldine Fitzpatrick,et al.  Self-Care Technologies in HCI: Trends, Tensions, and Opportunities , 2015, TCHI.

[29]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[30]  Andrew P. Witkin,et al.  Scale-space filtering: A new approach to multi-scale description , 1984, ICASSP.

[31]  Konstantin Aal,et al.  ICT-Based Fall Prevention System for Older Adults , 2016, ACM Trans. Comput. Hum. Interact..

[32]  Ben Stokes,et al.  Inflashoe: A Shape Changing Shoe to Control Underfoot Pressure , 2017, CHI Extended Abstracts.

[33]  Yi Zhai,et al.  The Study on the Life Signs of Clinical Patients Monitored by Electronic Wrist Band , 2017, 22017 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC).

[34]  Gierad Laput,et al.  Deus EM Machina: On-Touch Contextual Functionality for Smart IoT Appliances , 2017, CHI.

[35]  Billur Barshan,et al.  Human Activity Recognition Using Inertial/Magnetic Sensor Units , 2010, HBU.

[36]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[37]  Daren C. Brabham Crowdsourcing as a Model for Problem Solving , 2008 .

[38]  Anurag Agarwal,et al.  The Internet of Things—A survey of topics and trends , 2014, Information Systems Frontiers.

[39]  Sridhar Mahadevan,et al.  Manifold alignment using Procrustes analysis , 2008, ICML '08.

[40]  Hassan Ghasemzadeh,et al.  Energy-efficient signal processing in wearable embedded systems: an optimal feature selection approach , 2012, ISLPED '12.

[41]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[42]  Hassan Ghasemzadeh,et al.  Power-Aware Computing in Wearable Sensor Networks: An Optimal Feature Selection , 2015, IEEE Transactions on Mobile Computing.

[43]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[44]  R. Polikar,et al.  Ensemble based systems in decision making , 2006, IEEE Circuits and Systems Magazine.

[45]  Gerhard Tröster,et al.  The adARC pattern analysis architecture for adaptive human activity recognition systems , 2011, Journal of Ambient Intelligence and Humanized Computing.

[46]  Diane J. Cook,et al.  Automated Activity Interventions to Assist with Activities of Daily Living , 2012, Agents and Ambient Intelligence.

[47]  Hassan Ghasemzadeh,et al.  Personalization without User Interruption: Boosting Activity Recognition in New Subjects Using Unlabeled Data , 2017, 2017 ACM/IEEE 8th International Conference on Cyber-Physical Systems (ICCPS).

[48]  Hassan Ghasemzadeh,et al.  Autonomous Training of Activity Recognition Algorithms in Mobile Sensors: A Transfer Learning Approach in Context-Invariant Views , 2018, IEEE Transactions on Mobile Computing.

[49]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[50]  Valerii V. Fedorov,et al.  Optimal experimental design , 2010 .

[51]  Deniz Erdogmus,et al.  Divide-and-conquer approach for brain machine interfaces: nonlinear mixture of competitive linear models , 2003, Neural Networks.

[52]  Adrian E. Raftery,et al.  How Many Clusters? Which Clustering Method? Answers Via Model-Based Cluster Analysis , 1998, Comput. J..

[53]  Hans-Peter Kriegel,et al.  OPTICS: ordering points to identify the clustering structure , 1999, SIGMOD '99.

[54]  Hao Ma,et al.  Human Gait Modeling and Analysis Using a Semi-Markov Process With Ground Reaction Forces , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[55]  Qiang Yang,et al.  Boosting for transfer learning , 2007, ICML '07.

[56]  Hassan Ghasemzadeh,et al.  Toward seamless wearable sensing: Automatic on-body sensor localization for physical activity monitoring , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[57]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[58]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[59]  Billur Barshan,et al.  Comparative study on classifying human activities with miniature inertial and magnetic sensors , 2010, Pattern Recognit..

[60]  W. J. Studden,et al.  Optimal Experimental Designs , 1966 .

[61]  Timo Sztyler,et al.  On-body localization of wearable devices: An investigation of position-aware activity recognition , 2016, 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[62]  David Barber,et al.  Bayesian Classification With Gaussian Processes , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[63]  Mirco Musolesi,et al.  Towards multi-modal anticipatory monitoring of depressive states through the analysis of human-smartphone interaction , 2016, UbiComp Adjunct.

[64]  Senén Barro,et al.  Do we need hundreds of classifiers to solve real world classification problems? , 2014, J. Mach. Learn. Res..

[65]  Mi Zhang,et al.  BodyScan: Enabling Radio-based Sensing on Wearable Devices for Contactless Activity and Vital Sign Monitoring , 2016, MobiSys.

[66]  Paul Lukowicz,et al.  Dealing with sensor displacement in motion-based onbody activity recognition systems , 2008, UbiComp.

[67]  Matjaz Gams,et al.  Continuous stress detection using a wrist device: in laboratory and real life , 2016, UbiComp Adjunct.

[68]  Neil W. Bergmann,et al.  Gait-Watch: A Context-Aware Authentication System for Smart Watch Based on Gait Recognition , 2017, 2017 IEEE/ACM Second International Conference on Internet-of-Things Design and Implementation (IoTDI).

[69]  Bill N. Schilit,et al.  Enabling the Internet of Things , 2015, Computer.

[70]  Katherine Isbister,et al.  Interdependent Wearables (for Play): A Strong Concept for Design , 2017, CHI.

[71]  Paul Lukowicz,et al.  Collecting complex activity datasets in highly rich networked sensor environments , 2010, 2010 Seventh International Conference on Networked Sensing Systems (INSS).

[72]  Mohammed Feham,et al.  Multioccupant Activity Recognition in Pervasive Smart Home Environments , 2015, ACM Comput. Surv..

[73]  Michael I. Jordan,et al.  Task Decomposition Through Competition in a Modular Connectionist Architecture: The What and Where Vision Tasks , 1990, Cogn. Sci..

[74]  Daniel Roggen,et al.  Automatic Transfer of Activity Recognition Capabilities between Body-Worn Motion Sensors: Training Newcomers to Recognize Locomotion , 2011 .

[75]  Reza Ebrahimpour,et al.  Improving mixture of experts for view-independent face recognition using teacher-directed learning , 2011, Machine Vision and Applications.

[76]  Nirmalya Roy,et al.  A smart segmentation technique towards improved infrequent non-speech gestural activity recognition model , 2017, Pervasive Mob. Comput..

[77]  Mark D. Gross,et al.  Awareable steps: functional and fashionable shoes for patients with dementia , 2015, UbiComp/ISWC Adjunct.

[78]  M. Schwab,et al.  Data collection as a barrier to personalized medicine. , 2015, Trends in pharmacological sciences.