Distributed active learning with application to battery health management

This paper focuses on distributed implementation of active learning with a limited number of queries. In the prognostics and health management domain, the cost to obtain a training sample can be fairly high, especially when studying the aging process for remaining useful life prediction of a mission critical component. Active learning with limited resource is formulated as a reinforcement learning problem, where the sampling strategy has to minimize the expected generalization error within a finite horizon. An importance sampling based method is adopted for active learning and extended to distributed implementation with multiple active learners. The fusion of importance weights from multiple learners is interpreted as a special boosting strategy. The proposed framework is applicable to classification and regression problems as well as semi-supervised learning. The remaining useful life prediction for battery health management is used to compare the proposed method with conventional passive learning methods. Empirical study shows that the fusion of distributed active learners achieves better classification and prediction accuracy with a reduced number of training samples needed to have a complete run-to-failure profile.

[1]  Bhaskar Saha,et al.  Prognostics Methods for Battery Health Monitoring Using a Bayesian Framework , 2009, IEEE Transactions on Instrumentation and Measurement.

[2]  M. Armand,et al.  Issues and challenges facing rechargeable lithium batteries , 2001, Nature.

[3]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[4]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[5]  K. Goebel,et al.  Prognostics in Battery Health Management , 2008, IEEE Instrumentation & Measurement Magazine.

[6]  Noga Alon,et al.  The Probabilistic Method , 2015, Fundamentals of Ramsey Theory.

[7]  Sanjoy Dasgupta,et al.  A General Agnostic Active Learning Algorithm , 2007, ISAIM.

[8]  John Langford,et al.  Importance weighted active learning , 2008, ICML '09.

[9]  Sanjoy Dasgupta,et al.  Coarse sample complexity bounds for active learning , 2005, NIPS.

[10]  Peter Auer,et al.  The Nonstochastic Multiarmed Bandit Problem , 2002, SIAM J. Comput..

[11]  Steve Hanneke,et al.  Adaptive Rates of Convergence in Active Learning , 2009, COLT.

[12]  Naoki Abe,et al.  Query Learning Strategies Using Boosting and Bagging , 1998, ICML.

[13]  Bin Li,et al.  An adaptive sampling scheme guided by BART—with an application to predict processor performance , 2010 .

[14]  Kai Goebel,et al.  Modeling Li-ion Battery Capacity Depletion in a Particle Filtering Framework , 2009 .

[15]  Jasim Ahmed,et al.  Algorithms for Advanced Battery-Management Systems , 2010, IEEE Control Systems.

[16]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[17]  Min Chen,et al.  Accurate electrical battery model capable of predicting runtime and I-V performance , 2006, IEEE Transactions on Energy Conversion.

[18]  Robert E. Schapire,et al.  Predicting Nearly as Well as the Best Pruning of a Decision Tree , 1995, COLT.

[19]  Xiaojin Zhu,et al.  Introduction to Semi-Supervised Learning , 2009, Synthesis Lectures on Artificial Intelligence and Machine Learning.

[20]  O. Kempthorne,et al.  Introduction to experimental design , 1994 .