Parameter Learning Algorithms for Continuous Model Improvement Using Operational Data

In this paper, we consider the application of object-oriented Bayesian networks to failure diagnostics in manufacturing systems and continuous model improvement based on operational data. The analysis is based on an object-oriented Bayesian network developed for failure diagnostics of a one-dimensional pick-and-place industrial robot developed by IEF-Werner GmbH. We consider four learning algorithms (batch Expectation-Maximization (EM), incremental EM, Online EM and fractional updating) for parameter updating in the object-oriented Bayesian network using a real operational dataset. Also, we evaluate the performance of the considered algorithms on a dataset generated from the model to determine which algorithm is best suited for recovering the underlying generating distribution. The object-oriented Bayesian network has been integrated into both the control software of the robot as well as into a software architecture that supports diagnostic and prognostic capabilities of devices in manufacturing systems. We evaluate the time performance of the architecture to determine the feasibility of on-line learning from operational data using each of the four algorithms.

[1]  Avi Pfeffer,et al.  Object-Oriented Bayesian Networks , 1997, UAI.

[2]  O. Cappé,et al.  On‐line expectation–maximization algorithm for latent data models , 2009 .

[3]  Uffe Kjærulff,et al.  Bayesian Networks and Influence Diagrams: A Guide to Construction and Analysis , 2007, Information Science and Statistics.

[4]  Steffen L. Lauritzen,et al.  aHUGIN: A System Creating Adaptive Causal Probabilistic Networks , 1992, UAI.

[5]  David J. Spiegelhalter,et al.  Probabilistic Networks and Expert Systems , 1999, Information Science and Statistics.

[6]  S. Lauritzen.  The EM algorithm for graphical association models with missing data , 1995 .

[7]  João Reis,et al.  Sensor cloud: SmartComponent framework for reconfigurable diagnostics in intelligent manufacturing environments , 2015, 2015 IEEE 13th International Conference on Industrial Informatics (INDIN).

[8]  Finn Verner Jensen,et al.  Gradient Descent Training of Bayesian Networks , 1999, ESCQARU.

[9]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[10]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[11]  Eric Moulines,et al.  On‐line expectation–maximization algorithm for latent data models , 2007, ArXiv.

[12]  Marek J. Druzdzel,et al.  Learning discrete Bayesian network parameters from continuous data streams: What is the best strategy? , 2015, J. Appl. Log..

[13]  Marek J. Druzdzel,et al.  Decomposing Local Probability Distributions in Bayesian Networks for Improved Inference and Parameter Learning , 2006, FLAIRS.

[14]  Anders L. Madsen,et al.  The Hugin Tool for Learning Bayesian Networks , 2003, ECSQARU.

[15]  D. M. Titterington,et al.  Updating a Diagnostic System using Unconfirmed Cases , 1976 .

[16]  Anders L. Madsen,et al.  A methodology for developing local smart diagnostic models using expert knowledge , 2015, 2015 IEEE 13th International Conference on Industrial Informatics (INDIN).

[17]  Anders L. Madsen,et al.  Applying Object-Oriented Bayesian Networks for Smart Diagnosis and Health Monitoring at both Component and Factory Level , 2017, IEA/AIE.

[18]  Stuart J. Russell,et al.  Local Learning in Probabilistic Networks with Hidden Variables , 1995, IJCAI.

[19]  Gil Gonçalves,et al.  Sensor SelComp, a smart component for the industrial sensor cloud of the future , 2017, 2017 IEEE International Conference on Industrial Technology (ICIT).

[20]  Anders L. Madsen,et al.  SelSus: Towards a reference architecture for diagnostics and predictive maintenance using smart manufacturing devices , 2015, 2015 IEEE 13th International Conference on Industrial Informatics (INDIN).

[21]  Stuart J. Russell,et al.  Adaptive Probabilistic Networks with Hidden Variables , 1997, Machine Learning.

[22]  Martin Neil,et al.  Building large-scale Bayesian networks , 2000, The Knowledge Engineering Review.