Bayesian time-series models for continuous fault detection and recognition in industrial robotic tasks

This paper presents the application of a Bayesian nonparametric time-series model to process monitoring and fault classification for industrial robotic tasks. By means of an alignment task performed with a real robot, we show how the proposed approach allows to learn a set of sensor signature models encoding the spatial and temporal correlations among wrench measurements recorded during a number of successful task executions. Using these models, it is possible to detect continuously and on-line deviations from the expected sensor readings. Separate models are learned for a set of possible error scenarios involving a human modifying the workspace configuration. These non-nominal task executions are correctly detected and classified with an on-line algorithm, which opens the possibility for the development of error-specific recovery strategies. Our work is complementary to previous approaches in robotics, where process monitors based on probabilistic models, but limited to contact events, were developed for control purposes. Instead, in this paper we focus on capturing dynamic models of sensor signatures throughout the whole task, therefore allowing continuous monitoring and extending the system ability to interpret and react to errors.

[1]  Anders Robertsson,et al.  Force controlled robotic assembly without a force sensor , 2012, 2012 IEEE International Conference on Robotics and Automation.

[2]  Sylvain Calino,et al.  Robot programming by demonstration : a probabilistic approach , 2009 .

[3]  Herman Bruyninckx,et al.  Hierarchical Dirichlet Process Hidden Markov Models for abnormality detection in robotic assembly , 2012 .

[4]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[5]  Dana Kulic,et al.  Incremental Learning, Clustering and Hierarchy Formation of Whole Body Motion Patterns using Adaptive Hidden Markov Chains , 2008, Int. J. Robotics Res..

[6]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[7]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[8]  W. Marsden I and J , 2012 .

[9]  Eiichi Yoshida,et al.  A relative-change-based hierarchical taxonomy for cantilever-snap assembly verification , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Michael I. Jordan,et al.  Hierarchical Dirichlet Processes , 2006 .

[11]  G. Schreiber,et al.  The Fast Research Interface for the KUKA Lightweight Robot , 2022 .

[12]  Michael I. Jordan,et al.  Bayesian Nonparametric Methods for Learning Markov Switching Processes , 2010, IEEE Signal Processing Magazine.

[13]  Emily B. Fox,et al.  Bayesian nonparametric learning of complex dynamical phenomena , 2009 .

[14]  Michael I. Jordan,et al.  An HDP-HMM for systems with state persistence , 2008, ICML '08.

[15]  Geir Hovland,et al.  Hidden Markov Models as a Process Monitor in Robotic Assembly , 1998, Int. J. Robotics Res..

[16]  Alberto Rodriguez,et al.  Failure detection in assembly: Force signature analysis , 2010, 2010 IEEE International Conference on Automation Science and Engineering.

[17]  Sylvain Calinon,et al.  Robot Programming by Demonstration - a Probabilistic Approach , 2009 .

[18]  Siddhartha S. Srinivasa,et al.  Abort and retry in grasping , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.