Distributed fault detection and isolation of large-scale nonlinear systems: an adaptive approximation approach

The present thesis work has been submitted to the Department of Electrical,Electronic and Computer Engineering of the University of Trieste, in partialfulfillment of the requirements for the degree of Doctor of Philosophy inInformation Engineering. The work has been supported by a grant financedby Danieli Automation S.p.A, whose subject was “Numerical Modeling inthe Steel–making Industry”.The thesis work deals with the problem of fault diagnosis for distributedsystems. Fault diagnosis is a key requirement in the design of modern and re-liable systems. While the fault diagnosis problem has been extensively stud-ied for centralized systems, and for some class of distributed systems suchas multi–processor systems, a lack of research is apparent when looking forresults about the fault diagnosis of distributed discrete and continuous–timesystems. The objective of the present work is to fill this gap, by applyinga divide et impera paradigm to actual fault diagnosis schemes in order tomake the problem of fault diagnosis for distributed systems tractable, andthe corresponding solutions robust and reliable themselves.I wish here to profoundly thank my advisor, prof. Thomas Parisini, thatsupported and guided me with painstaking patience and efforts since mymaster’s degree. He was a mentor, and a great friend during the last, in-tense years. He helped me avoid the pitfalls of research, and continuouslymotivated me in order to reach my objectives. Another expression of mygratitude is directed to my co–advisor, prof. Marios M. Polycarpou, whoseexperience and analytical skillfulness was invaluable during the developmentof all the theory providing the foundations for my work. His care and endur-ing support made my stay as a visiting student at the University of Cyprusa most profitable, and unforgettable experience.My deep thankfulness goes also to Danieli Automation S.p.A., that madethis research possible, and in particular to all the people of the R&D labora-tory with whom I worked side by side during these years, on many practicalproblems too. If I ever developed an experimental attitude, it is thank tothe countless hours I was allowed to spend in that laboratory, and thank tothe skilled advice I was always given.Iwant also to acknowledge the contribution of prof. Marcel Staroswiecky,with whom I had many fruitful discussions during a short stay at the Ecolevii

[1]  GERNOT METZE,et al.  On the Connection Assignment Problem of Diagnosable Systems , 1967, IEEE Trans. Electron. Comput..

[2]  J. Price GO TO THE ANT...... , 1969, British Journal of Psychiatry.

[3]  Richard Vernon Beard,et al.  Failure accomodation in linear systems through self-reorganization. , 1971 .

[4]  D. Siljak,et al.  On stability of discrete composite systems , 1973 .

[5]  Harold Lee Jones,et al.  Failure detection in linear systems , 1973 .

[6]  Kenneth P. Bogart,et al.  Introductory Combinatorics , 1977 .

[7]  R. Clark Instrument Fault Detection , 1978, IEEE Transactions on Aerospace and Electronic Systems.

[8]  Dragoslav D. Šiljak,et al.  Large-Scale Dynamic Systems: Stability and Structure , 1978 .

[9]  Michael Athans,et al.  Survey of decentralized control methods for large scale systems , 1978 .

[10]  R. N. Claek Instrument Fault Detection , 1978 .

[11]  Ikeda,et al.  Overlapping decompositions, expansions, and contractions of dynamic systems , 1979 .

[12]  M. Vidyasagar Decomposition techniques for large-scale systems with nonadditive interactions: Stability and stabilizability , 1980 .

[13]  Mohamed F. Hassan,et al.  New approach to failure detection in large-scale systems , 1983 .

[14]  A. Willsky,et al.  Analytical redundancy and the design of robust failure detection systems , 1984 .

[15]  Rolf Isermann,et al.  Process fault detection based on modeling and estimation methods - A survey , 1984, Autom..

[16]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[17]  D. Siljak,et al.  Decentralized estimation and control with overlapping information sets , 1986 .

[18]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[19]  C. R. Johnson,et al.  Lectures on adaptive parameter estimation , 1988 .

[20]  J.J. Gertler,et al.  Survey of model-based failure detection and isolation in complex plants , 1988, IEEE Control Systems Magazine.

[21]  M. M. Akhter,et al.  Effect of model uncertainty on failure detection: the threshold selector , 1988 .

[22]  Cecilia R. Aragon,et al.  Optimization by Simulated Annealing: An Experimental Evaluation; Part I, Graph Partitioning , 1989, Oper. Res..

[23]  Paul M. Frank,et al.  Fault diagnosis in dynamic systems: theory and application , 1989 .

[24]  Paul M. Frank,et al.  Fault diagnosis in dynamic systems using analytical and knowledge-based redundancy: A survey and some new results , 1990, Autom..

[25]  Janos J. Gertler,et al.  Analytical Redundancy Methods in Fault Detection and Isolation , 1991 .

[26]  Paul M. Frank,et al.  Robust Component Fault Detection and Isolation in Nonlinear Dynamic Systems using Nonlinear unknown Input Observers , 1991 .

[27]  Horst D. Simon,et al.  Partitioning of unstructured problems for parallel processing , 1991 .

[28]  Gary Chartrand,et al.  Applied and algorithmic graph theory , 1992 .

[29]  B.D. Appleby,et al.  Using learning techniques to accommodate unanticipated faults , 1993, IEEE Control Systems.

[30]  Michèle Basseville,et al.  Detection of abrupt changes: theory and application , 1993 .

[31]  Sudhakar M. Reddy,et al.  FAULT-DIAGNOSIS IN FULLY DISTRIBUTED SYSTEMS , 1995, Twenty-Fifth International Symposium on Fault-Tolerant Computing, 1995, ' Highlights from Twenty-Five Years'..

[32]  Marios M. Polycarpou,et al.  Automated fault detection and accommodation: a learning systems approach , 1995, IEEE Trans. Syst. Man Cybern..

[33]  Vicsek,et al.  Novel type of phase transition in a system of self-driven particles. , 1995, Physical review letters.

[34]  Barry F. Smith,et al.  Domain Decomposition: Parallel Multilevel Methods for Elliptic Partial Differential Equations , 1996 .

[35]  Hong Wang,et al.  Actuator fault diagnosis: an adaptive observer-based technique , 1996, IEEE Trans. Autom. Control..

[36]  Sam Toueg,et al.  Unreliable failure detectors for reliable distributed systems , 1996, JACM.

[37]  Y. Saad,et al.  Overlapping Domain Decomposition Algorithms for General Sparse Matrices , 1996, Numer. Linear Algebra Appl..

[38]  Marios M. Polycarpou,et al.  On-line Approximation Methods for Robust Fault Detection , 1996 .

[39]  Yousef Saad,et al.  Overlapping Domain Decomposition Algorithms for General Sparse Matrices , 1996, Numer. Linear Algebra Appl..

[40]  Perry Y. Li,et al.  AHS safe control laws for platoon leaders , 1997, IEEE Trans. Control. Syst. Technol..

[41]  Robust Nonlinear Fault Diagnosis in Input-Output Systems , 1997 .

[42]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[43]  Hong Wang,et al.  On the use of adaptive updating rules for actuator and sensor fault diagnosis , 1997, Autom..

[44]  Marios M. Polycarpou,et al.  Neural-network-based robust fault diagnosis in robotic systems , 1997, IEEE Trans. Neural Networks.

[45]  Mohammad Aldeen,et al.  Stabilization of decentralized control systems , 1997 .

[46]  H. Van Dyke Parunak,et al.  "Go to the ant": Engineering principles from natural multi-agent systems , 1997, Ann. Oper. Res..

[47]  Frank L. Lewis,et al.  Neural Network Control Of Robot Manipulators And Non-Linear Systems , 1998 .

[48]  Jason L. Speyer,et al.  A decentralized fault detection filter , 1998, Proceedings of the 1998 American Control Conference. ACC (IEEE Cat. No.98CH36207).

[49]  Marios M. Polycarpou On-line approximators for nonlinear system identification: A unified approach , 1998 .

[50]  Vipin Kumar,et al.  A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs , 1998, SIAM J. Sci. Comput..

[51]  Janos Gertler,et al.  Fault detection and diagnosis in engineering systems , 1998 .

[52]  Jie Chen,et al.  Robust Model-Based Fault Diagnosis for Dynamic Systems , 1998, The International Series on Asian Studies in Computer and Information Science.

[53]  Michel Kinnaert,et al.  Robust fault detection based on observers for bilinear systems , 1999, Autom..

[54]  Gianfranco Lamperti,et al.  Diagnosis of Large Active Systems , 1999, Artif. Intell..

[55]  A. Isidori,et al.  On the problem of residual generation for fault detection in nonlinear systems and some related facts , 1999, 1999 European Control Conference (ECC).

[56]  Andrew G. Sparks,et al.  Spacecraft formation flying: dynamics and control , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[57]  Pieter J. Mosterman,et al.  Diagnosis of continuous valued systems in transient operating regions , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[58]  Marios M. Polycarpou,et al.  Learning approach to nonlinear fault diagnosis: detectability analysis , 2000, IEEE Trans. Autom. Control..

[59]  Srdjan S. Stankovic,et al.  Decentralized overlapping control of a platoon of vehicles , 2000, IEEE Trans. Control. Syst. Technol..

[60]  Xiaoming Hu,et al.  Formation constrained multi-agent control , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[61]  Marios M. Polycarpou,et al.  Robust fault isolation for a class of non-linear input?output systems , 2001 .

[62]  Alberto Isidori,et al.  A geometric approach to nonlinear fault detection and isolation , 2000, IEEE Trans. Autom. Control..

[63]  R.J. Povinelli,et al.  Diagnostics of eccentricities and bar/end-ring connector breakages in polyphase induction motors through a combination of time-series data mining and time-stepping coupled FE-state space techniques , 2001, Conference Record of the 2001 IEEE Industry Applications Conference. 36th IAS Annual Meeting (Cat. No.01CH37248).

[64]  C. Sabol,et al.  Satellite Formation Flying Design and Evolution , 2001 .

[65]  Marios M. Polycarpou Fault accommodation of a class of multivariable nonlinear dynamical systems using a learning approach , 2001, IEEE Trans. Autom. Control..

[66]  Tamas Vicsek,et al.  A question of scale , 2001, Nature.

[67]  Thomas Parisini,et al.  Distributed-information neural control: the case of dynamic routing in traffic networks , 2001, IEEE Trans. Neural Networks.

[68]  Marios M. Polycarpou,et al.  A robust detection and isolation scheme for abrupt and incipient faults in nonlinear systems , 2002, IEEE Trans. Autom. Control..

[69]  Tamas Vicsek Complexity: The bigger picture , 2002, Nature.

[70]  Marios M. Polycarpou,et al.  Feedback control of water quality , 2002 .

[71]  Christoforos N. Hadjicostis,et al.  Non-concurrent fault identification in discrete event systems using encoded Petri net states , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[72]  Daniel W. Palmer,et al.  Fuel optimal manoeuvres for multiple spacecraft formation reconfiguration using multi-agent optimization , 2002 .

[73]  Feng Zhao,et al.  Distributed Diagnosis of Networked, Embedded Systems , 2002 .

[74]  Ian F. Akyildiz,et al.  Sensor Networks , 2002, Encyclopedia of GIS.

[75]  Mexican Waves in an Excitable Medium , 2002 .

[76]  Fernando Paganini,et al.  Distributed control of spatially invariant systems , 2002, IEEE Trans. Autom. Control..

[77]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part I: Quantitative model-based methods , 2003, Comput. Chem. Eng..

[78]  Yi Lu Murphey,et al.  Automotive fault diagnosis - part II: a distributed agent diagnostic system , 2003, IEEE Trans. Veh. Technol..

[79]  Rodney Teo Computing danger zones for provably safe closely spaced parallel approaches: Theory and experiment , 2003 .

[80]  Geir E. Dullerud,et al.  Distributed control design for spatially interconnected systems , 2003, IEEE Trans. Autom. Control..

[81]  J.M. Fowler,et al.  A formation flight experiment , 2003, IEEE Control Systems.

[82]  Bruno Sinopoli,et al.  Distributed control applications within sensor networks , 2003, Proc. IEEE.

[83]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part II: Qualitative models and search strategies , 2003, Comput. Chem. Eng..

[84]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part III: Process history based methods , 2003, Comput. Chem. Eng..

[85]  R. Murray,et al.  Consensus protocols for networks of dynamic agents , 2003, Proceedings of the 2003 American Control Conference, 2003..

[86]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[87]  Marios M. Polycarpou,et al.  Adaptive fault-tolerant control of nonlinear uncertain systems: an information-based diagnostic approach , 2004, IEEE Transactions on Automatic Control.

[88]  Vijay Kumar,et al.  Robot and sensor networks for first responders , 2004, IEEE Pervasive Computing.

[89]  Cédric Langbort,et al.  Distributed control design for systems interconnected over an arbitrary graph , 2004, IEEE Transactions on Automatic Control.

[90]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[91]  Kevin M. Passino,et al.  Stable social foraging swarms in a noisy environment , 2004, IEEE Transactions on Automatic Control.

[92]  T. Parisini,et al.  Cooperative control of discrete-time agents with delayed information exchange: A receding-horizon approach , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[93]  Diomidis Spinellis,et al.  A survey of peer-to-peer content distribution technologies , 2004, CSUR.

[94]  M. V. Iordache,et al.  Diagnosis and Fault-Tolerant Control , 2007, IEEE Transactions on Automatic Control.

[95]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[96]  Stephen P. Boyd,et al.  Fastest Mixing Markov Chain on a Graph , 2004, SIAM Rev..

[97]  R.M. Murray,et al.  Receding horizon control of multi-vehicle formations: a distributed implementation , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[98]  G. Leugering,et al.  Domain Decomposition Methods in Optimal Control of Partial Differential Equations , 2004 .

[99]  Rodney Teo,et al.  Decentralized overlapping control of a formation of unmanned aerial vehicles , 2004, Autom..

[100]  Gautam Biswas,et al.  Designing Distributed Diagnosers for Complex Physical Systems , 2005 .

[101]  Eleftheria Athanasopoulou,et al.  Probabilistic approaches to fault detection in networked discrete event systems , 2005, IEEE Transactions on Neural Networks.

[102]  E.M. Atkins,et al.  A survey of consensus problems in multi-agent coordination , 2005, Proceedings of the 2005, American Control Conference, 2005..

[103]  R. Olfati-Saber,et al.  Consensus Filters for Sensor Networks and Distributed Sensor Fusion , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[104]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[105]  R. Harley,et al.  Fault signature modeling and detection of inner race bearing faults , 2006, IEEE International Conference on Electric Machines and Drives, 2005..

[106]  S. Roy,et al.  A control-theoretic perspective on the design of distributed agreement protocols , 2005, Proceedings of the 2005, American Control Conference, 2005..

[107]  T. Vicsek,et al.  Uncovering the overlapping community structure of complex networks in nature and society , 2005, Nature.

[108]  Sheng Ma,et al.  Adaptive diagnosis in distributed systems , 2005, IEEE Transactions on Neural Networks.

[109]  Stephen P. Boyd,et al.  Gossip algorithms: design, analysis and applications , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[110]  Mac Schwager,et al.  Distributed Coverage Control with Sensory Feedback for Networked Robots , 2006, Robotics: Science and Systems.

[111]  K.H. Johansson,et al.  Distributed and Collaborative Estimation over Wireless Sensor Networks , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[112]  Tung Le,et al.  Graphical Inference Methods for Fault Diagnosis based on Information from Unreliable Sensors , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[113]  R.M.G. Ferrari,et al.  A fault detection scheme for distributed nonlinear uncertain systems , 2006, 2006 IEEE Conference on Computer Aided Control System Design, 2006 IEEE International Conference on Control Applications, 2006 IEEE International Symposium on Intelligent Control.

[114]  Jean-Jacques E. Slotine,et al.  A theoretical study of different leader roles in networks , 2006, IEEE Transactions on Automatic Control.

[115]  J. Shamma,et al.  Belief consensus and distributed hypothesis testing in sensor networks , 2006 .

[116]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.

[117]  R. Olfati-Saber,et al.  Distributed Fault Diagnosis using Sensor Networks and Consensus-based Filters , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[118]  Tamer Basar,et al.  Optimal control of LTI systems over unreliable communication links , 2006, Autom..

[119]  Raffaello D'Andrea,et al.  A decomposition approach to multi-vehicle cooperative control , 2005, Robotics Auton. Syst..

[120]  N. Lechevin,et al.  Towards Decentralized Fault Detection in UAV Formations , 2007, 2007 American Control Conference.

[121]  Gautam Biswas,et al.  Distributed Diagnosis in Formations of Mobile Robots , 2007, IEEE Transactions on Robotics.

[122]  Riccardo M. G. Ferrari,et al.  Distributed fault diagnosis with overlapping decompositions and consensus filters , 2007, 2007 American Control Conference.

[123]  R.M. Murray,et al.  Asynchronous Distributed Averaging on Communication Networks , 2007, IEEE/ACM Transactions on Networking.

[124]  Stephen P. Boyd,et al.  Distributed average consensus with least-mean-square deviation , 2007, J. Parallel Distributed Comput..

[125]  Marios M. Polycarpou,et al.  A fault detection and isolation scheme for nonlinear uncertain discrete-time sytems , 2007, 2007 46th IEEE Conference on Decision and Control.

[126]  C. Edwards,et al.  Fault Reconstruction in a Leader/Follower Spacecraft System Using Higher Order Sliding Mode Observers , 2007, 2007 American Control Conference.

[127]  Yuan Yan Tang,et al.  Efficient Fault Identification of Diagnosable Systems under the Comparison Model , 2007, IEEE Transactions on Computers.

[128]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[129]  Antonio Bicchi,et al.  Decentralized intrusion detection for secure cooperative multi-agent systems , 2007, 2007 46th IEEE Conference on Decision and Control.

[130]  Panos J. Antsaklis,et al.  Control and Communication Challenges in Networked Real-Time Systems , 2007, Proceedings of the IEEE.

[131]  Bruno Sinopoli,et al.  Foundations of Control and Estimation Over Lossy Networks , 2007, Proceedings of the IEEE.

[132]  A. Barabasi,et al.  Quantifying social group evolution , 2007, Nature.

[133]  R. Devlin A bigger picture , 2008, Nature.

[134]  R.M.G. Ferrari,et al.  A robust fault detection and isolation scheme for a class of uncertain input-output discrete-time nonlinear systems , 2008, 2008 American Control Conference.

[135]  Antonio Bicchi,et al.  Logical consensus for distributed network agreement , 2008, 2008 47th IEEE Conference on Decision and Control.

[136]  Marios M. Polycarpou,et al.  Cooperative Constrained Control of Distributed Agents With Nonlinear Dynamics and Delayed Information Exchange: A Stabilizing Receding-Horizon Approach , 2008, IEEE Transactions on Automatic Control.

[137]  Milos S. Stankovic,et al.  Consensus based multi-agent control structures , 2008, 2008 47th IEEE Conference on Decision and Control.

[138]  Wassim M. Haddad,et al.  Distributed nonlinear control algorithms for network consensus , 2008, Autom..

[139]  Derong Liu,et al.  Adaptive approximation based control: Unifying neural, fuzzy and traditional adaptive approximation approaches. Jay A. Farrell and Marios M. Polycarpou, Wiley, New York, 2006. No of pages: 440. ISBN 978-0-471-72788-0 , 2008 .

[140]  Long Wang,et al.  Consensus protocols for discrete-time multi-agent systems with time-varying delays , 2008, Autom..

[141]  C. Hadjicostis,et al.  Distributed Non-Concurrent Fault Identification in Discrete Event Systems , 2008 .

[142]  Marios M. Polycarpou,et al.  Distributed Fault Diagnosis With Overlapping Decompositions: An Adaptive Approximation Approach , 2009, IEEE Transactions on Automatic Control.

[143]  Milos S. Stankovic,et al.  Consensus Based Overlapping Decentralized Estimator , 2009, IEEE Transactions on Automatic Control.