Multi-agent based control of large-scale complex systems employing distributed dynamic inference engine

Increasing societal demand for automation has led to considerable efforts to control large-scale complex systems, especially in the area of autonomous intelligent control methods. The control system of a large-scale complex system needs to satisfy four system level requirements: robustness, flexibility, reusability, and scalability. Corresponding to the four system level requirements, there arise four major challenges. First, it is difficult to get accurate and complete information. Second, the system may be physically highly distributed. Third, the system evolves very quickly. Fourth, emergent global behaviors of the system can be caused by small disturbances at the component level. The Multi-Agent Based Control (MABC) method as an implementation of distributed intelligent control has been the focus of research since the 1970s, in an effort to solve the above-mentioned problems in controlling large-scale complex systems. However, to the author’s best knowledge, all MABC systems for large-scale complex systems with significant uncertainties are problem-specific and thus difficult to extend to other domains or larger systems. This situation is partly due to the control architecture of multiple agents being determined by agent to agent coupling and interaction mechanisms. Therefore, the research objective of this dissertation is to develop a comprehensive, generalized framework for the control system design of general large-scale complex systems with significant uncertainties, with the focus on distributed control architecture design and distributed inference engine design. A Hybrid Multi-Agent Based Control (HyMABC) architecture is proposed by combining hierarchical control architecture and module control architecture with logical replication rings. First, it decomposes a complex system hierarchically; second, it combines the components in the same level as a module, and then designs common interfaces for all of the components in the same module; third, replications are made for critical agents and are organized into logical rings. This architecture maintains clear guidelines for complexity decomposition and also increases the robustness of the whole system. Multiple Sectioned Dynamic Bayesian Networks (MSDBNs) as a distributed dynamic probabilistic inference engine, can be embedded into the control architecture to handle uncertainties of general large-scale complex systems. MSDBNs decomposes a large knowledge-based system into many agents. Each agent holds its partial perspective of a large problem domain by representing its knowledge as a Dynamic Bayesian Network (DBN). Each agent accesses local evidence from its corresponding local sensors and communicates with other agents through finite message passing. If the distributed agents can be organized into a tree structure, satisfying the running intersection property and d-sep set requirements, globally consistent inferences are achievable in a distributed way. By using different frequencies for local DBN agent belief updating and global system belief updating, it balances the communication cost with the global consistency of inferences. In this dissertation, a fully factorized Boyen-Koller (BK) approximation algorithm is used for local DBN agent belief updating, and the static Junction Forest Linkage Tree (JFLT) algorithm is used for global system belief updating. MSDBNs assume a static structure and a stable communication network for the whole system. However, for a real system, sub-Bayesian networks as nodes could be lost, and the communication network could be shut down due to partial damage in the system. Therefore, on-line and automatic MSDBNs structure formation is necessary for making robust state estimations and increasing survivability of the whole system. A Distributed Spanning Tree Optimization (DSTO) algorithm, a Distributed D-Sep Set Satisfaction (DDSSS) algorithm, and a Distributed Running Intersection Satisfaction (DRIS) algorithm are proposed in this dissertation. Combining these three distributed algorithms and a Distributed Belief Propagation (DBP) algorithm in MSDBNs makes state estimations robust to partial damage in the whole system. Combining the distributed control architecture design and the distributed inference engine design leads to a process of control system design for a general large-scale complex system. As applications of the proposed methodology, the control system design of a simplified ship chilled water system and a notional ship chilled water system have been demonstrated step by step. Simulation results not only show that the proposed methodology gives a clear guideline for control system design for general large-scale complex systems with dynamic and uncertain environment, but also indicate that the combination of MSDBNs and HyMABC can provide excellent performance for controlling general large-scale complex systems.

[1]  Stuart J. Russell,et al.  Exploiting locality in probabilistic inference , 2004 .

[2]  Reza Olfati-Saber,et al.  Distributed Kalman filtering and sensor fusion in sensor networks , 2006 .

[3]  Ian F. Akyildiz,et al.  Wireless sensor networks , 2007 .

[4]  X. Chen,et al.  Cooperative Verification of Agent Interface , 2002, Probabilistic Graphical Models.

[5]  Petros G. Voulgaris,et al.  On optimal ℓ∞ to ℓ∞ filtering , 1995, Autom..

[6]  P. J. Lawrence,et al.  Navigation sensor, filter, and failure mode simulation results using the distributed Kalman filter simulator (DKFSIM) , 1996, Proceedings of Position, Location and Navigation Symposium - PLANS '96.

[7]  M. R. Katebi,et al.  Predictive control design for large-scale systems , 1997, Autom..

[8]  Michael Luck,et al.  Agent autonomy through the 3 M motivational taxonomy , 2003 .

[9]  大西 仁,et al.  Pearl, J. (1988, second printing 1991). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan-Kaufmann. , 1994 .

[10]  P. Caines,et al.  On the supervisory control of multi-agent product systems , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[11]  Charles L. Forgy,et al.  Rete: a fast algorithm for the many pattern/many object pattern match problem , 1991 .

[12]  Richard R. Brooks,et al.  Distributed Sensor Networks: A Multiagent Perspective , 2008 .

[13]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[14]  Geoffrey Zweig,et al.  Speech Recognition with Dynamic Bayesian Networks , 1998, AAAI/IAAI.

[15]  Jesper Tegnér,et al.  Learning dynamic Bayesian network models via cross-validation , 2005, Pattern Recognit. Lett..

[16]  Marinus Maris,et al.  Distributed Perception Networks: An Architecture for Information Fusion Systems Based on Causal Probabilistic Models , 2006, 2006 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[17]  Karl G. Kempf,et al.  A MODEL PREDICTIVE CONTROL FRAMEWORK FOR ROBUST MANAGEMENT OF MULTI-PRODUCT, MULTI-ECHELON DEMAND NETWORKS , 2002 .

[18]  Ruggero Carli,et al.  Distributed Kalman filtering using consensus strategies , 2007, 2007 46th IEEE Conference on Decision and Control.

[19]  Amir Fijany,et al.  A New Method for Sensor Placement Optimization , 2005 .

[20]  N. Motee,et al.  Optimal partitioning in distributed model predictive control , 2003, Proceedings of the 2003 American Control Conference, 2003..

[21]  Yang Xiang,et al.  Agent interface enhancement: making multiagent graphical models accessible , 2006, AAMAS '06.

[22]  H. Van Dyke Parunak,et al.  A Practitioners' Review of Industrial Agent Applications , 2000, Autonomous Agents and Multi-Agent Systems.

[23]  Fernando Maciel Barbosa,et al.  Distributed processing in power system state estimation , 2000, 2000 10th Mediterranean Electrotechnical Conference. Information Technology and Electrotechnology for the Mediterranean Countries. Proceedings. MeleCon 2000 (Cat. No.00CH37099).

[24]  Vladimír Marík,et al.  Simulation in agent-based manufacturing control systems , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[25]  R. Olfati-Saber,et al.  Consensus Filters for Sensor Networks and Distributed Sensor Fusion , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[26]  Agostino Poggi,et al.  Developing Multi-agent Systems with JADE , 2007, ATAL.

[27]  Fred P. Brooks,et al.  The Mythical Man-Month , 1975, Reliable Software.

[28]  Eugene Charniak,et al.  Bayesian Networks without Tears , 1991, AI Mag..

[29]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[30]  Yang Xiang,et al.  Semantics of Multiply Sectioned Bayesian Networks for Cooperative Multi-agent Distributed Interpretation , 1993 .

[31]  Shay Kutten,et al.  A sub-linear time distributed algorithm for minimum-weight spanning trees , 1993, Proceedings of 1993 IEEE 34th Annual Foundations of Computer Science.

[32]  Victor R. Lesser,et al.  Functionally Accurate, Cooperative Distributed Systems , 1988, IEEE Transactions on Systems, Man, and Cybernetics.

[33]  Chen-Ching Liu,et al.  Intelligent systems for strategic power infrastructure defense , 2002 .

[34]  Leonidas J. Guibas,et al.  Collaborative signal and information processing: an information-directed approach , 2003 .

[35]  William A. Maul,et al.  Qualitative model-based diagnostics for rocket systems , 1993 .

[36]  Anand S. Rao,et al.  BDI Agents: From Theory to Practice , 1995, ICMAS.

[37]  Richard T Lacoss Distributed Sensor Networks , 1978 .

[38]  Jung-Ho Lewe,et al.  An Integrated Decision-Making Framework for Transportation Architectures:Application to Aviation Systems Design , 2005 .

[39]  Michael Wooldridge,et al.  Towards a Logic of Rational Agency , 2003, Log. J. IGPL.

[40]  Sebastian Thrun,et al.  Decentralized Sensor Fusion with Distributed Particle Filters , 2002, UAI.

[41]  Michael Luby,et al.  Approximating Probabilistic Inference in Bayesian Belief Networks is NP-Hard , 1993, Artif. Intell..

[42]  Gregory F. Cooper,et al.  The Computational Complexity of Probabilistic Inference Using Bayesian Belief Networks , 1990, Artif. Intell..

[43]  Q. H. Wu,et al.  IP Network-based Multi-agent Systems for Industrial Automation: Information Management, Condition Monitoring and Control of Power Systems , 2006 .

[44]  Yang Xiang Distributed Multi-Agent Probabilistic Reasoning With Bayesian Networks , 1994, ISMIS.

[45]  FIPA Abstract Architecture Specification , 2002 .

[46]  S. Sitharama Iyengar,et al.  Distributed Sensor Networks , 2004 .

[47]  Klaus Fischer,et al.  A Taxonomy of Autonomy in Multiagent Organisation , 2003, Agents and Computational Autonomy.

[48]  P. Sebastiani,et al.  A Bayesian dynamic model for influenza surveillance , 2006, Statistics in medicine.

[49]  Paul J. M. Havinga,et al.  D-FLER - A Distributed Fuzzy Logic Engine for Rule-Based Wireless Sensor Networks , 2007, UCS.

[50]  Richard M. Murray,et al.  DYNAMIC CONSENSUS FOR MOBILE NETWORKS , 2005 .

[51]  Mark W. Schmidt,et al.  Modeling Discrete Interventional Data using Directed Cyclic Graphical Models , 2009, UAI.

[52]  R. Olfati-Saber,et al.  Distributed Kalman Filter with Embedded Consensus Filters , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[53]  R. Bucy,et al.  Digital synthesis of non-linear filters , 1971 .

[54]  Anna Scaglione,et al.  Scalable distributed Kalman filtering through consensus , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[55]  P. Pandurang Nayak,et al.  A Model-Based Approach to Reactive Self-Configuring Systems , 1996, AAAI/IAAI, Vol. 2.

[56]  T. Dean,et al.  Model-based Monitoring, Diagnosis and Control , 2003 .

[57]  Dongbing Gu,et al.  Consensus based distributed particle filter in sensor networks , 2008, 2008 International Conference on Information and Automation.

[58]  Pierre A. Humblet,et al.  A Distributed Algorithm for Minimum-Weight Spanning Trees , 1983, TOPL.

[59]  Fakhri Karray,et al.  A framework for coordinated control of multi-agent systems , 2004 .

[60]  N. L. Griffin,et al.  A rule-based inference engine which is optimal and VLSI implementable , 1989, [Proceedings 1989] IEEE International Workshop on Tools for Artificial Intelligence.

[61]  Grady Booch,et al.  Object-Oriented Analysis and Design with Applications , 1990 .

[62]  Kristian G. Olesen,et al.  Practical Issues in Modeling Large Diagnostic Systems with Multiply Sectioned Bayesian Networks , 2000, Int. J. Pattern Recognit. Artif. Intell..

[63]  Jean Bézivin,et al.  Model Engineering for Complex Systems , 2008 .

[64]  Chia-Hui Huang,et al.  Supply chain diagnostics with dynamic Bayesian networks , 2005, Comput. Ind. Eng..

[65]  Daniel Tylavsky,et al.  Parallel processing in power systems computation , 1992 .

[66]  Frederic D. McKenzie,et al.  An integrated model-based approach for real-time on-line diagnosis of complex systems , 1998 .

[67]  Finn V. Jensen,et al.  Bayesian Networks and Decision Graphs , 2001, Statistics for Engineering and Information Science.

[68]  Karl G. Kempf,et al.  A Model Predictive Control framework for robust management of multi-product, multi-echelon demand networks , 2003, Annu. Rev. Control..

[69]  Yang Xiang,et al.  Belief updating in multiply sectioned Bayesian networks without repeated local propagations , 2000, Int. J. Approx. Reason..

[70]  Ilya Shmulevich,et al.  Learning the structure of dynamic Bayesian networks from time series and steady state measurements , 2008, Machine Learning.

[71]  Dimitri N. Mavris,et al.  A Dynamic Surrogate Model Technique for Power Systems Modeling and Simulation , 2008 .

[72]  Yang Xiang Cooperative triangulation in MSBNs without revealing subnet structures , 2001, Networks.

[73]  Eugene P. Sabini,et al.  Development Of A Smart Pumping System , 2001 .

[74]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[75]  Meritxell Vinyals,et al.  A Survey on Sensor Networks from a Multiagent Perspective , 2011, Comput. J..

[76]  George,et al.  An Intelligent Approach to Coordinated Control of Multiple Unmanned Aerial Vehicles , 2004 .

[77]  M. Calisti,et al.  FOUNDATION FOR INTELLIGENT PHYSICAL AGENTS , 2000 .

[78]  Carlos Guestrin,et al.  Robust Probabilistic Inference in Distributed Systems , 2004, UAI.

[79]  Petar M. Djuric,et al.  Resampling algorithms and architectures for distributed particle filters , 2005, IEEE Transactions on Signal Processing.

[80]  Anand S. Rao,et al.  An architecture for real-time reasoning and system control , 1992, IEEE Expert.

[81]  David Heckerman,et al.  A Tutorial on Learning with Bayesian Networks , 1998, Learning in Graphical Models.

[82]  David Naso,et al.  A coordination strategy for distributed multi-agent manufacturing systems , 2004 .

[83]  Baruch Awerbuch,et al.  Optimal distributed algorithms for minimum weight spanning tree, counting, leader election, and related problems , 1987, STOC.

[84]  David Poole,et al.  MULTIPLY SECTIONED BAYESIAN NETWORKS AND JUNCTION FORESTS FOR LARGE KNOWLEDGE‐BASED SYSTEMS , 1993, Comput. Intell..

[85]  Qi Cheng,et al.  Joint State Monitoring and Fault Detection using Distributed Particle Filtering , 2007, 2007 Conference Record of the Forty-First Asilomar Conference on Signals, Systems and Computers.

[86]  Sushil Jajodia,et al.  Measuring network security using dynamic bayesian network , 2008, QoP '08.

[87]  Nicolas Lhuillier,et al.  FOUNDATION FOR INTELLIGENT PHYSICAL AGENTS , 2003 .

[88]  Bart De Schutter,et al.  Multi-Agent Model Predictive Control: A Survey , 2004, ArXiv.

[89]  David H. Scheidt Intelligent agent-based control , 2002 .

[90]  D.H. Scheidt,et al.  Model-Based Agents , 2007, 2007 IEEE Power Engineering Society General Meeting.

[91]  Fabio Bellifemine,et al.  Developing Multi-Agent Systems with JADE (Wiley Series in Agent Technology) , 2007 .

[92]  Rahul Sukthankar,et al.  Distributed Inference in Dynamical Systems , 2006, NIPS.

[93]  Victor R. Lesser,et al.  On the role of multiply sectioned Bayesian networks to cooperative multiagent systems , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[94]  Nicholas R. Jennings,et al.  Agent-based control systems: Why are they suited to engineering complex systems? , 2003 .

[95]  Jose Antonio Beleza Carvalho,et al.  Parallel and distributed processing in state estimation of power system energy , 1998, MELECON '98. 9th Mediterranean Electrotechnical Conference. Proceedings (Cat. No.98CH36056).

[96]  Pierre Brémaud,et al.  MATHEMATICAL PRINCIPLES OF SIGNAL PROCESSING: FOURIER AND WAVELET ANALYSIS , 2012 .

[97]  Avi Pfeffer,et al.  Asynchronous Dynamic Bayesian Networks , 2005, UAI.

[98]  G. Bornard,et al.  Optimal control of complex irrigation systems via decomposition-coordination and the use of augmented Lagrangian , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[99]  Yang Xiang Cooperative triangulation in MSBNs without revealing subnet structures , 2001 .

[100]  Davide Brunelli,et al.  Wireless Sensor Networks , 2012, Lecture Notes in Computer Science.

[101]  D. Georges Decentralized adaptive control for a water distribution system , 1994, 1994 Proceedings of IEEE International Conference on Control and Applications.

[102]  Paul J. Lawrence Comparison of a Distributed Kalman Filter Versus a Centralized Kalman Filter with Fault Detection Considerations , 1993 .

[103]  Kingsley Fregene,et al.  HICA: A Framework for Distributed Multiagent Control , 2001 .

[104]  Mark Coates,et al.  Distributed particle filters for sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[105]  Ben Taskar,et al.  Introduction to statistical relational learning , 2007 .