An Adaptive Fusion Strategy for Distributed Information Estimation Over Cooperative Multi-Agent Networks

In this paper, we study the problem of distributed information estimation that is closely relevant to some network-based applications, such as distributed surveillance, cooperative localization, and optimization. We consider a problem where an application area containing multiple information sources of interest is divided into a series of subregions in which only one information source exists. The information is presented as a signal variable, which has finite states associated with certain probabilities. The probability distribution of information states of all the subregions constitutes a global information picture for the whole area. Agents with limited measurement and communication ranges are assumed to monitor the area, and cooperatively create a local estimate of the global information. To efficiently approximate the actual global information using individual agents’ own estimates, we propose an adaptive distributed information fusion strategy and use it to enhance the local Bayesian rule-based updating procedure. Specifically, this adaptive fusion strategy is induced by iteratively minimizing a Jensen–Shannon divergence-based objective function. A constrained optimization model is also presented to derive minimum Jensen–Shannon divergence weights at each agent for fusing local neighbors’ individual estimates. Theoretical analysis and numerical results are supplemented to show the convergence performance and effectiveness of the proposed solution.

[1]  J. B. Rosen The Gradient Projection Method for Nonlinear Programming. Part I. Linear Constraints , 1960 .

[2]  W. Rudin Principles of mathematical analysis , 1964 .

[3]  J. E. Falk Lagrange multipliers and nonlinear programming , 1967 .

[4]  M. Powell A method for nonlinear constraints in minimization problems , 1969 .

[5]  M. Hestenes Multiplier and gradient methods , 1969 .

[6]  M. J. D. Powell,et al.  On search directions for minimization algorithms , 1973, Math. Program..

[7]  何光宗 ROSEN’S GRADIENT PROJECTION WITH DISCRETE STEPS , 1990 .

[8]  R. Durrett Probability: Theory and Examples , 1993 .

[9]  Jianhua Lin,et al.  Divergence measures based on the Shannon entropy , 1991, IEEE Trans. Inf. Theory.

[10]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[11]  Dimitri P. Bertsekas,et al.  A New Class of Incremental Gradient Methods for Least Squares Problems , 1997, SIAM J. Optim..

[12]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[13]  Sonia Martínez,et al.  Coverage control for mobile sensing networks , 2002, IEEE Transactions on Robotics and Automation.

[14]  Robert D. Nowak,et al.  Quantized incremental algorithms for distributed optimization , 2005, IEEE Journal on Selected Areas in Communications.

[15]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[16]  J.P. How,et al.  UAV Search for Dynamic Targets with Uncertain Motion Models , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[17]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[18]  Ali H. Sayed,et al.  Incremental Adaptive Strategies Over Distributed Networks , 2007, IEEE Transactions on Signal Processing.

[19]  S. Shankar Sastry,et al.  Tracking and Coordination of Multiple Agents Using Sensor Networks: System Design, Algorithms and Experiments , 2007, Proceedings of the IEEE.

[20]  Ali H. Sayed,et al.  Diffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis , 2008, IEEE Transactions on Signal Processing.

[21]  Ioannis D. Schizas,et al.  Distributed LMS for Consensus-Based In-Network Adaptive Processing , 2009, IEEE Transactions on Signal Processing.

[22]  Ali H. Sayed,et al.  Diffusion LMS Strategies for Distributed Estimation , 2010, IEEE Transactions on Signal Processing.

[23]  David W. Casbeer,et al.  Multi-agent Decentralized Search of a Probability Map with Communication Constraints* , 2010 .

[24]  Asuman E. Ozdaglar,et al.  Constrained Consensus and Optimization in Multi-Agent Networks , 2008, IEEE Transactions on Automatic Control.

[25]  Ali H. Sayed,et al.  Distributed optimization via diffusion adaptation , 2011, 2011 4th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[26]  Srdjan S. Stankovic,et al.  Decentralized Parameter Estimation by Consensus Based Stochastic Approximation , 2007, IEEE Transactions on Automatic Control.

[27]  Frank Nielsen,et al.  Skew Jensen-Bregman Voronoi Diagrams , 2011, Trans. Comput. Sci..

[28]  Sonia Martínez,et al.  On Distributed Convex Optimization Under Inequality and Equality Constraints , 2010, IEEE Transactions on Automatic Control.

[29]  Ali H. Sayed,et al.  Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks , 2011, IEEE Transactions on Signal Processing.

[30]  Ali H. Sayed,et al.  Diffusion strategies for adaptation and learning over networks: an examination of distributed strategies and network behavior , 2013, IEEE Signal Processing Magazine.

[31]  Ali H. Sayed,et al.  On the benefits of diffusion cooperation for distributed optimization and learning , 2013, 21st European Signal Processing Conference (EUSIPCO 2013).

[32]  Kai-Yew Lum,et al.  Multiagent Information Fusion and Cooperative Control in Target Search , 2013, IEEE Transactions on Control Systems Technology.

[33]  Gang Feng,et al.  Persistent awareness coverage control for mobile sensor networks , 2013, Autom..

[34]  Anthony Tzes,et al.  Spatially distributed area coverage optimisation in mobile robotic networks with arbitrary convex anisotropic patterns , 2013, Autom..

[35]  Vijay Kumar,et al.  Cooperative multi-target localization with noisy sensors , 2013, 2013 IEEE International Conference on Robotics and Automation.

[36]  Alfred O. Hero,et al.  Diffusion LMS for multitask problems with overlapping hypothesis subspaces , 2014, 2014 IEEE International Workshop on Machine Learning for Signal Processing (MLSP).

[37]  Ali H. Sayed,et al.  Adaptive Penalty-Based Distributed Stochastic Convex Optimization , 2013, IEEE Transactions on Signal Processing.

[38]  Ali H. Sayed,et al.  Adaptive Networks , 2014, Proceedings of the IEEE.

[39]  Ali H. Sayed,et al.  Asynchronous Adaptation and Learning Over Networks—Part I: Modeling and Stability Analysis , 2013, IEEE Transactions on Signal Processing.

[40]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .