Analysis of Distributed Adaptive Filters Based on Diffusion Strategies Over Sensor Networks

In this paper, we will analyze a basic class of diffusion adaptive filters based on least mean squares algorithms. Both stability and performance analyses will be carried out under a general cooperative information condition, without such stringent conditions as statistical independence and stationarity that have been used in almost all the existing literature and, thus, makes our theory applicable to stochastic systems with feedback. In comparison with the existing work, a key theoretical difficulty that needs to be overcome in this paper is to analyze the product of asymmetric correlated nonstationary random matrices, which is inherent in the structure of the diffusion-type filtering algorithms. We will further demonstrate that the distributed adaptive filters can estimate a dynamic process of interest from noisy measurements by a set of sensors working in a cooperative way, in the natural scenario where none of the sensors can fulfill the estimation task individually due to insufficient information. Finally, the necessity of our cooperative information condition will also be discussed in this paper.

[1]  Lei Guo Estimating time-varying parameters by the Kalman filter based algorithm: stability and convergence , 1990 .

[2]  Harold J. Kushner,et al.  Stochastic Approximation Algorithms and Applications , 1997, Applications of Mathematics.

[3]  Odile Macchi,et al.  Adaptive Processing: The Least Mean Squares Approach with Applications in Transmission , 1995 .

[4]  P. Kumar,et al.  Theory and practice of recursive identification , 1985, IEEE Transactions on Automatic Control.

[5]  Gang George Yin,et al.  Distributed Energy-Aware Diffusion Least Mean Squares: Game-Theoretic Learning , 2013, IEEE Journal of Selected Topics in Signal Processing.

[6]  Changyin Sun,et al.  Distributed Cooperative Adaptive Identification and Control for a Group of Continuous-Time Systems With a Cooperative PE Condition via Consensus , 2014, IEEE Transactions on Automatic Control.

[7]  Benoît Champagne,et al.  Diffusion LMS Strategies in Sensor Networks With Noisy Input Data , 2015, IEEE/ACM Transactions on Networking.

[8]  Ali H. Sayed,et al.  On the Learning Behavior of Adaptive Networks—Part I: Transient Analysis , 2013, IEEE Transactions on Information Theory.

[9]  Ruggero Carli,et al.  Distributed Kalman filtering based on consensus strategies , 2008, IEEE Journal on Selected Areas in Communications.

[10]  Ali Sayed,et al.  Adaptation, Learning, and Optimization over Networks , 2014, Found. Trends Mach. Learn..

[11]  Ali H. Sayed,et al.  Diffusion Strategies Outperform Consensus Strategies for Distributed Estimation Over Adaptive Networks , 2012, IEEE Transactions on Signal Processing.

[12]  Lennart Ljung,et al.  Theory and Practice of Recursive Identification , 1983 .

[13]  Isao Yamada,et al.  Diffusion Least-Mean Squares With Adaptive Combiners: Formulation and Performance Analysis , 2010, IEEE Transactions on Signal Processing.

[14]  Chen Chen,et al.  Performance analysis of distributed adaptive filters , 2015, Commun. Inf. Syst..

[15]  Azam Khalili,et al.  A distributed incremental LMS algorithm with reliability of observation consideration , 2010, 2010 IEEE International Conference on Communication Systems.

[16]  Lei Guo,et al.  Stability of distributed LMS under cooperative stochastic excitation , 2015, 2015 34th Chinese Control Conference (CCC).

[17]  L. Ljung,et al.  Exponential stability of general tracking algorithms , 1995, IEEE Trans. Autom. Control..

[18]  Soummya Kar,et al.  Convergence Rate Analysis of Distributed Gossip (Linear Parameter) Estimation: Fundamental Limits and Tradeoffs , 2010, IEEE Journal of Selected Topics in Signal Processing.

[19]  Chen Chen,et al.  Performance bounds of distributed adaptive filters with cooperative correlated signals , 2016, Science China Information Sciences.

[20]  Simon Haykin,et al.  Adaptive filter theory (2nd ed.) , 1991 .

[21]  Azam Khalili,et al.  Steady-State Analysis of Diffusion LMS Adaptive Networks With Noisy Links , 2012, IEEE Transactions on Signal Processing.

[22]  Ioannis D. Schizas,et al.  Distributed LMS for Consensus-Based In-Network Adaptive Processing , 2009, IEEE Transactions on Signal Processing.

[23]  Lei Guo,et al.  Stability of Diffusion Adaptive Filters , 2014 .

[24]  Harold J. Kushner,et al.  Approximation and Weak Convergence Methods for Random Processes , 1984 .

[25]  Mousa Shamsi,et al.  Adaptive Networks Under Non-Stationary Conditions: Formulation, Performance Analysis, and Application , 2015, IEEE Transactions on Signal Processing.

[26]  Lei Guo,et al.  Stability of Recursive Stochastic Tracking Algorithms , 1994 .

[27]  L. Ljung,et al.  Necessary and sufficient conditions for stability of LMS , 1997, IEEE Trans. Autom. Control..

[28]  Lennart Ljung,et al.  Performance analysis of general tracking algorithms , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[29]  Siyu Xie,et al.  Exponential Stability of LMS-Based Distributed Adaptive Filters , 2017 .

[30]  Victor Solo,et al.  Stability of distributed adaptive algorithms II: Diffusion algorithms , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).