Adaptive link selection algorithms for distributed estimation

This paper presents adaptive link selection algorithms for distributed estimation and considers their application to wireless sensor networks and smart grids. In particular, exhaustive search-based least mean squares (LMS) / recursive least squares (RLS) link selection algorithms and sparsity-inspired LMS / RLS link selection algorithms that can exploit the topology of networks with poor-quality links are considered. The proposed link selection algorithms are then analyzed in terms of their stability, steady-state, and tracking performance and computational complexity. In comparison with the existing centralized or distributed estimation strategies, the key features of the proposed algorithms are as follows: (1) more accurate estimates and faster convergence speed can be obtained and (2) the network is equipped with the ability of link selection that can circumvent link failures and improve the estimation performance. The performance of the proposed algorithms for distributed estimation is illustrated via simulations in applications of wireless sensor networks and smart grids.

[1]  Ali H. Sayed,et al.  Single-link diffusion strategies over adaptive networks , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  Ali H. Sayed,et al.  On the Influence of Informed Agents on Learning and Adaptation Over Networks , 2012, IEEE Transactions on Signal Processing.

[3]  Yih-Fang Huang,et al.  Distributed Least Mean-Square Estimation With Partial Diffusion , 2014, IEEE Transactions on Signal Processing.

[4]  Yih-Fang Huang,et al.  Analysis of a reduced-communication diffusion LMS algorithm , 2014, Signal Process..

[5]  Rodrigo C. de Lamare,et al.  Blind Adaptive Interference Suppression Based on Set-Membership Constrained Constant-Modulus Algorithms With Dynamic Bounds , 2012, IEEE Transactions on Signal Processing.

[6]  Rodrigo C. de Lamare,et al.  Adaptive reduced-rank processing based on joint and iterative interpolation, decimation, and filtering , 2009, IEEE Trans. Signal Process..

[7]  Ali H. Sayed,et al.  Diffusion Strategies for Distributed Kalman Filtering and Smoothing , 2010, IEEE Transactions on Automatic Control.

[8]  Ali H. Sayed,et al.  Sparse diffusion LMS for distributed adaptive estimation , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Rodrigo C. de Lamare,et al.  Set-Membership Adaptive Algorithms Based on Time-Varying Error Bounds for CDMA Interference Suppression , 2009, IEEE Transactions on Vehicular Technology.

[10]  Ali H. Sayed,et al.  Performance Limits for Distributed Estimation Over LMS Adaptive Networks , 2012, IEEE Transactions on Signal Processing.

[11]  Alfred O. Hero,et al.  Sparse LMS for system identification , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  A. Hero,et al.  Regularized Least-Mean-Square Algorithms , 2010, 1012.5066.

[13]  Eweda Eweda,et al.  Comparison of RLS, LMS, and sign algorithms for tracking randomly time-varying channels , 1994, IEEE Trans. Signal Process..

[14]  V. Nascimento,et al.  Sparsity-aware affine projection adaptive algorithms for system identification , 2011 .

[15]  Ali H. Sayed,et al.  Fundamentals Of Adaptive Filtering , 2003 .

[16]  Ali H. Sayed,et al.  Diffusion LMS Strategies for Distributed Estimation , 2010, IEEE Transactions on Signal Processing.

[17]  Martin Haardt,et al.  Blind Adaptive Constrained Constant-Modulus Reduced-Rank Interference Suppression Algorithms Based on Interpolation and Switched Decimation , 2011, IEEE Transactions on Signal Processing.

[18]  Ali H. Sayed,et al.  Linear Estimation (Information and System Sciences Series) , 2000 .

[19]  Ioannis D. Schizas,et al.  Distributed Recursive Least-Squares for Consensus-Based In-Network Adaptive Estimation , 2009, IEEE Transactions on Signal Processing.

[20]  Ali H. Sayed,et al.  Incremental Adaptive Strategies Over Distributed Networks , 2007, IEEE Transactions on Signal Processing.

[21]  Wenchang Sun,et al.  Sampling theorem for wavelet subspaces: error estimate and irregular sampling , 2000, IEEE Trans. Signal Process..

[22]  Marc Moonen,et al.  Distributed Adaptive Node-Specific Signal Estimation in Fully Connected Sensor Networks—Part II: Simultaneous and Asynchronous Node Updating , 2010, IEEE Transactions on Signal Processing.

[23]  Bernard Widrow,et al.  Adaptive Signal Processing , 1985 .

[24]  Robert D. Nowak,et al.  Quantized incremental algorithms for distributed optimization , 2005, IEEE Journal on Selected Areas in Communications.

[25]  Rodrigo C. de Lamare,et al.  Sparsity-Aware Adaptive Algorithms Based on Alternating Optimization and Shrinkage , 2014, IEEE Signal Processing Letters.

[26]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[27]  Jing Huang,et al.  State Estimation in Electric Power Grids: Meeting New Challenges Presented by the Requirements of the Future Grid , 2012, IEEE Signal Processing Magazine.

[28]  H. Vincent Poor,et al.  Distributed estimation over sensor networks based on distributed conjugate gradient strategies , 2016, IET Signal Process..

[29]  H. Vincent Poor,et al.  Distributed Compressed Estimation Based on Compressive Sensing , 2015, IEEE Signal Processing Letters.

[30]  D. Bertsekas,et al.  Incremental subgradient methods for nondifferentiable optimization , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[31]  Thakshila Wimalajeewa,et al.  Distributed Node Selection for Sequential Estimation over Noisy Communication Channels , 2010, IEEE Transactions on Wireless Communications.

[32]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[33]  Ali H. Sayed,et al.  Diffusion recursive least-squares for distributed estimation over adaptive networks , 2008, IEEE Transactions on Signal Processing.

[34]  Simon Haykin,et al.  Adaptive Filter Theory 4th Edition , 2002 .

[35]  J. Chambers,et al.  Distributed adaptive estimation based on the APA algorithm over diffusion networks with changing topology , 2009, 2009 IEEE/SP 15th Workshop on Statistical Signal Processing.

[36]  Yih-Fang Huang,et al.  Adaptive Distributed Estimation Based on Recursive Least-Squares and Partial Diffusion , 2014, IEEE Transactions on Signal Processing.

[37]  Bernie Mulgrew,et al.  IEEE International Joint Conference on Neural Networks , 1999 .

[38]  H. Poor,et al.  Fully Distributed State Estimation for Wide-Area Monitoring Systems , 2012, IEEE Transactions on Smart Grid.

[39]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[40]  Anjan Bose,et al.  Smart Transmission Grid Applications and Their Supporting Infrastructure , 2010, IEEE Transactions on Smart Grid.

[41]  Ali H. Sayed,et al.  Diffusion adaptive networks with changing topologies , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[42]  Rodrigo C. de Lamare,et al.  Study of Distributed Conjugate Gradient Strategies for Distributed Estimation Over Sensor Networks , 2016, ArXiv.

[43]  Yunlong Cai,et al.  Low-Complexity Variable Step-Size Mechanism for Code-Constrained Constant Modulus Stochastic Gradient Algorithms Applied to CDMA Interference Suppression , 2007, IEEE Transactions on Signal Processing.

[44]  Ali H. Sayed,et al.  Diffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis , 2008, IEEE Transactions on Signal Processing.

[45]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[46]  Yih-Fang Huang,et al.  Frequency-Domain Set-Membership Filtering and Its Applications , 2007, IEEE Transactions on Signal Processing.

[47]  Dimitri P. Bertsekas,et al.  A New Class of Incremental Gradient Methods for Least Squares Problems , 1997, SIAM J. Optim..