Normalized LMS algorithm and data-selective strategies for adaptive graph signal estimation

Abstract This work proposes a normalized least-mean-squares (NLMS) algorithm for online estimation of bandlimited graph signals (GS) using a reduced number of noisy measurements. As in the classical adaptive filtering framework, the resulting GS estimation technique converges faster than the least-mean-squares (LMS) algorithm while being less complex than the recursive least-squares (RLS) algorithm, both recently recast as adaptive estimation strategies for the GS framework. Detailed steady-state mean-squared error and deviation analyses are provided for the proposed NLMS algorithm, and are also employed to complement previous analyses on the LMS and RLS algorithms. Additionally, two different time-domain data-selective (DS) strategies are proposed to reduce the overall computational complexity by only performing updates when the input signal brings enough innovation. The parameter setting of the algorithms is performed based on the analysis of these DS strategies, and closed formulas are derived for an accurate evaluation of the update probability when using different adaptive algorithms. The theoretical results predicted in this work are corroborated with high accuracy by numerical simulations.

[1]  Tobias Damm,et al.  Direct methods and ADI‐preconditioned Krylov subspace methods for generalized Lyapunov equations , 2008, Numer. Linear Algebra Appl..

[2]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs: Frequency Analysis , 2013, IEEE Transactions on Signal Processing.

[3]  Jelena Kovacevic,et al.  Discrete Signal Processing on Graphs: Sampling Theory , 2015, IEEE Transactions on Signal Processing.

[4]  Antonio Ortega,et al.  Towards a sampling theorem for signals on arbitrary graphs , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[6]  Alan J. Laub,et al.  Matrix analysis - for scientists and engineers , 2004 .

[7]  Paulo S. R. Diniz,et al.  On Data-Selective Adaptive Filtering , 2018, IEEE Transactions on Signal Processing.

[8]  Yih-Fang Huang,et al.  BEACON: an adaptive set-membership filtering technique with sparse updates , 1999, IEEE Trans. Signal Process..

[9]  J. Nagumo,et al.  A learning method for system identification , 1967, IEEE Transactions on Automatic Control.

[10]  Ali H. Sayed,et al.  Adaptive Filters , 2008 .

[11]  Paulo S. R. Diniz,et al.  Adaptive Filtering: Algorithms and Practical Implementation , 1997 .

[12]  Sergio Barbarossa,et al.  Adaptive Graph Signal Processing: Algorithms and Optimal Sampling Strategies , 2017, IEEE Transactions on Signal Processing.

[13]  Jelena Kovacevic,et al.  Signal Recovery on Graphs: Fundamental Limits of Sampling Strategies , 2015, IEEE Transactions on Signal and Information Processing over Networks.

[14]  Larry C. Andrews,et al.  Special Functions Of Mathematics For Engineers , 2022 .

[15]  Alejandro Ribeiro,et al.  Greedy Sampling of Graph Signals , 2017, IEEE Transactions on Signal Processing.

[16]  Georgios B. Giannakis,et al.  Online Censoring for Large-Scale Regressions with Application to Streaming Big Data , 2015, IEEE Transactions on Signal Processing.

[17]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[18]  J. Kovacevic,et al.  Sampling theory for graph signals , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  Pierre Vandergheynst,et al.  Graph Signal Processing: Overview, Challenges, and Applications , 2017, Proceedings of the IEEE.

[20]  Philipp Birken,et al.  Numerical Linear Algebra , 2011, Encyclopedia of Parallel Computing.

[21]  F. Downton,et al.  Introduction to Mathematical Statistics , 1959 .

[22]  Paolo Di Lorenzo,et al.  Online Recovery of Time- varying Signals Defined over Dynamic Graphs , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[23]  Wallace A. Martins,et al.  Online Temperature Estimation using Graph Signals , 2018 .

[24]  David D. Falconer,et al.  Tracking properties and steady-state performance of RLS adaptive filter algorithms , 1986, IEEE Trans. Acoust. Speech Signal Process..

[25]  Sunil K. Narang,et al.  Signal processing techniques for interpolation in graph structured data , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[26]  P. Diniz,et al.  Set-membership affine projection algorithm , 2001, IEEE Signal Processing Letters.

[27]  Soummya Kar,et al.  The Internet of Things: Secure Distributed Inference , 2018, IEEE Signal Processing Magazine.

[28]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs , 2012, IEEE Transactions on Signal Processing.

[29]  Sergio Barbarossa,et al.  Adaptive Least Mean Squares Estimation of Graph Signals , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[30]  José M. F. Moura,et al.  Big Data Analysis with Signal Processing on Graphs: Representation and processing of massive data sets with irregular structure , 2014, IEEE Signal Processing Magazine.

[31]  José M. F. Moura,et al.  Signal Recovery on Graphs: Variation Minimization , 2014, IEEE Transactions on Signal Processing.

[32]  B. Widrow,et al.  Stationary and nonstationary learning characteristics of the LMS adaptive filter , 1976, Proceedings of the IEEE.

[33]  Dirk T. M. Slock,et al.  On the convergence behavior of the LMS and the normalized LMS algorithms , 1993, IEEE Trans. Signal Process..

[34]  Sergio Barbarossa,et al.  Distributed Adaptive Learning of Graph Signals , 2016, IEEE Transactions on Signal Processing.

[35]  Gang Wang,et al.  Adaptive censoring for large-scale regressions , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[36]  Sergio Barbarossa,et al.  Sampling and Recovery of Graph Signals , 2017, 1712.09310.

[37]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[38]  N. Cressie The origins of kriging , 1990 .

[39]  Sergio Barbarossa,et al.  Optimal sampling strategies for adaptive learning of graph signals , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[40]  Sergio Barbarossa,et al.  Distributed recursive least squares strategies for adaptive reconstruction of graph signals , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).