Distributed Estimation Over an Adaptive Incremental Network Based on the Affine Projection Algorithm

We study the problem of distributed estimation based on the affine projection algorithm (APA), which is developed from Newton's method for minimizing a cost function. The proposed solution is formulated to ameliorate the limited convergence properties of least-mean-square (LMS) type distributed adaptive filters with colored inputs. The analysis of transient and steady-state performances at each individual node within the network is developed by using a weighted spatial-temporal energy conservation relation and confirmed by computer simulations. The simulation results also verify that the proposed algorithm provides not only a faster convergence rate but also an improved steady-state performance as compared to an LMS-based scheme. In addition, the new approach attains an acceptable misadjustment performance with lower computational and memory cost, provided the number of regressor vectors and filter length parameters are appropriately chosen, as compared to a distributed recursive-least-squares (RLS) based method.

[1]  R. Olfati-Saber,et al.  Consensus Filters for Sensor Networks and Distributed Sensor Fusion , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[2]  Gregory J. Pottie,et al.  Instrumenting the world with wireless sensor networks , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[3]  Ali H. Sayed,et al.  Adaptive Processing over Distributed Networks , 2007, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[4]  Robert D. Nowak,et al.  Quantized incremental algorithms for distributed optimization , 2005, IEEE Journal on Selected Areas in Communications.

[5]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[6]  José Antonio Apolinário,et al.  Convergence analysis of the binormalized data-reusing LMS algorithm , 2000, IEEE Trans. Signal Process..

[7]  Deborah Estrin,et al.  Guest Editors' Introduction: Overview of Sensor Networks , 2004, Computer.

[8]  Ali H. Sayed,et al.  Diffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis , 2008, IEEE Transactions on Signal Processing.

[9]  S. Haykin.  Adaptive Filters , 2007 .

[10]  Ali H. Sayed,et al.  Mean-square performance of a family of affine projection algorithms , 2004, IEEE Transactions on Signal Processing.

[11]  H. Vincent Poor,et al.  Distributed learning in wireless sensor networks , 2005, IEEE Signal Processing Magazine.

[12]  S. G. Sankaran.  STEREOPHONIC ACOUSTIC ECHO CANCELLATION USING NLMS WITH ORTHOGONAL CORRECTION FACTORS , 1999 .

[13]  Ali H. Sayed,et al.  Transient behavior of affine projection algorithms , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[14]  Shoji Makino,et al.  Stereo projection echo canceller with true echo path estimation , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[15]  Mark G. Terwilliger,et al.  Overview of Sensor Networks , 2004 .

[16]  Ali H. Sayed,et al.  A unified approach to the steady-state and tracking analyses of adaptive filters , 2001, IEEE Trans. Signal Process..

[17]  A.H. Sayed,et al.  Distributed Recursive Least-Squares Strategies Over Adaptive Networks , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.

[18]  S. Thomas Alexander,et al.  Adaptive Signal Processing , 1986, Texts and Monographs in Computer Science.

[19]  R. Olfati-Saber,et al.  Distributed Kalman Filter with Embedded Consensus Filters , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[20]  Mani Srivastava,et al.  Overview of sensor networks , 2004 .

[21]  Jonathon A. Chambers,et al.  A new incremental affine projection-based adaptive algorithm for distributed networks , 2008, Signal Process..

[22]  Ali H. Sayed,et al.  Incremental Adaptive Strategies Over Distributed Networks , 2007, IEEE Transactions on Signal Processing.

[23]  Ali H. Sayed,et al.  Diffusion adaptive networks with changing topologies , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[24]  Ali H. Sayed,et al.  Diffusion recursive least-squares for distributed estimation over adaptive networks , 2008, IEEE Transactions on Signal Processing.

[25]  Danilo P. Mandic,et al.  A generalized normalized gradient descent algorithm , 2004, IEEE Signal Processing Letters.

[26]  Ali H. Sayed,et al.  Distributed Adaptive Incremental Strategies: Formulation and Performance Analysis , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[27]  Paulo Sergio Ramirez,et al.  Fundamentals of Adaptive Filtering , 2002 .

[28]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .