On the Development of Distributed Estimation Techniques for Wireless Sensor Networks

Wireless sensor networks (WSNs) have lately witnessed tremendous demand, as evidenced by the increasing number of day-to-day applications. The sensor nodes aim at estimating the parameters of their corresponding adaptive filters to achieve the desired response for the event of interest. Some of the burning issues related to linear parameter estimation in WSNs have been addressed in this thesis mainly focusing on reduction of communication overhead and latency, and robustness to noise. The first issue deals with the high communication overhead and latency in distributed parameter estimation techniques such as diffusion least mean squares (DLMS) and incremental least mean squares (ILMS) algorithms. Subsequently the poor performance demonstrated by these distributed techniques in presence of impulsive noise has been dealt separately. The issue of source localization i.e. estimation of source bearing in WSNs, where the existing decentralized algorithms fail to perform satisfactorily, has been resolved in this thesis. Further the same issue has been dealt separately independent of nodal connectivity in WSNs. This thesis proposes two algorithms namely the block diffusion least mean squares (BDLMS) and block incremental least mean squares (BILMS) algorithms for reducing the communication overhead in WSNs. The theoretical and simulation studies demonstrate that BDLMS and BILMS algorithms provide the same performances as that of DLMS and ILMS, but with significant reduction in communication overheads per node. The latency also reduces by a factor as high as the block-size used in the proposed algorithms. With an aim to develop robustness towards impulsive noise, this thesis proposes three robust distributed algorithms i.e. saturation nonlinearity incremental LMS (SNILMS), saturation nonlinearity diffusion LMS (SNDLMS) and Wilcoxon norm diffusion LMS (WNDLMS) algorithms. The steady-state analysis of SNILMS algorithm is carried out based on spatial-temporal energy conservation principle. The theoretical and simulation results show that these algorithms are robust to impulsive noise. The SNDLMS algorithm is found to provide better performance than SNILMS and WNDLMS algorithms. In order to develop a distributed source localization technique, a novel diffusion maximum likelihood (ML) bearing estimation algorithm is proposed in this thesis which needs less communication overhead than the centralized algorithms. After forming a random array with its neighbours, each sensor node estimates the source bearing by optimizing the ML function locally using a diffusion particle swarm optimization algorithm. The simulation results show that the proposed algorithm performs better than the centralized multiple signal classification (MUSIC) algorithm in terms of probability of resolution and root mean square error. Further, in order to make the proposed algorithm independent of nodal connectivity, a distributed in-cluster bearing estimation technique is proposed. Each cluster of sensors estimates the source bearing by optimizing the ML function locally in cooperation with other clusters. The simulation results demonstrate improved performance of the proposed method in comparison to the centralized and decentralized MUSIC algorithms, and the distributed in-network algorithm.

[1]  Ossama Younis,et al.  Node clustering in wireless sensor networks: recent developments and deployment challenges , 2006, IEEE Network.

[2]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[3]  Babita Majhi,et al.  Robust distributed linear parameter estimation in wireless sensor network , 2011, 2011 International Conference on Energy, Automation and Signal.

[4]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[5]  Chee-Yee Chong,et al.  Sensor networks: evolution, opportunities, and challenges , 2003, Proc. IEEE.

[6]  Mohamed F. Younis,et al.  Overlapping Multi-hop Clustering for Wireless Sensor Networks , 2009, ArXiv.

[7]  Ali H. Sayed,et al.  Analysis of Spatial and Incremental LMS Processing for Distributed Estimation , 2011, IEEE Transactions on Signal Processing.

[8]  Yilong Lu,et al.  Array failure correction with a genetic algorithm , 1999 .

[9]  Michael N. Vrahatis,et al.  Recent approaches to global optimization problems through Particle Swarm Optimization , 2002, Natural Computing.

[10]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .

[11]  Mohamed-Slim Alouini,et al.  A unified approach to the probability of error for noncoherent and differentially coherent modulations over generalized fading channels , 1998, IEEE Trans. Commun..

[12]  Ali H. Sayed,et al.  Fundamentals Of Adaptive Filtering , 2003 .

[13]  J. Capon High-resolution frequency-wavenumber spectrum analysis , 1969 .

[14]  Bernard Mulgrew,et al.  Robust Distributed Optimization in Wireless Sensor Network , 2009, 2009 International Conference on Advances in Recent Technologies in Communication and Computing.

[15]  Efstratios Skafidas,et al.  Distributed Source Localization Based on TOA Measurements in Wireless Sensor Networks , 2009, J. Electr. Comput. Eng..

[16]  Ossama Younis,et al.  HEED: a hybrid, energy-efficient, distributed clustering approach for ad hoc sensor networks , 2004, IEEE Transactions on Mobile Computing.

[17]  Marc Moonen,et al.  Distributed Adaptive Node-Specific Signal Estimation in Fully Connected Sensor Networks—Part II: Simultaneous and Asynchronous Node Updating , 2010, IEEE Transactions on Signal Processing.

[18]  Marc Moonen,et al.  Distributed Adaptive Node-Specific Signal Estimation in Fully Connected Sensor Networks—Part I: Sequential Node Updating , 2010, IEEE Transactions on Signal Processing.

[19]  Ganapati Panda,et al.  Robust identification using new Wilcoxon least mean square algorithm , 2009 .

[20]  N. Bershad On weight update saturation nonlinearities in LMS adaptation , 1990, IEEE Trans. Acoust. Speech Signal Process..

[21]  Linlin Ci,et al.  Acoustic Source Localization in Wireless Sensor Networks , 2007, Workshop on Intelligent Information Technology Application (IITA 2007).

[22]  Ananthram Swami,et al.  Wireless sensor networks : signal processing and communications perspectives , 2007 .

[23]  Bernard Mulgrew,et al.  Maximum likelihood DOA estimation in distributed wireless sensor network using adaptive particle swarm optimization , 2011, ICCCS '11.

[24]  Davide Brunelli,et al.  Wireless Sensor Networks , 2012, Lecture Notes in Computer Science.

[25]  Tareq Y. Al-Naffouri,et al.  Transient analysis of adaptive filters with error nonlinearities , 2003, IEEE Trans. Signal Process..

[26]  Sergios Theodoridis,et al.  A new fast block adaptive algorithm , 1999, IEEE Trans. Signal Process..

[27]  Ali H. Sayed,et al.  Diffusion LMS Strategies for Distributed Estimation , 2010, IEEE Transactions on Signal Processing.

[28]  Ali H. Sayed,et al.  Diffusion Strategies for Distributed Kalman Filtering and Smoothing , 2010, IEEE Transactions on Automatic Control.

[29]  Alfred O. Hero,et al.  Distributed maximum likelihood estimation for sensor networks , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[30]  Ying Zhang,et al.  Combs, needles, haystacks: balancing push and pull for discovery in large-scale sensor networks , 2004, SenSys '04.

[31]  B. El-Jabu,et al.  Optimal Robust Adaptive LMS Algorithm without Adaptation Step-Size , 2008, 2008 Global Symposium on Millimeter Waves.

[32]  Ali H. Sayed,et al.  Diffusion recursive least-squares for distributed estimation over adaptive networks , 2008, IEEE Transactions on Signal Processing.

[33]  Babita Majhi,et al.  Robust Incremental LMS over Wireless Sensor Network in Impulsive Noise , 2010, 2010 International Conference on Computational Intelligence and Communication Networks.

[34]  Ali H. Sayed,et al.  Distributed Detection Over Adaptive Networks Using Diffusion Adaptation , 2011, IEEE Transactions on Signal Processing.

[35]  R. Vemuri,et al.  Robust adaptive algorithms for active noise and vibration control , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[36]  Ali H. Sayed,et al.  Incremental Adaptive Strategies Over Distributed Networks , 2007, IEEE Transactions on Signal Processing.

[37]  Wei Hong,et al.  Proceedings of the 5th Symposium on Operating Systems Design and Implementation Tag: a Tiny Aggregation Service for Ad-hoc Sensor Networks , 2022 .

[38]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[39]  Thomas Kailath,et al.  Decentralized processing in sensor arrays , 1985, IEEE Trans. Acoust. Speech Signal Process..

[40]  Stephen P. Boyd,et al.  A space-time diffusion scheme for peer-to-peer least-squares estimation , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[41]  Bernard Mulgrew,et al.  Block Least Mean Squares Algorithm over Distributed Wireless Sensor Network , 2012, J. Comput. Networks Commun..

[42]  Ioannis D. Schizas,et al.  Distributed LMS for Consensus-Based In-Network Adaptive Processing , 2009, IEEE Transactions on Signal Processing.

[43]  Lok-Kee Ting,et al.  Virtex FPGA implementation of a pipelined adaptive LMS predictor for electronic support measures receivers , 2005, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[44]  Richard G. Baraniuk,et al.  Robust Distributed Estimation Using the Embedded Subgraphs Algorithm , 2006, IEEE Transactions on Signal Processing.

[45]  Pei Jung Chung,et al.  DOA estimation using fast EM and SAGE algorithms , 2002, Signal Process..

[46]  Dimitri P. Bertsekas,et al.  A New Class of Incremental Gradient Methods for Least Squares Problems , 1997, SIAM J. Optim..

[47]  Neil J. Bershad On Error Saturation Nonlinearities for LMS Adaptation in Impulsive Noise , 2008, IEEE Transactions on Signal Processing.

[48]  Bernard Mulgrew,et al.  Vertically challenged array design for DOA estimation , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[49]  Ali H. Sayed,et al.  Diffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis , 2008, IEEE Transactions on Signal Processing.

[50]  Ravi Mazumdar,et al.  A case for hybrid sensor networks , 2008, IEEE/ACM Trans. Netw..

[51]  Petre Stoica,et al.  MUSIC, maximum likelihood and Cramer-Rao bound , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[52]  Robert F. Pawula,et al.  A modified version of Price's theorem , 1967, IEEE Trans. Inf. Theory.

[53]  Richard R. Brooks,et al.  Distributed Sensor Networks: A Multiagent Perspective , 2008 .

[54]  Ali H. Sayed,et al.  Diffusion adaptive networks with changing topologies , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[55]  Mikael Johansson,et al.  On Distributed Optimization Using Peer-to-Peer Communications in Wireless Sensor Networks , 2008, 2008 5th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks.

[56]  D. Puccinelli,et al.  Wireless sensor networks: applications and challenges of ubiquitous sensing , 2005, IEEE Circuits and Systems Magazine.

[57]  Arie Feuer Performance analysis of the block least mean square algorithm , 1985 .

[58]  Robert Price,et al.  A useful theorem for nonlinear devices having Gaussian inputs , 1958, IRE Trans. Inf. Theory.

[59]  H. Vincent Poor,et al.  Joint channel estimation and symbol detection in Rayleigh flat-fading channels with impulsive noise , 1997, IEEE Communications Letters.

[60]  A. Zerguine,et al.  Convergence analysis of the LMS algorithm with a general error nonlinearity and an IID input , 1998, Conference Record of Thirty-Second Asilomar Conference on Signals, Systems and Computers (Cat. No.98CH36284).

[61]  Petre Stoica,et al.  Performance study of conditional and unconditional direction-of-arrival estimation , 1990, IEEE Trans. Acoust. Speech Signal Process..

[62]  Kung Yao,et al.  Maximum-likelihood source localization and unknown sensor location estimation for wideband signals in the near-field , 2002, IEEE Trans. Signal Process..

[63]  Bernard Widrow,et al.  Adaptive Signal Processing , 1985 .

[64]  A. Patnaik,et al.  Amplitude only compensation for failed antenna array using particle swarm optimization , 2008, 2008 IEEE Antennas and Propagation Society International Symposium.

[65]  Ian F. Akyildiz,et al.  Sensor Networks , 2002, Encyclopedia of GIS.

[66]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[67]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[68]  Neil J. Bershad,et al.  Saturation effects in LMS adaptive echo cancellation for binary data , 1990, IEEE Trans. Acoust. Speech Signal Process..

[69]  Bernie Mulgrew,et al.  Distributed identification of nonlinear processes using incremental and diffusion type PSO algorithms , 2009, 2009 IEEE Congress on Evolutionary Computation.

[70]  Sanjit K. Mitra,et al.  Block implementation of adaptive digital filters , 1981 .

[71]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[72]  John N. Tsitsiklis,et al.  Comments on "Coordination of Groups of Mobile Autonomous Agents Using Nearest Neighbor Rules" , 2007, IEEE Trans. Autom. Control..

[73]  Isao Yamada,et al.  An Adaptive Projected Subgradient Approach to Learning in Diffusion Networks , 2009, IEEE Transactions on Signal Processing.

[74]  Bjorn Ottersten,et al.  Exact and Large Sample ML Techniques for Parameter Estimation and Detection in Array Processing , 1993 .

[75]  Huaiyu Dai,et al.  Distributed Signal Processing Techniques for Wireless Sensor Networks , 2008, EURASIP J. Adv. Signal Process..

[76]  Seung Chan Bang,et al.  A Robust Adaptive Algorithm and Its Performance Anlaysis with Contaminated-Gaussian Noise , 1994 .

[77]  Peter L. Schmidt,et al.  Distributed source localization in a wireless sensor network , 2005 .

[78]  Mohamed F. Younis,et al.  Overlapping Multihop Clustering for Wireless Sensor Networks , 2009, IEEE Transactions on Parallel and Distributed Systems.

[79]  Gregory J. Pottie,et al.  Wireless integrated network sensors , 2000, Commun. ACM.

[80]  Bernard Mulgrew,et al.  A self-orthogonalizing efficient block adaptive filter , 1986, IEEE Trans. Acoust. Speech Signal Process..

[81]  Tareq Y. Al-Naffouri,et al.  Adaptive Filters with Error Nonlinearities: Mean-Square Analysis and Optimum Design , 2001, EURASIP J. Adv. Signal Process..

[82]  Michael Dean,et al.  Low complexity implementation of LMS algorithm , 2002 .

[83]  Mario Di Francesco,et al.  Energy conservation in wireless sensor networks: A survey , 2009, Ad Hoc Networks.

[84]  M.J. Abedin,et al.  Localization of near-field radiating sources with an arbitrary antenna array , 2008, 2008 IEEE Antennas and Propagation Society International Symposium.

[85]  Emile H. L. Aarts,et al.  Simulated Annealing: Theory and Applications , 1987, Mathematics and Its Applications.

[86]  Karl Henrik Johansson,et al.  Subgradient methods and consensus algorithms for solving convex optimization problems , 2008, 2008 47th IEEE Conference on Decision and Control.

[87]  D.H. Werner,et al.  Particle swarm optimization versus genetic algorithms for phased array synthesis , 2004, IEEE Transactions on Antennas and Propagation.

[88]  Sang Woo Kim,et al.  Wilcoxon adaptive algorithms for robust identification , 2009 .

[89]  John G. McWhirter,et al.  From Bit Level Systolic Arrays to HDTV Processor Chips , 2006, IEEE 17th International Conference on Application-specific Systems, Architectures and Processors (ASAP'06).

[90]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[91]  C. Burrus Block implementation of digital filters , 1971 .

[92]  Shing-Chow Chan,et al.  A recursive least M-estimate algorithm for robust adaptive filtering in impulsive noise: fast algorithm and convergence performance analysis , 2004, IEEE Transactions on Signal Processing.

[93]  R. O. Schmidt,et al.  Multiple emitter location and signal Parameter estimation , 1986 .

[94]  Yih-Lon Lin,et al.  Preliminary Study on Wilcoxon Learning Machines , 2008, IEEE Transactions on Neural Networks.

[95]  R.L. Moses,et al.  Locating the nodes: cooperative localization in wireless sensor networks , 2005, IEEE Signal Processing Magazine.

[96]  Biswanath Mukherjee,et al.  Wireless sensor network survey , 2008, Comput. Networks.

[97]  Bhaskar Krishnamachari,et al.  Modeling Search Costs in Wireless Sensor Networks , 2007, 2007 5th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks and Workshops.

[98]  Asuman Ozdaglar,et al.  Cooperative distributed multi-agent optimization , 2010, Convex Optimization in Signal Processing and Communications.

[99]  Yilong Lu,et al.  A Refined Genetic Algorithm for Accurate and Reliable DOA Estimation with a Sensor Array , 2007, Wirel. Pers. Commun..

[100]  Alfred O. Hero,et al.  A Convergent Incremental Gradient Method with a Constant Step Size , 2007, SIAM J. Optim..

[101]  Ilan Ziskind,et al.  Maximum likelihood localization of multiple sources by alternating projection , 1988, IEEE Trans. Acoust. Speech Signal Process..

[102]  Petre Stoica,et al.  Decentralized array processing using the MODE algorithm , 1995 .

[103]  Karl Henrik Johansson,et al.  Technical Communique On decentralized negotiation of optimal consensus , 2008 .

[104]  Y. Rahmat-Samii,et al.  Particle swarm optimization in electromagnetics , 2004, IEEE Transactions on Antennas and Propagation.

[105]  Shin'ichi Koike Adaptive threshold nonlinear algorithm for adaptive filters with robustness against impulse noise , 1997, IEEE Trans. Signal Process..

[106]  Alfred O. Hero,et al.  Energy-based sensor network source localization via projection onto convex sets , 2006, IEEE Trans. Signal Process..

[107]  Kung Yao,et al.  Source localization and beamforming , 2002, IEEE Signal Process. Mag..

[108]  Anna Hać,et al.  Wireless Sensor Network Designs , 2003 .

[109]  Ganapati Panda,et al.  Transient Analysis of Error saturation Nonlinearity LMS in Impulsive Noise , 2009 .

[110]  Edmund M. Yeh,et al.  Distributed energy management algorithm for large-scale wireless sensor networks , 2007, MobiHoc '07.

[111]  Bernard Mulgrew,et al.  Distributed bearing estimation technique using diffusion particle swarm optimisation algorithm , 2012, IET Wirel. Sens. Syst..

[112]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[113]  Dimitri P. Bertsekas,et al.  Incremental Subgradient Methods for Nondifferentiable Optimization , 2001, SIAM J. Optim..

[114]  Chong Kwan Un,et al.  Block conjugate gradient algorithms for adaptive filtering , 1996, Signal Process..

[115]  Seong Rag Kim,et al.  Adaptive robust impulse noise filtering , 1995, IEEE Trans. Signal Process..

[116]  Ameer Ahmed Abbasi,et al.  A survey on clustering algorithms for wireless sensor networks , 2007, Comput. Commun..

[117]  Torsten Söderström,et al.  Statistical analysis of decentralized MUSIC , 1992 .

[118]  John G. McWhirter,et al.  From Bit Level Systolic Arrays to HDTV Processor Chips , 2006, ASAP.

[119]  Randolph L. Moses,et al.  A Self-Localization Method for Wireless Sensor Networks , 2003, EURASIP J. Adv. Signal Process..

[120]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[121]  Robert Nowak,et al.  Distributed optimization in sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[122]  Jaesung Lim Block adaptive filtering algorithm based on the preconditioned conjugate gradient method , 1998, Signal Process..

[123]  Bernie Mulgrew,et al.  Maximum Lilkelihood Source Localization in Wireless Sensor Network Using Particle Swarm Optimization , 2011 .

[124]  Petre Stoica,et al.  Maximum likelihood methods for direction-of-arrival estimation , 1990, IEEE Trans. Acoust. Speech Signal Process..

[125]  Bernard Mulgrew,et al.  Distributed DOA estimation using clustering of sensor nodes and diffusion PSO algorithm , 2013, Swarm Evol. Comput..

[126]  Xiaowei Xu,et al.  SCAN: a structural clustering algorithm for networks , 2007, KDD '07.

[127]  Rangasami L. Kashyap,et al.  Robust decentralized direction-of-arrival estimation in contaminated noise , 1990, IEEE Trans. Acoust. Speech Signal Process..

[128]  Peter M. Clarkson,et al.  A class of order statistic LMS algorithms , 1992, IEEE Trans. Signal Process..

[129]  Griff L. Bilbro,et al.  Sample-sort simulated annealing , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[130]  Gregory J. Pottie,et al.  Instrumenting the world with wireless sensor networks , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[131]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[132]  Sailes K. Sengijpta Fundamentals of Statistical Signal Processing: Estimation Theory , 1995 .

[133]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[134]  Peter Willett,et al.  Distributed Estimation in Large Wireless Sensor Networks via a Locally Optimum Approach , 2008, IEEE Transactions on Signal Processing.

[135]  Weili Wu,et al.  Wireless Sensor Networks and Applications , 2008 .

[136]  Ganapati Panda,et al.  The Performance Analysis of Error Saturation Nonlinearity LMS in Impulsive Noise based on Weighted-Energy Conservation , 2010 .

[137]  Robert D. Nowak,et al.  Decentralized source localization and tracking [wireless sensor networks] , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.