Distributed Particle Filtering in Networks of Agents

This thesis is focused on distributed particle filter (DPF) algorithms performing decentralized sequential state estimation in networks of agents. The individual agents are equipped with sensing, computation, and communication capabilities. Applications of networks of agents are manifold and include environmental and agricultural monitoring, target tracking, pollution source localization, healthcare monitoring, chemical plume tracking, and surveillance. Performing distributed (collaborative) estimation of certain states of the environment from the measurements obtained by the agents is an essential task in many applications. Particle filters (PFs) are a modern approach to sequential state estimation that offers superior performance in nonlinear and non-Gaussian systems. A distributed (decentralized) implementation of PFs in networks of agents is complicated by the fact that the measurements are dispersed among the agents. Diffusing the locally available information throughout the network is thus an essential component of DPF algorithms. In this thesis, we group the existing DPF algorithms into three main classes, which we call fusion center-based, statistics dissemination-based, and measurement dissemination-based DPFs. Subclasses of the statistics dissemination-based class include leader agent-based and consensus-based DPFs. We discuss the main features and properties of the DPF algorithms belonging to the various (sub)classes. Then, we propose a novel leader agent-based DPF with a “look-ahead” proposal density adaptation that significantly reduces the estimation error. In this DPF, Gaussian mixture representations of partial posteriors are propagated along an aggregation chain of agents. We also propose several consensus-based DPFs that employ the novel “likelihood consensus” method for a distributed approximate calculation of the global (all-agents) likelihood function. In these DPFs, each agent executes a local PF that calculates a particle representation of the global posterior. To reduce the amount of communications and the latency, we propose a modification of the likelihood consensus that requires only a single consensus iteration per PF recursion. Finally, we develop a distributed, consensus-based proposal adaptation scheme that yields a performance improvement or allows a reduction of the number of particles. Simulation results for a target tracking problem demonstrate the excellent performance of the proposed DPFs, which is often very close to the performance of a centralized PF.

[1]  Soummya Kar,et al.  Gossip Algorithms for Distributed Signal Processing , 2010, Proceedings of the IEEE.

[2]  Petar M. Djuric,et al.  Non-centralized target tracking in networks of directional sensors: Further advances , 2011, 2011 4th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[3]  Mónica F. Bugallo,et al.  Target tracking by fusion of random measures , 2007, Signal Image Video Process..

[4]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[5]  Andrea Cavallaro,et al.  Distributed target tracking under realistic network conditions , 2011 .

[6]  Arthur G. O. Mutambara,et al.  Decentralized Estimation and Control for Multisensor Systems , 2019 .

[7]  Mark Coates,et al.  Distributed particle filters for sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[8]  Dongbing Gu Distributed Particle Filter for Target Tracking , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[9]  M. Pitt,et al.  Filtering via Simulation: Auxiliary Particle Filters , 1999 .

[10]  Harold W. Sorenson,et al.  Recursive Bayesian estimation using piece-wise constant approximations , 1988, Autom..

[11]  Dongbing Gu,et al.  Consensus based distributed particle filter in sensor networks , 2008, 2008 International Conference on Information and Automation.

[12]  Pramod K. Varshney,et al.  Bandwidth-Efficient Target Tracking In Distributed Sensor Networks Using Particle Filters , 2006, 2006 9th International Conference on Information Fusion.

[13]  Paolo Braca,et al.  Running consensus in wireless sensor networks , 2008, 2008 11th International Conference on Information Fusion.

[14]  R. S. Bucy,et al.  Bayes Theorem and Digital Realizations for Non-Linear Filters , 1969 .

[15]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[16]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[17]  M. Fiedler Algebraic connectivity of graphs , 1973 .

[18]  Xiaodong Wang,et al.  Joint multiple target tracking and classification in collaborative sensor networks , 2004, ISIT.

[19]  G. Pottie,et al.  Entropy-based sensor selection heuristic for target localization , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[20]  Peter D. Scott,et al.  Comparison of SCIPUFF Plume Prediction with Particle Filter Assimilated Prediction for Dipole Pride 26 Data , 2011, ArXiv.

[21]  Pramod K. Varshney,et al.  Posterior Crlb Based Sensor Selection for Target Tracking in Sensor Networks , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[22]  Martin Hasler,et al.  Nonlinear Average Consensus , 2009 .

[23]  Peter Willett,et al.  Integration of Bayes detection with target tracking , 2001, IEEE Trans. Signal Process..

[24]  Deok-Jin Lee,et al.  Nonlinear Estimation and Multiple Sensor Fusion Using Unscented Information Filtering , 2008, IEEE Signal Processing Letters.

[25]  S. Haykin,et al.  Cubature Kalman Filters , 2009, IEEE Transactions on Automatic Control.

[26]  Babak Hassibi,et al.  Particle filtering for Quantized Innovations , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[27]  Gerald Matz,et al.  Mean-square optimal weight design for average consensus , 2012, 2012 IEEE 13th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[28]  Andrea Cavallaro,et al.  Multi-Camera Networks: Principles and Applications , 2009 .

[29]  Petar M. Djuric,et al.  Sequential likelihood consensus and its application to distributed particle filtering with reduced communications and latency , 2011, 2011 Conference Record of the Forty Fifth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[30]  Sebastian Thrun,et al.  Decentralized Sensor Fusion with Distributed Particle Filters , 2002, UAI.

[31]  H. Sorenson,et al.  Nonlinear Bayesian estimation using Gaussian sum approximations , 1972 .

[32]  Louahdi Khoudour,et al.  Robust visual tracking via MCMC-based particle filtering , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[33]  Michael G. Rabbat,et al.  Distributed auxiliary particle filters using selective gossip , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[34]  G. Ing,et al.  Sensor network particle filters: motes as particles , 2005, IEEE/SP 13th Workshop on Statistical Signal Processing, 2005.

[35]  M. Simandl,et al.  Sampling Densities of Particle Filter: A Survey and Comparison , 2007, 2007 American Control Conference.

[36]  Vladimir Shin,et al.  Consensus Sigma-Point Information Filter for Large-Scale Sensor Networks , 2010, 2010 Ninth International Symposium on Distributed Computing and Applications to Business, Engineering and Science.

[37]  Mónica F. Bugallo,et al.  Target Tracking by Particle Filtering in Binary Sensor Networks , 2008, IEEE Transactions on Signal Processing.

[38]  Timothy J. Robinson,et al.  Sequential Monte Carlo Methods in Practice , 2003 .

[39]  Stergios I. Roumeliotis,et al.  Set-Membership Constrained Particle Filter: Distributed Adaptation for Sensor Networks , 2011, IEEE Transactions on Signal Processing.

[40]  Yang Weng,et al.  Target tracking in wireless sensor networks using particle filter with quantized innovations , 2010, 2010 13th International Conference on Information Fusion.

[41]  Franz Hlawatsch,et al.  Time-space-sequential distributed particle filtering with low-rate communications , 2009, 2009 Conference Record of the Forty-Third Asilomar Conference on Signals, Systems and Computers.

[42]  Rudolph van der Merwe,et al.  The unscented Kalman filter for nonlinear estimation , 2000, Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373).

[43]  Hugh F. Durrant-Whyte,et al.  A decentralised particle filtering algorithm for multi-target tracking across multiple flight vehicles , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[44]  Hugh F. Durrant-Whyte,et al.  Consistent methods for Decentralised Data Fusion using Particle Filters , 2006, 2006 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[45]  Rudolph van der Merwe,et al.  Sigma-point kalman filters for probabilistic inference in dynamic state-space models , 2004 .

[46]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[47]  Ronald P. S. Mahler,et al.  Random Set Theory for Target Tracking and Identification , 2001 .

[48]  Mark J. F. Gales,et al.  Product of Gaussians for speech recognition , 2006, Comput. Speech Lang..

[49]  Mark Coates,et al.  Asynchronous distributed particle filter via decentralized evaluation of Gaussian products , 2010, 2010 13th International Conference on Information Fusion.

[50]  Ba Tuong Vo,et al.  Random finite sets in Multi-object filtering , 2008 .

[51]  R. Castro,et al.  Selective Gossip , 2009, 2009 3rd IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[52]  Jeffrey K. Uhlmann,et al.  Unscented filtering and nonlinear estimation , 2004, Proceedings of the IEEE.

[53]  Antonio Ortega,et al.  Signal compression in wireless sensor networks , 2012, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[54]  Xiaodong Wang,et al.  Decentralized sigma-point information filters for target tracking in collaborative sensor networks , 2005, IEEE Transactions on Signal Processing.

[55]  Petar M. Djuric,et al.  Likelihood consensus-based distributed particle filtering with distributed proposal density adaptation , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[56]  Franz Hlawatsch,et al.  Time-space-sequential algorithms for distributed Bayesian state estimation in serial sensor networks , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[57]  Mónica F. Bugallo,et al.  A New Class of Particle Filters for Random Dynamic Systems with Unknown Statistics , 2004, EURASIP J. Adv. Signal Process..

[58]  Ivan Stojmenovic,et al.  Wireless Sensor and Actuator Networks: Algorithms and Protocols for Scalable Coordination and Data Communication , 2010 .

[59]  Arash Mohammadi,et al.  Distributed particle filtering for large scale dynamical systems , 2009, 2009 IEEE 13th International Multitopic Conference.

[60]  B. Anderson,et al.  Optimal Filtering , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[61]  Yan Zhou,et al.  Distributed sigma-point Kalman filtering for sensor networks: Dynamic consensus approach , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[62]  Hugh F. Durrant-Whyte,et al.  Decentralised particle filtering for multiple target tracking in wireless sensor networks , 2008, 2008 11th International Conference on Information Fusion.

[63]  Hing Cheung So,et al.  Distributed Particle Filter for Target Tracking in Sensor Networks , 2009 .

[64]  Stephen P. Boyd,et al.  Fastest Mixing Markov Chain on a Graph , 2004, SIAM Rev..

[65]  Feng Zhao,et al.  Information-Driven Dynamic Sensor Collaboration for Tracking Applications , 2002 .

[66]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[67]  Devavrat Shah,et al.  Fast Distributed Algorithms for Computing Separable Functions , 2005, IEEE Transactions on Information Theory.

[68]  Darryl Morrell,et al.  The use of particle filtering with the unscented transform to schedule sensors multiple steps ahead , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[69]  Mónica F. Bugallo,et al.  Target Tracking in a Two-Tiered Hierarchical Sensor Network , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[70]  Hugh Durrant-Whyte,et al.  Decentralised data fusion with particles , 2005 .

[71]  Dongbing Gu,et al.  Distributed EM Algorithm for Gaussian Mixtures in Sensor Networks , 2008, IEEE Transactions on Neural Networks.

[72]  J. Liu,et al.  Multitarget Tracking in Distributed Sensor Networks , 2007, IEEE Signal Processing Magazine.

[73]  Petar M. Djuric,et al.  Non-centralized target tracking in networks of directional sensors , 2011 .

[74]  Sonia Martínez,et al.  Discrete-time dynamic average consensus , 2010, Autom..

[75]  Petar M. Djuric,et al.  Gaussian sum particle filtering , 2003, IEEE Trans. Signal Process..

[76]  Fredrik Gustafsson,et al.  Particle filters for positioning, navigation, and tracking , 2002, IEEE Trans. Signal Process..

[77]  Zhen-ya Yan,et al.  Distributed particle filter for target tracking in wireless sensor network , 2006, 2006 14th European Signal Processing Conference.

[78]  J. Navarro-Pedreño Numerical Methods for Least Squares Problems , 1996 .

[79]  A. Papandreou-Suppappola,et al.  Scheduling multiple sensors using particle filters in target tracking , 2003, IEEE Workshop on Statistical Signal Processing, 2003.

[80]  Petar M. Djuric,et al.  Study of Algorithmic and Architectural Characteristics of Gaussian Particle Filters , 2010, J. Signal Process. Syst..

[81]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[82]  John W. Fisher,et al.  Using Sample-based Representations Under Communications Constraints , 2004 .

[83]  G. Kitagawa Non-Gaussian State—Space Modeling of Nonstationary Time Series , 1987 .

[84]  P. R. Bevington,et al.  Data Reduction and Error Analysis for the Physical Sciences , 1969 .

[85]  Branko Ristic,et al.  Beyond the Kalman Filter: Particle Filters for Tracking Applications , 2004 .

[86]  Feng Zhao,et al.  Collaborative In-Network Processing for Target Tracking , 2003, EURASIP J. Adv. Signal Process..

[87]  Tong Zhao,et al.  Distributed Sequential Bayesian Estimation of a Diffusive Source in Wireless Sensor Networks , 2007, IEEE Transactions on Signal Processing.

[88]  Kazufumi Ito,et al.  Gaussian filters for nonlinear filtering problems , 2000, IEEE Trans. Autom. Control..

[89]  A. Chandrakasan,et al.  Energy-efficient DSPs for wireless sensor networks , 2002, IEEE Signal Process. Mag..

[90]  Henk Wymeersch,et al.  Belief consensus algorithms for fast distributed target tracking in wireless sensor networks , 2012, Signal Process..

[91]  Amir Asif,et al.  Consensus-based distributed unscented particle filter , 2011, 2011 IEEE Statistical Signal Processing Workshop (SSP).

[92]  James Llinas,et al.  Handbook of Multisensor Data Fusion , 2001 .

[93]  Deborah Estrin,et al.  Information-theoretic approaches for sensor selection and placement in sensor networks for target localization and tracking , 2005, Journal of Communications and Networks.

[94]  Petar M. Djuric,et al.  Distributed particle filtering in agent networks: A survey, classification, and comparison , 2013, IEEE Signal Processing Magazine.

[95]  Y. Bar-Ness,et al.  Distributed synchronization in wireless networks , 2008, IEEE Signal Processing Magazine.

[96]  Xiaodong Wang,et al.  Dynamic sensor collaboration via sequential Monte Carlo , 2004, IEEE Journal on Selected Areas in Communications.

[97]  Erwin Riegler,et al.  Simultaneous distributed sensor self-localization and target tracking using belief propagation and likelihood consensus , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[98]  Binoy Ravindran,et al.  Completely Distributed Particle Filters for Target Tracking in Sensor Networks , 2011, 2011 IEEE International Parallel & Distributed Processing Symposium.

[99]  Yoan Miche,et al.  Mixture Models and EM , 2007 .

[100]  P.K. Varshney,et al.  Channel Aware Particle Filtering for Tracking in Sensor Networks , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.

[101]  Target tracking with asynchronous measurements by a network of distributed mobile agents , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[102]  Petar M. Djuric,et al.  Likelihood Consensus and Its Application to Distributed Particle Filtering , 2011, IEEE Transactions on Signal Processing.

[103]  Alexander T. Ihler,et al.  Inference in sensor networks: graphical models and particle methods , 2005 .

[104]  Petar M. Djuric,et al.  Gaussian particle filtering , 2003, IEEE Trans. Signal Process..

[105]  James V. Candy,et al.  Bayesian Signal Processing: Classical, Modern and Particle Filtering Methods , 2009 .

[106]  Pramod K. Varshney,et al.  A sensor selection approach for target tracking in sensor networks with quantized measurements , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[107]  Pramod K. Varshney,et al.  Tracking in Wireless Sensor Networks Using Particle Filtering: Physical Layer Considerations , 2009, IEEE Transactions on Signal Processing.

[108]  Peter I. Corke,et al.  Environmental Wireless Sensor Networks , 2010, Proceedings of the IEEE.

[109]  Jonathan Beaudeau,et al.  Non-centralized target tracking with mobile agents , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[110]  Reza Olfati-Saber,et al.  Distributed Kalman filtering for sensor networks , 2007, 2007 46th IEEE Conference on Decision and Control.

[111]  Petar M. Djuric,et al.  Distributed Gaussian particle filtering using likelihood consensus , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[112]  Tal Shima,et al.  UAV Cooperative Decision and Control: Challenges and Practical Approaches , 2008 .

[113]  H.-A. Loeliger,et al.  An introduction to factor graphs , 2004, IEEE Signal Process. Mag..

[114]  Ruggero Carli,et al.  Distributed Kalman filtering based on consensus strategies , 2008, IEEE Journal on Selected Areas in Communications.

[115]  Richard M. Murray,et al.  DYNAMIC CONSENSUS FOR MOBILE NETWORKS , 2005 .

[116]  Sailes K. Sengijpta Fundamentals of Statistical Signal Processing: Estimation Theory , 1995 .

[117]  Hisashi Tanizaki,et al.  Nonlinear Filters: Estimation and Applications , 1993 .

[118]  R. Olfati-Saber,et al.  Distributed Kalman Filter with Embedded Consensus Filters , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[119]  C. D. Kemp,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[120]  Simon J. Godsill,et al.  An Overview of Existing Methods and Recent Advances in Sequential Monte Carlo , 2007, Proceedings of the IEEE.

[121]  Leonidas J. Guibas,et al.  Wireless sensor networks - an information processing approach , 2004, The Morgan Kaufmann series in networking.

[122]  Anand D. Sarwate,et al.  Broadcast Gossip Algorithms for Consensus , 2009, IEEE Transactions on Signal Processing.

[123]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[124]  P. Djurić,et al.  Particle filtering , 2003, IEEE Signal Process. Mag..

[125]  Robert Babuska,et al.  Distributed nonlinear estimation for robot localization using weighted consensus , 2010, 2010 IEEE International Conference on Robotics and Automation.

[126]  Yu Hen Hu,et al.  Distributed particle filters for wireless sensor network target tracking , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[127]  Greg Welch,et al.  Welch & Bishop , An Introduction to the Kalman Filter 2 1 The Discrete Kalman Filter In 1960 , 1994 .

[128]  Jorge Cortes,et al.  Distributed Control of Robotic Networks: A Mathematical Approach to Motion Coordination Algorithms , 2009 .

[129]  P. Willett,et al.  Practical fusion of quantized measurements via particle filtering , 2008, IEEE Transactions on Aerospace and Electronic Systems.

[130]  Nando de Freitas,et al.  The Unscented Particle Filter , 2000, NIPS.

[131]  Petar M. Djuric,et al.  Likelihood consensus: Principles and application to distributed particle filtering , 2010, 2010 Conference Record of the Forty Fourth Asilomar Conference on Signals, Systems and Computers.

[132]  James Llinas,et al.  Handbook of Multisensor Data Fusion : Theory and Practice, Second Edition , 2008 .

[133]  Parameswaran Ramanathan,et al.  Distributed particle filter with GMM approximation for multiple targets localization and tracking in wireless sensor network , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[134]  Rudolph van der Merwe,et al.  Gaussian mixture sigma-point particle filters for sequential probabilistic inference in dynamic state-space models , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[135]  A. Willsky,et al.  Particle filtering under communications constraints , 2005, IEEE/SP 13th Workshop on Statistical Signal Processing, 2005.

[136]  Mónica F. Bugallo,et al.  Tracking with particle filtering in tertiary wireless sensor networks , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[137]  Grégoire Allaire,et al.  Numerical Linear Algebra , 2007 .

[138]  Jorge Cortés,et al.  Finite-time convergent gradient flows with applications to network consensus , 2006, Autom..

[139]  JeongGil Ko,et al.  Wireless Sensor Networks for Healthcare , 2010, Proceedings of the IEEE.

[140]  Christoph F. Mecklenbräuker,et al.  Localization of acoustic sources using a decentralized particle filter , 2011, EURASIP J. Wirel. Commun. Netw..

[141]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[142]  Qi Cheng,et al.  Joint State Monitoring and Fault Detection using Distributed Particle Filtering , 2007, 2007 Conference Record of the Forty-First Asilomar Conference on Signals, Systems and Computers.