Conditional Posterior Cramer-Rao Lower Bound and Distributed Target Tracking in Sensor Networks

Sequential Bayesian estimation is the process of recursively estimating the state of a dynamical system observed in the presence of noise. Posterior Cramer-Rao lower bound (PCRLB) sets a performance limit on any Bayesian estimator for the given dynamical system. The PCRLB does not fully utilize the existing measurement information to give an indication of the mean squared error (MSE) of the estimator in the future. In many practical applications, we are more concerned with the value of the bound in the future than in the past. PCRLB is an offline bound, because it averages out the very useful measurement information, which makes it an off-line bound determined only by the system dynamical model, system measurement model and the prior knowledge of the system state at the initial time. This dissertation studies the sequential Bayesian estimation problem and then introduces the notation of conditional PCRLB, which utilizes the existing measurement information up to the current time, and sets the limit on the MSE of any Bayesian estimators at the next time step. This work has two emphases: firstly, we give the mathematically rigorous formulation of the conditional PCRLB as well as the approximate recursive version of conditional PCRLB for nonlinear, possibly non-Gaussian dynamical systems. Secondly, we apply particle filter techniques to compute the numerical values of the conditional PCRLB approximately, which overcomes the integration problems introduced by nonlinear/non-Gaussian systems. Further, we explore several possible applications of the proposed bound to find algorithms that provide improved performance. The primary problem of interest is the sensor selection problem for target tracking in sensor networks. Comparisons are also made between the performance of sensor selection algorithm based on the proposed bound and the existing approaches, such as information driven, nearest neighbor, and PCRLB with renewal strategy, to demonstrate the superior performances of the proposed approach. This dissertation also presents a bandwidth-efficient algorithm for tracking a target in sensor networks using distributed particle filters. This algorithm distributes the computation burden for target tracking over the sensor nodes. Each sensor node transmits a compressed local tracking result to the fusion center by a modified expectationmaximization (EM) algorithm to save the communication bandwidth. The fusion center incorporates the compressed tracking results to give the estimate of the target state. Finally, the target tracking problem in heterogeneous sensor networks is investigated extensively. Extended Kalman Filter and particle filter techniques are implemented and compared for tracking a maneuvering target with the Interacting Multiple Model (IMM). Conditional Posterior Cramer-Rao Lower Bound and Distributed Target Tracking in Sensor Networks by

[1]  G. Kitagawa Non-Gaussian State—Space Modeling of Nonstationary Time Series , 1987 .

[2]  Yunmin Zhu,et al.  Unified optimal linear estimation fusion. I. Unified models and fusion rules , 2000, Proceedings of the Third International Conference on Information Fusion.

[3]  Feng Zhao,et al.  Information-driven dynamic sensor collaboration , 2002, IEEE Signal Process. Mag..

[4]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[5]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[6]  R. E. Kalman,et al.  New Results in Linear Filtering and Prediction Theory , 1961 .

[7]  Patrick Pérez,et al.  Sequential Monte Carlo methods for multiple target tracking and data fusion , 2002, IEEE Trans. Signal Process..

[8]  John W. Fisher,et al.  Approximate Dynamic Programming for Communication-Constrained Sensor Network Management , 2007, IEEE Transactions on Signal Processing.

[9]  B. Anderson,et al.  Optimal Filtering , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[10]  T. Pham,et al.  Distributed tracking in AD-HOC sensor networks , 2005, IEEE/SP 13th Workshop on Statistical Signal Processing, 2005.

[11]  Daniel Minoli,et al.  Wireless Sensor Networks: Technology, Protocols, and Applications , 2007 .

[12]  Kenneth J. Hintz,et al.  A measure of the information gain attributable to cueing , 1991, IEEE Trans. Syst. Man Cybern..

[13]  A. F. Smith,et al.  Statistical analysis of finite mixture distributions , 1986 .

[14]  Jun S. Liu,et al.  Sequential Imputations and Bayesian Missing Data Problems , 1994 .

[15]  X. R. Li,et al.  A Survey of Maneuvering Target Tracking—Part III: Measurement Models , 2001 .

[16]  Tom E. Bishop,et al.  Blind Image Restoration Using a Block-Stationary Signal Model , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[17]  Alfred O. Hero,et al.  An Information-Based Approach to Sensor Management in Large Dynamic Networks , 2007, Proceedings of the IEEE.

[18]  Claire J. Tomlin,et al.  Mobile Sensor Network Control Using Mutual Information Methods and Particle Filters , 2010, IEEE Transactions on Automatic Control.

[19]  Chee-Yee Chong,et al.  Sensor networks: evolution, opportunities, and challenges , 2003, Proc. IEEE.

[20]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[21]  Tong Zhao,et al.  Adaptive Polarized Waveform Design for Target Tracking Based on Sequential Bayesian Inference , 2008, IEEE Transactions on Signal Processing.

[22]  Jeff Harrison,et al.  Applied Bayesian Forecasting and Time Series Analysis , 1994 .

[23]  Joseph G. Ibrahim,et al.  Monte Carlo Methods in Bayesian Computation , 2000 .

[24]  John B. Moore,et al.  The Kalman-Bucy Filter as a True Time-Varying Wiener Filter , 1971, IEEE Trans. Syst. Man Cybern..

[25]  Yu Hen Hu,et al.  Distributed particle filters for wireless sensor network target tracking , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[26]  Pramod K. Varshney,et al.  A sensor selection approach for target tracking in sensor networks with quantized measurements , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[27]  New York Dover,et al.  ON THE CONVERGENCE PROPERTIES OF THE EM ALGORITHM , 1983 .

[28]  Jean-Michel Marin,et al.  Bayesian Modelling and Inference on Mixtures of Distributions , 2005 .

[29]  Xiaodong Wang,et al.  Joint multiple target tracking and classification in collaborative sensor networks , 2004, ISIT.

[30]  M. West Robust Sequential Approximate Bayesian Estimation , 1981 .

[31]  K. Punithakumar,et al.  Multisensor deployment using PCRLBS, incorporating sensor deployment and motion uncertainties , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[32]  Sailes K. Sengijpta Fundamentals of Statistical Signal Processing: Estimation Theory , 1995 .

[33]  Y. Bar-Shalom Tracking and data association , 1988 .

[34]  Thia Kirubarajan,et al.  Large-Scale Optimal Sensor Array Management for Multitarget Tracking , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[35]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .

[36]  Michael I. Jordan,et al.  Convergence results for the EM approach to mixtures of experts architectures , 1995, Neural Networks.

[37]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[38]  Darryl Morrell,et al.  Dynamic Configuration of Time-Varying Waveforms for Agile Sensing and Tracking in Clutter , 2007, IEEE Transactions on Signal Processing.

[39]  Y. Bar-Shalom,et al.  Multisensor resource deployment using posterior Cramer-Rao bounds , 2004, IEEE Transactions on Aerospace and Electronic Systems.

[40]  Sanjay Kumar Madria,et al.  Sensor networks: an overview , 2003 .

[41]  Pramod K. Varshney,et al.  Dynamic and Evolutionary Multi-objective Optimization for Sensor Selection in Sensor Networks for Target Tracking , 2009, IJCCI.

[42]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[43]  Pramod K. Varshney,et al.  Energy Aware Iterative Source Localization for Wireless Sensor Networks , 2010, IEEE Transactions on Signal Processing.

[44]  Pramod K. Varshney,et al.  Posterior Crlb Based Sensor Selection for Target Tracking in Sensor Networks , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[45]  Alfred O. Hero,et al.  Sensor management using an active sensing approach , 2005, Signal Process..

[46]  X. R. Li,et al.  Survey of maneuvering target tracking. Part I. Dynamic models , 2003 .

[47]  Pramod K. Varshney,et al.  Channel aware iterative source localization for wireless sensor networks , 2010, 2010 13th International Conference on Information Fusion.

[48]  Carlos H. Muravchik,et al.  Posterior Cramer-Rao bounds for discrete-time nonlinear filtering , 1998, IEEE Trans. Signal Process..

[49]  R. Tharmarasa,et al.  PCRLB-based multisensor array management for multitarget tracking , 2004, IEEE Transactions on Aerospace and Electronic Systems.

[50]  H. Sorenson,et al.  Bayesian Parameter Estimation , 2006, Statistical Inference for Engineers and Data Scientists.

[51]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[52]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[53]  Thiagalingam Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation , 2001 .

[54]  Michael I. Jordan,et al.  Learning from Incomplete Data , 1994 .

[55]  Leonidas J. Guibas,et al.  Collaborative signal and information processing: an information-directed approach , 2003 .

[56]  Archana Bharathidasan,et al.  Sensor Networks : An Overview , 2002 .

[57]  Petar M. Djuric,et al.  Gaussian particle filtering , 2003, IEEE Trans. Signal Process..

[58]  Arnaud Doucet,et al.  Particle filters for state estimation of jump Markov linear systems , 2001, IEEE Trans. Signal Process..

[59]  Jeff A. Bilmes,et al.  A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models , 1998 .

[60]  Mark Coates,et al.  Distributed particle filters for sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[61]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[62]  I. Bilik,et al.  Target tracking in glint noise environment using nonlinear non-Gaussian Kalman filter , 2006, 2006 IEEE Conference on Radar.