Collaborative distributed data fusion architecture using multi-level Markov decision processes

Decentralized multisensor-multitarget tracking has numerous advantages over single-sensor or single-platform tracking. In this paper, we present a solution to one of the main problems of decentralized tracking, namely, distributed information transfer and fusion among the participating platforms. This paper presents a hierarchial multi-level decision mechanism for collaborative distributed data fusion that provides each platform with the required data for the fusion process while substantially reducing redundancy in the information flow in the overall system. We consider a distributed data fusion system consisting of platforms that are decentralized, heterogenous, and potentially unreliable. The proposed approach, which is based on hierarchial Markov decision processes and decentralized lookup substrate, will control the information exchange and data fusion process based, among the other parameters, on maximizing performance metrics of individual platforms, thereby enhancing the whole distributed system's reliability as well as that of each participating platform. Simulation examples demonstrate the operation and the performance results of the system.

[1]  John N. Tsitsiklis,et al.  The Complexity of Markov Decision Processes , 1987, Math. Oper. Res..

[2]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[3]  Chee-Yee Chong.  Graphical Models for Nonlinear Distributed Estimation , 2004 .

[4]  Leon Sterling,et al.  Distributed information fusion agents , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[5]  T. B. Boffey.  Linear Network Optimization: Algorithms and Codes , 1994 .

[6]  David R. Karger,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM '01.

[7]  Thiagalingam Kirubarajan,et al.  Optimal cooperative placement of UAVs for ground target tracking with Doppler radar , 2004, SPIE Defense + Commercial Sensing.

[8]  Kathryn B. Laskey,et al.  Credibility Models for Multi-Source Fusion , 2006, 2006 9th International Conference on Information Fusion.

[9]  Ronald J. Williams,et al.  Tight Performance Bounds on Greedy Policies Based on Imperfect Value Functions , 1993 .

[10]  Robert Morris,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM 2001.

[11]  Yakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Principles and Techniques , 1995 .

[12]  Leslie Pack Kaelbling,et al.  On the Complexity of Solving Markov Decision Problems , 1995, UAI.

[13]  Alan S. Willsky,et al.  Distributed data association for multi-target tracking in sensor networks , 2005 .

[14]  Dimitri P. Bertsekas,et al.  Dynamic Programming: Deterministic and Stochastic Models , 1987 .

[15]  Thia Kirubarajan,et al.  Estimation and Decision Fusion: A Survey , 2006, 2006 IEEE International Conference on Engineering of Intelligent Systems.

[16]  Y. Bar-Shalom,et al.  Autonomous Ground Target Tracking by Multiple Cooperative UAVs , 2005, 2005 IEEE Aerospace Conference.

[17]  C.-Y. Chong,et al.  Distributed fusion and communication management for target identification , 2005, 2005 7th International Conference on Information Fusion.

[18]  Alfonso Farina,et al.  Algorithms for the selection of the active sensors in distributed tracking: comparison between Frisbee and GNS methods , 2006, 2006 9th International Conference on Information Fusion.

[19]  Bin Yu,et al.  Learning the Quality of Sensor Data in Distributed Decision Fusion , 2006, 2006 9th International Conference on Information Fusion.

[20]  Claudia V. Goldman,et al.  Efficient Control of Information Flow for Distributed Multisensor Fusion Using Markov Decision Processes , 2006, 2006 9th International Conference on Information Fusion.

[21]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[22]  Pramod K. Varshney,et al.  Decision fusion in a wireless sensor network with a large number of sensors , 2004 .

[23]  Feng Zhao,et al.  Distributed tracking in wireless ad hoc sensor networks , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[24]  Yaakov Bar-Shalom,et al.  Multitarget/Multisensor Tracking: Applications and Advances -- Volume III , 2000 .

[25]  Krishna R. Pattipati,et al.  Efficient multisensor fusion using multidimensional data association , 2001 .

[26]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[27]  Nicholas R. Jennings,et al.  Computational Mechanism Design for Information Fusion within Sensor Networks , 2006, 2006 9th International Conference on Information Fusion.