Value of information based distributed inference and planning

In multi-agent applications it is often the case that not all information is equally valuable to the missions, and agents are typically resource limited. Therefore it is important to ensure that the resources are spent on getting and conveying valuable information. This thesis presents efficient distributed sensing and planning algorithms that improve resource planning efficiency by taking into account the obtainable Value of Information (VoI) and improve distributed sensing efficiency by ensuring agents only broadcast high value measurements. The first result focuses on communication efficient distributed sensing algorithms. In particular, agents broadcast their measurements only when the VoI in their measurements exceeds a pre-defined threshold. The VoI threshold is further adaptively adjusted to better balance between the communication cost incurred and the longterm accuracy of the estimation. Theoretical results are presented establishing almost sure convergence of the communication cost and estimation error for distributions in the exponential family. Moreover, an algorithm that automatically forgets old information is also developed to estimate dynamically changing parameters. Validation through numerical simulations and real datasets show that the new VoIbased algorithms can yield improved parameter estimates than those achieved by previously published hyperparameter consensus algorithms while incurring only a fraction of the communication cost. The second result focuses on efficient distributed planning algorithms. In particular, in a system with heterogeneous agents, a coupled planning framework is presented that evaluates the sensing/exploration activities by the improvement on mission returns. Numerical results shows that the coupling between exploration and tasking agents encourages better cooperation between them, thus leading to better performance than decoupled approaches. A hardware testbed is developed to demonstrate the perfor-

[1]  Shie Mannor,et al.  Percentile Optimization for Markov Decision Processes with Parameter Uncertainty , 2010, Oper. Res..

[2]  Sameera S. Ponda,et al.  Distributed chance-constrained task allocation for autonomous multi-agent teams , 2012, 2012 American Control Conference (ACC).

[3]  B. Bethke,et al.  Real-time indoor autonomous vehicle test environment , 2008, IEEE Control Systems.

[4]  R. Wets,et al.  Stochastic programming , 1989 .

[5]  Richard M. Murray,et al.  Recent Research in Cooperative Control of Multivehicle Systems , 2007 .

[6]  Grace L. Yang,et al.  On Bayes Procedures , 1990 .

[7]  Han-Lim Choi,et al.  Consensus-Based Decentralized Auctions for Robust Task Allocation , 2009, IEEE Transactions on Robotics.

[8]  Alfred O. Hero,et al.  An Information-Based Approach to Sensor Management in Large Dynamic Networks , 2007, Proceedings of the IEEE.

[9]  John K Kruschke,et al.  Bayesian data analysis. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[10]  S. Grime,et al.  Data fusion in decentralized sensor networks , 1994 .

[11]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[12]  S. M. Ali,et al.  A General Class of Coefficients of Divergence of One Distribution from Another , 1966 .

[13]  Moe Z. Win,et al.  Asymptotic Performance of a Censoring Sensor Network , 2007, IEEE Transactions on Information Theory.

[14]  L. Blackmore,et al.  Convex Chance Constrained Predictive Control without Sampling , 2009 .

[15]  Frank Nielsen,et al.  Entropies and cross-entropies of exponential families , 2010, 2010 IEEE International Conference on Image Processing.

[16]  S. Panzieri,et al.  Adding and removing nodes in consensus , 2012, 2012 20th Mediterranean Conference on Control & Automation (MED).

[17]  Jonathan P. How,et al.  Multi-Task Allocation and Path Planning for Cooperating UAVs , 2003 .

[18]  David G. Schmale,et al.  Path planning for efficient UAV coordination in aerobiological sampling missions , 2008, 2008 47th IEEE Conference on Decision and Control.

[19]  A. Czirók,et al.  Collective Motion , 1999, physics/9902023.

[20]  Feng Zhao,et al.  Information-driven dynamic sensor collaboration , 2002, IEEE Signal Process. Mag..

[21]  William McEneaney,et al.  CONTROL FOR UAV OPERATIONS UNDER IMPERFECT INFORMATION , 2002 .

[22]  Wei Ren,et al.  Information consensus in multivehicle cooperative control , 2007, IEEE Control Systems.

[23]  H. Chernoff A Measure of Asymptotic Efficiency for Tests of a Hypothesis Based on the sum of Observations , 1952 .

[24]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[25]  K. Kastella,et al.  Particle filtering for multitarget detection and tracking , 2005, 2005 IEEE Aerospace Conference.

[26]  C. Guestrin,et al.  Distributed regression: an efficient framework for modeling sensor network data , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[27]  Georgios B. Giannakis,et al.  Distributed measurement censoring for estimation with wireless sensor networks , 2011, 2011 IEEE 12th International Workshop on Signal Processing Advances in Wireless Communications.

[28]  Wee Peng Tay Decentralized detection in resource-limited sensor network architectures , 2008 .

[29]  Robin J. Evans,et al.  An information theoretic approach to observer path design for bearings-only tracking , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[30]  Stuart J. Russell,et al.  Exploiting locality in probabilistic inference , 2004 .

[31]  Yongcan Cao,et al.  Experiments in Consensus-based Distributed Cooperative Control of Multiple Mobile Robots , 2007, 2007 International Conference on Mechatronics and Automation.

[32]  Naomi Ehrich Leonard,et al.  Collective Motion, Sensor Networks, and Ocean Sampling , 2007, Proceedings of the IEEE.

[33]  Neeta Trivedi,et al.  Graphical Models for Distributed Inference in Wireless Sensor Networks , 2009, 2009 Third International Conference on Sensor Technologies and Applications.

[34]  Huaiyu Zhu On Information and Sufficiency , 1997 .

[35]  Allen L. Soyster,et al.  Technical Note - Convex Programming with Set-Inclusive Constraints and Applications to Inexact Linear Programming , 1973, Oper. Res..

[36]  Alexander Shapiro,et al.  Convex Approximations of Chance Constrained Programs , 2006, SIAM J. Optim..

[37]  Arkadi Nemirovski,et al.  Robust solutions of uncertain linear programs , 1999, Oper. Res. Lett..

[38]  Guanrong Chen,et al.  Introduction to random signals and applied Kalman filtering, 2nd edn. Robert Grover Brown and Patrick Y. C. Hwang, Wiley, New York, 1992. ISBN 0‐471‐52573‐1, 512 pp., $62.95. , 1992 .

[39]  Andreas Krause,et al.  Near-optimal sensor placements in Gaussian processes , 2005, ICML.

[40]  Evgueni A. Haroutunian,et al.  Information Theory and Statistics , 2011, International Encyclopedia of Statistical Science.

[41]  Sulema Aranda,et al.  On Optimal Sensor Placement and Motion Coordination for Target Tracking , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[42]  Han-Lim Choi,et al.  A hyperparameter consensus method for agreement under uncertainty , 2012, Autom..

[43]  Mehran Mesbahi,et al.  Network Identification via Node Knockout , 2010, IEEE Transactions on Automatic Control.

[44]  Magnus Egerstedt,et al.  Network discovery: An estimation based approach , 2011, Proceedings of the 2011 American Control Conference.

[45]  Jonathan P. How,et al.  Active Exploration in Robust Unmanned Vehicle Task Assignment , 2011, J. Aerosp. Comput. Inf. Commun..

[46]  Han-Lim Choi,et al.  Adaptive sampling and forecasting with mobile sensor networks , 2009 .

[47]  Alfred O. Hero,et al.  Information Theoretic Approaches to Sensor Management , 2008 .

[48]  Ruggero Carli,et al.  Distributed Kalman filtering using consensus strategies , 2007, 2007 46th IEEE Conference on Decision and Control.

[49]  Chee-Yee Chong,et al.  Analytical and Computational Evaluation of Scalable Distributed Fusion Algorithms , 2010, IEEE Transactions on Aerospace and Electronic Systems.

[50]  J. Karl Hedrick,et al.  INFORMATION-THEORETIC SENSOR MOTION CONTROL FOR DISTRIBUTED ESTIMATION , 2007 .

[51]  L. Brown Fundamentals of statistical exponential families: with applications in statistical decision theory , 1986 .

[52]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[53]  Mark E. Campbell,et al.  Fast Weighted Exponential Product Rules for Robust General Multi-Robot Data Fusion , 2012, Robotics: Science and Systems.

[54]  Simon J. Julier,et al.  An Empirical Study into the Use of Chernoff Information for Robust, Distributed Fusion of Gaussian Mixture Models , 2006, 2006 9th International Conference on Information Fusion.

[55]  Keith D. Kastella,et al.  Foundations and Applications of Sensor Management , 2010 .

[56]  Vijay Gupta,et al.  Distributed estimation and control in networked systems , 2007 .

[57]  Jonathan P. How,et al.  Value-of-information aware active task assignment , 2013 .

[58]  A.S. Willsky,et al.  Distributed fusion in sensor networks , 2006, IEEE Signal Processing Magazine.

[59]  Hugh F. Durrant-Whyte,et al.  Decentralized Bayesian negotiation for cooperative search , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[60]  Venkatesh Saligrama,et al.  A Token-Based Approach for Distributed Computation in Sensor Networks , 2011, IEEE Journal of Selected Topics in Signal Processing.

[61]  Panos M. Pardalos,et al.  Advances in Cooperative Control and Optimization , 2008 .

[62]  Mehdi Alighanbari,et al.  Robust and decentralized task assignment algorithms for UAVs , 2007 .

[63]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[64]  Luca Francesco Bertuccelli Robust planning for heterogeneous UAVs in uncertain environments , 2004 .

[65]  Simon J. Julier,et al.  On conservative fusion of information with unknown non-Gaussian dependence , 2012, 2012 15th International Conference on Information Fusion.

[66]  Magnus Egerstedt,et al.  Graph Theoretic Methods in Multiagent Networks , 2010, Princeton Series in Applied Mathematics.

[67]  Alexei Makarenko,et al.  Decentralised data fusion: A graphical model approach , 2009, 2009 12th International Conference on Information Fusion.

[68]  A. Jadbabaie,et al.  Decentralized Computation of Homology Groups in Networks by Gossip , 2007, 2007 American Control Conference.

[69]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[70]  Deborah Estrin,et al.  Information-theoretic approaches for sensor selection and placement in sensor networks for target localization and tracking , 2005, Journal of Communications and Networks.

[71]  Nathan Michael,et al.  Persistent surveillance with a team of MAVs , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[72]  Antonio Alonso Ayuso,et al.  Introduction to Stochastic Programming , 2009 .

[73]  William J. Farrell,et al.  Generalized chernoff fusion approximation for practical distributed data fusion , 2009, 2009 12th International Conference on Information Fusion.

[74]  Loredana Arienzo,et al.  An Information-Theoretic Approach for Energy-Efficient Collaborative Tracking in Wireless Sensor Networks , 2010, EURASIP J. Wirel. Commun. Netw..