Information-Theoretic Control of Multiple Sensor Platforms

Ben Grocholsky Doctor of Philosophy The University of Sydney March 2002 Information-Theoretic Control of Multiple Sensor Platforms This thesis is concerned with the development of a consistent, information-theoretic basis for understanding of coordination and cooperation decentralised multi-sensor multi-platform systems. Autonomous systems composed of multiple sensors and multiple platforms potentially have significant importance in applications such as defence, search and rescue, mining or intelligent manufacturing. However, the effective use of multiple autonomous systems requires that an understanding be developed of the mechanisms of coordination and cooperation between component systems in pursuit of a common goal. A fundamental, quantitative, understanding of coordination and cooperation between decentralised autonomous systems is the main goal of this thesis. This thesis focuses on the problem of coordination and cooperation for teams of autonomous systems engaged in information gathering and data fusion tasks. While this is a subset of the general cooperative autonomous systems problem, it still encompasses a range of possible applications in picture compilation, navigation, searching and map building problems. The great advantage of restricting the domain of interest in this way is that an underlying mathematical model for coordination and cooperation can be based on the use of information-theoretic models of platform and sensor abilities. The information theoretic approach builds on the established principles and architecture previously developed for decentralised data fusion systems. In the decentralised control problem addressed in this thesis, each platform and sensor system is considered to be a distinct decision maker with an individual information-theoretic utility measure capturing both local objectives and the inter-dependencies among the decisions made by other members of the team. Together these information-theoretic utilities constitute the team objective. The key contributions of this thesis lie in the quantification and study of cooperative control between sensors and platforms using information as a common utility measure. In particular, • The problem of information gathering is formulated as an optimal control problem by identifying formal measures of information with utility or pay-off. • An information-theoretic utility model of coupling and coordination between decentralised decision makers is elucidated. This is used to describe how the information gathering strategies of a team of autonomous systems are coupled. • Static and dynamic information structures for team members are defined. It is shown that the use of static information structures can lead to efficient, although sub-optimal, decentralised control strategies for the team. • Significant examples in decentralised control of a team of sensors are developed. These include the multi-vehicle multi-target bearings-only tracking problem, and the area coverage or exploration problem for multiple vehicles. These examples demonstrate the range of non-trivial problems to which the theory in this thesis can be employed.

[1]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[2]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[3]  J. Nash Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[4]  J. Nash THE BARGAINING PROBLEM , 1950, Classics in Game Theory.

[5]  J. Robinson AN ITERATIVE METHOD OF SOLVING A GAME , 1951, Classics in Game Theory.

[6]  J. Nash Two-Person Cooperative Games , 1953 .

[7]  J. Marschak,et al.  Elements for a Theory of Teams , 1955 .

[8]  N E Manos,et al.  Stochastic Models , 1960, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[9]  R. Radner,et al.  Team Decision Problems , 1962 .

[10]  Robert Wilson,et al.  Computing Equilibria of N-Person Games , 1971 .

[11]  R. Radner,et al.  Economic theory of teams , 1972 .

[12]  Y. Ho,et al.  Team decision theory and information structures in optimal control problems--Part II , 1972 .

[13]  Arthur Gelb,et al.  Applied Optimal Estimation , 1974 .

[14]  Y. Ho,et al.  Teams, signaling, and information theory , 1977, 1977 IEEE Conference on Decision and Control including the 16th Symposium on Adaptive Processes and A Special Symposium on Fuzzy Set Theory and Applications.

[15]  G. R. Sullivan,et al.  The development of an efficient optimal control package , 1978 .

[16]  Yu-Chi Ho,et al.  Team decision theory and information structures , 1980 .

[17]  Philip E. Gill,et al.  Practical optimization , 1981 .

[18]  Editors , 1986, Brain Research Bulletin.

[19]  Gregory D. Hager,et al.  Information and multi-sensor coordination , 1986, UAI.

[20]  Kok Lay Teo,et al.  Control parametrization: A unified approach to optimal control problems with general constraints , 1988, Autom..

[21]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[22]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[23]  Jaroslaw Sobieszczanski-Sobieski,et al.  Optimization by decomposition: A step from hierarchic to non-hierarchic systems , 1989 .

[24]  Jaroslaw Sobieszczanski-Sobieski,et al.  Overcoming the Bellman's curse of dimensionality in large optimization problems , 1990 .

[25]  T. M. Berg,et al.  Model Distribution in Decentralized Multi-Sensor Data Fusion , 1991, 1991 American Control Conference.

[26]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[27]  J. Magnus,et al.  Matrix Differential Calculus with Applications in Statistics and Econometrics , 1991 .

[28]  Dimitri P. Bertsekas,et al.  A forward/reverse auction algorithm for asymmetric assignment problems , 1992, Comput. Optim. Appl..

[29]  H. F. Durrant-Whyte,et al.  On Distributed and Decentralized Estimation , 1992 .

[30]  H.F. Durrant-Whyte,et al.  On sensor management in decentralized data fusion , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[31]  Hugh F. Durrant-Whyte,et al.  A Fully Decentralized Multi-Sensor System For Tracking and Surveillance , 1993, Int. J. Robotics Res..

[32]  Hugh F. Durrant-Whyte,et al.  A decentralized Bayesian algorithm for identification of tracked targets , 1993, IEEE Trans. Syst. Man Cybern..

[33]  Hugh F. Durrant-Whyte,et al.  A formally verified modular decentralized robot control system , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[34]  M. Yokoo,et al.  Team Theoretic Approach For Sensing Based Robot Navigation , 1993, Proceedings of the Intelligent Vehicles '93 Symposium.

[35]  Hugh Durrant-Whyte,et al.  Modular Mobile Robot Design , 1993 .

[36]  James Manyika,et al.  An information-theoretic approach to data fusion and sensor management , 1993 .

[37]  E. Kalai,et al.  Rational Learning Leads to Nash Equilibrium , 1993 .

[38]  Hugh F. Durrant-Whyte,et al.  Nonlinear information space: a practical basis for decentralization , 1994, Other Conferences.

[39]  H.F. Durrant-Whyte,et al.  Reliability in decentralised data fusion networks , 1994, Proceedings of 1994 IEEE International Conference on MFI '94. Multisensor Fusion and Integration for Intelligent Systems.

[40]  Hugh F. Durrant-Whyte,et al.  Network management in decentralized data fusion networks , 1994, Other Conferences.

[41]  H.F. Durrant-Whyte,et al.  Routing for reliability in decentralised sensing networks , 1994, Proceedings of 1994 American Control Conference - ACC '94.

[42]  P. Perona,et al.  Motion estimation via dynamic vision , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[43]  Jaroslaw Sobieszczanski-Sobieski,et al.  Optimization of coupled systems : A critical overview of approaches , 1994 .

[44]  Maja J. Mataric,et al.  Issues and approaches in the design of collective autonomous agents , 1995, Robotics Auton. Syst..

[45]  Alex Fukunaga,et al.  Cooperative mobile robotics: antecedents and directions , 1995 .

[46]  T. Kellam,et al.  Artificial Minds , 1996, Inf. Process. Manag..

[47]  Jaroslaw Sobieszczanski-Sobieski,et al.  Multidisciplinary aerospace design optimization - Survey of recent developments , 1996 .

[48]  Julio Rosenblatt,et al.  DAMN: a distributed architecture for mobile navigation , 1997, J. Exp. Theor. Artif. Intell..

[49]  Arthur G. O. Mutambara,et al.  Decentralized Estimation and Control for Multisensor Systems , 2019 .

[50]  J. Passerieux,et al.  Optimal observer maneuver for bearings-only tracking , 1998 .

[51]  Gregory A. McIntyre,et al.  A Comprehensive Approach to Sensor Management and Scheduling , 1998 .

[52]  J. Cadre,et al.  Optimal observer trajectory in bearings-only tracking for manoeuvring sources , 1999 .

[53]  Jean-Pierre Le Cadre,et al.  Optimizing the receiver maneuvers for bearings-only tracking , 1999, Autom..

[54]  Lynne E. Parker,et al.  Adaptive heterogeneous multi-robot teams , 1998, Neurocomputing.

[55]  Wolfram Burgard,et al.  Collaborative Multi-Robot Localization , 1999, DAGM-Symposium.

[56]  H. Haken,et al.  Treatment of combinatorial optimization problems using selection equations with cost terms. Part II. NP -hard three-dimensional assignment problems , 1999 .

[57]  Y. Oshman,et al.  Optimization of observer trajectories for bearings-only target localization , 1999 .

[58]  V. Vassiliadis,et al.  Second-order sensitivities of general dynamic systems with application to optimal control problems , 1999 .

[59]  Rainer E. Burkard,et al.  Linear Assignment Problems and Extensions , 1999, Handbook of Combinatorial Optimization.

[60]  David W. Payton,et al.  Pheromone Robotics , 2001, SPIE Optics East.

[61]  Gee Wah Ng,et al.  Sensor management - what, why and how , 2000, Inf. Fusion.

[62]  Daniel J. Stilwell,et al.  A framework for decentralized control of autonomous vehicles , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[63]  Daniel J. Stilwell,et al.  A strategy for controlling autonomous robot platoons , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[64]  T. Binder,et al.  Dynamic optimization using a wavelet based adaptive control vector parameterization strategy , 2000 .

[65]  Timothy W. McLain,et al.  A decomposition strategy for optimal coordination of unmanned air vehicles , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[66]  Gaurav S. Sukhatme,et al.  Modular behaviors in heterogeneous groups of mobile robots , 2000, SPIE Optics East.

[67]  Wolfram Burgard,et al.  Collaborative multi-robot exploration , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[68]  Gaurav S. Sukhatme,et al.  Fly spy: lightweight localization and target tracking for cooperating ground and air robots , 2000 .

[69]  Alberto Elfes,et al.  Towards dynamic target identification using optimal design of experiments , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[70]  Anthony Stentz,et al.  A Market Approach to Multirobot Coordination , 2001 .

[71]  Timothy W. McLain,et al.  Cooperative control of UAV rendezvous , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[72]  Milind Tambe,et al.  Team Coordination among Distributed Agents: Analyzing Key Teamwork Theories and Models , 2002 .

[73]  John J. Leonard,et al.  Cooperative concurrent mapping and localization , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[74]  Milind Tambe,et al.  Multiagent teamwork: analyzing the optimality and complexity of key theories and models , 2002, AAMAS '02.

[75]  Timothy R. Vittor,et al.  Modular Decentralized Control of Fruit Picking Redundant Manipulator , 2003 .