Necessary conditions for optimality for a distributed optimal control problem

This paper presents a novel optimal control problem formulation and new optimality conditions, referred to as distributed optimal control, for systems comprised of many dynamic agents that can each be described by the same ordinary differential equations (ODEs). The macroscopic system performance is represented by an integral cost function of a restriction operator comprised of the probability density function of the individual agents' state variables, and of their control laws. It is shown that, under proper assumptions, the macroscopic cost can be optimized subject to a hyperbolic partial differential equation (PDE) that describes the evolution of the macroscopic state over larger spatial and temporal scales. This methodology extends the capabilities of optimal control to complex systems described by numerous interacting dynamical systems. The approach is demonstrated on a simulated network of distributed sensors installed on autonomous underwater vehicles, and deployed to provide track coverage over a region of interest.

[1]  C. Hargraves,et al.  DIRECT TRAJECTORY OPTIMIZATION USING NONLINEAR PROGRAMMING AND COLLOCATION , 1987 .

[2]  Philip E. Gill,et al.  Practical optimization , 1981 .

[3]  Miodrag Potkonjak,et al.  Worst and best-case coverage in sensor networks , 2005, IEEE Transactions on Mobile Computing.

[4]  Anil V. Rao,et al.  Optimal Reconfiguration of Spacecraft Formations Using the Gauss Pseudospectral Method , 2008 .

[5]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[6]  Thomas A. Wettergren,et al.  Sensor Repositioning to Improve Undersea Sensor Field Coverage , 2007, OCEANS 2007.

[7]  O. Egeland,et al.  Trajectory planning and collision avoidance for underwater vehicles using optimal control , 1994 .

[8]  Robert Allen,et al.  Guidance and Control of Underwater Vehicles , 2003 .

[9]  Camillo J. Taylor,et al.  Dynamic Sensor Planning and Control for Optimally Tracking Targets , 2003, Int. J. Robotics Res..

[10]  Ioannis G. Kevrekidis,et al.  Equation-free: The computer-aided analysis of complex multiscale systems , 2004 .

[11]  Howie Choset,et al.  Coverage for robotics – A survey of recent results , 2001, Annals of Mathematics and Artificial Intelligence.

[12]  T.A. Wettergren Performance of search via track-before-detect for distributed sensor networks , 2008, IEEE Transactions on Aerospace and Electronic Systems.

[13]  Jean-Claude Latombe,et al.  Nonholonomic multibody mobile robots: Controllability and motion planning in the presence of obstacles , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[14]  Jean-Claude Latombe,et al.  Robot Motion Planning with Uncertainty in Control and Sensing , 1991, Artif. Intell..

[15]  Robert F. Stengel,et al.  Optimal Control and Estimation , 1994 .

[16]  Anil V. Rao,et al.  Optimal Control of an Underwater Sensor Network for Cooperative Target Tracking , 2009, IEEE Journal of Oceanic Engineering.

[17]  Silvia Ferrari,et al.  A Geometric Transversal Approach to Analyzing Track Coverage in Sensor Networks , 2008, IEEE Transactions on Computers.

[18]  Howie Choset,et al.  Path Planning for Robotic Demining: Robust Sensor-Based Coverage of Unstructured Environments and Probabilistic Methods , 2003, Int. J. Robotics Res..

[19]  K.M. Passino,et al.  Stability analysis of social foraging swarms , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  J. Sibert Electronic Tagging and Tracking in Marine Fisheries , 2001, Reviews: Methods and Technologies in Fish Biology and Fisheries.

[21]  J. Betts Survey of Numerical Methods for Trajectory Optimization , 1998 .

[22]  Thomas A. Wettergren,et al.  Optimal placement of distributed sensors against moving targets , 2009, TOSN.

[23]  Sonia Martínez,et al.  Coverage control for mobile sensing networks , 2002, IEEE Transactions on Robotics and Automation.

[24]  Thomas A. Wettergren,et al.  Assessing Design Tradeoffs in Deploying Undersea Distributed Sensor Networks , 2007, OCEANS 2007.

[25]  R.L. Streit,et al.  Tracking with distributed sets of proximity sensors using geometric invariants , 2004, IEEE Transactions on Aerospace and Electronic Systems.

[26]  G. V. Keuk Sequential track extraction , 1998 .

[27]  Lawrence Carin,et al.  Application of the theory of optimal experiments to adaptive electromagnetic-induction sensing of buried targets , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.