Estimation and stability of nonlinear control systems under intermittent information with applications to multi-agent robotics

This dissertation investigates the role of intermittent information in estimation and control problems and applies the obtained results to multi-agent tasks in robotics. First, we develop a stochastic hybrid model of mobile networks able to capture a large variety of heterogeneous multi-agent problems and phenomena. This model is applied to a case study where a heterogeneous mobile sensor network cooperatively detects and tracks mobile targets based on intermittent observations. When these observations form a satisfactory target trajectory, a mobile sensor is switched to the pursuit mode and deployed to capture the target. The cost of operating the sensors is determined from the geometric properties of the network, environment and probability of target detection. The above case study is motivated by the Marco Polo game played by children in swimming pools. Second, we develop adaptive sampling of targets’ positions in order to minimize energy consumption, while satisfying performance guarantees such as increased probability of detection over time, and no-escape conditions. A parsimonious predictor-corrector tracking

[1]  Claire J. Tomlin,et al.  Applications of hybrid reachability analysis to robotic aerial vehicles , 2011, Int. J. Robotics Res..

[2]  M. Micheli Random Sampling of a Continuous-time Stochastic Dynamical System: Analysis, State Estimation, and Applications , 2001 .

[3]  R. Sanfelice,et al.  Hybrid dynamical systems , 2009, IEEE Control Systems.

[4]  Paulo Tabuada,et al.  To Sample or not to Sample: Self-Triggered Control for Nonlinear Systems , 2008, IEEE Transactions on Automatic Control.

[5]  By Radha Poovendran Cyber – Physical Systems : Close Encounters Between Two Parallel Worlds , 2010 .

[6]  Rafael Fierro,et al.  A Multi-Vehicle Framework for the Development of Robotic Games: The Marco Polo Case , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[7]  Pavankumar Tallapragada,et al.  On event triggered trajectory tracking for control affine nonlinear systems , 2011, IEEE Conference on Decision and Control and European Control Conference.

[8]  Francesco Bullo,et al.  On Kalman Filtering for Detectable Systems With Intermittent Observations , 2009, IEEE Transactions on Automatic Control.

[9]  Märta Barenthin Syberg Complexity Issues, Validation and Input Design for Control in System Identification , 2008 .

[10]  Paulo Tabuada,et al.  Isochronous manifolds in self-triggered control , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[11]  Dragan Nesic,et al.  Input–Output Stability of Networked Control Systems With Stochastic Protocols and Channels , 2008, IEEE Transactions on Automatic Control.

[12]  Maurizio Porfiri,et al.  Tracking and formation control of multiple autonomous agents: A two-level consensus approach , 2007, Autom..

[13]  Silvia Ferrari,et al.  Information-Driven Sensor Path Planning by Approximate Cell Decomposition , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  Mor Harchol-Balter,et al.  Resource discovery in distributed networks , 1999, PODC '99.

[15]  Gerald Tesauro,et al.  Neurogammon: a neural-network backgammon program , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[16]  Jay H. Lee,et al.  Choice of approximator and design of penalty function for an approximate dynamic programming based control approach , 2006 .

[17]  Gerd Hirzinger,et al.  Energy-efficient Autonomous Four-rotor Flying Robot Controlled at 1 kHz , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[18]  Jun Zhao,et al.  Vector L2-gain and stability of feedback switched systems , 2009, Autom..

[19]  Jiejun Kong,et al.  The challenges of building mobile underwater wireless networks for aquatic applications , 2006, IEEE Network.

[20]  Chuandong Li,et al.  Stabilization of Nonlinear Systems via Periodically Intermittent Control , 2007, IEEE Transactions on Circuits and Systems II: Express Briefs.

[21]  Roman Obermaisser Time-Triggered Communication , 2009, Networked Embedded Systems.

[22]  Panos J. Antsaklis,et al.  Stability of Model-Based Networked Control Systems with Intermittent Feedback , 2009 .

[23]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[24]  Yasamin Mostofi,et al.  Communication-aware target tracking using navigation functions - Centralized case , 2009, 2009 Second International Conference on Robot Communication and Coordination.

[25]  John Lygeros,et al.  Lecture Notes on Hybrid Systems , 2004 .

[26]  P. Kokotovic,et al.  Sufficient conditions for stabilization of sampled-data nonlinear systems via discrete-time approximations , 1999 .

[27]  Longxin Lin Self-Improving Reactive Agents Based on Reinforcement Learning, Planning and Teaching , 2004, Machine Learning.

[28]  R. Fierro,et al.  Self-triggering in nonlinear systems: A small gain theorem approach , 2012, 2012 20th Mediterranean Conference on Control & Automation (MED).

[29]  Peng Yang,et al.  A General Stability Condition for Multi-Agent Coordination by Coupled Estimation and Control , 2007, 2007 American Control Conference.

[30]  Giuseppe Lipari,et al.  Schedulability Analysis of Global Scheduling Algorithms on Multiprocessor Platforms , 2009, IEEE Transactions on Parallel and Distributed Systems.

[31]  Rafael Fierro,et al.  A Geometric Optimization Approach to Detecting and Intercepting Dynamic Targets , 2007, 2007 American Control Conference.

[32]  Pedro M. Crespo,et al.  Asymptotically Equivalent Sequences of Matrices and Hermitian Block Toeplitz Matrices With Continuous Symbols: Applications to MIMO Systems , 2008, IEEE Transactions on Information Theory.

[33]  João Pedro Hespanha,et al.  A Survey of Recent Results in Networked Control Systems , 2007, Proceedings of the IEEE.

[34]  Orhan C. Imer,et al.  Optimal Estimation and Control Under Communication Network Constraints , 2005 .

[35]  Panos J. Antsaklis,et al.  Event-triggered real-time scheduling for stabilization of passive and output feedback passive systems , 2011, Proceedings of the 2011 American Control Conference.

[36]  Wilson J. Rugh,et al.  Linear system theory (2nd ed.) , 1996 .

[37]  Zhijun Tang Information-theoretic management of mobile sensor agents , 2005 .

[38]  Long Wang,et al.  Asynchronous Consensus in Continuous-Time Multi-Agent Systems With Switching Topology and Time-Varying Delays , 2006, IEEE Transactions on Automatic Control.

[39]  S. Hirche,et al.  Performance Oriented Control over Networks -- Switching Controllers and Switched Time Delay -- , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[40]  Panos J. Antsaklis,et al.  Optimal control of switched systems based on parameterization of the switching instants , 2004, IEEE Transactions on Automatic Control.

[41]  Vaughan R. Pratt,et al.  Direct least-squares fitting of algebraic surfaces , 1987, SIGGRAPH.

[42]  J. J. Garcia-Luna-Aceves,et al.  Link-state routing in networks with unidirectional links , 1999, Proceedings Eight International Conference on Computer Communications and Networks (Cat. No.99EX370).

[43]  Junliang Chen,et al.  Interacting Multiple Model Particle-type Filtering Approaches to Ground Target Tracking , 2008, J. Comput..

[44]  W. D. Jones,et al.  Keeping cars from crashing , 2001 .

[45]  Warren B. Powell,et al.  Approximate Dynamic Programming - Solving the Curses of Dimensionality , 2007 .

[46]  Philip Rabinowitz,et al.  Methods of Numerical Integration , 1985 .

[47]  A. Gelman Objections to Bayesian statistics , 2008 .

[48]  A. Morse,et al.  STABILITY OF SWITCHED SYSTEMS WITH AVERAGE , 1999 .

[49]  Frank L. Lewis,et al.  Autonomous Mobile Robots : Sensing, Control, Decision Making and Applications , 2006 .

[50]  J. Imae,et al.  L/sub 2/-gain computation for nonlinear systems using optimal control algorithms , 1996, Proceedings of 35th IEEE Conference on Decision and Control.

[51]  Brett M Bethke,et al.  Kernel-based approximate dynamic programming using Bellman residual elimination , 2010 .

[52]  Carlos Canudas de Wit,et al.  NONLINEAR CONTROL DESIGN FOR MOBILE ROBOTS , 1994 .

[53]  Wei Zhang Controller synthesis for switched systems using approximate dynamic programming , 2009 .

[54]  George J. Pappas,et al.  Distributed Hybrid Control for Multiple-Pursuer Multiple-Evader Games , 2007, HSCC.

[55]  Peter Seiler,et al.  Estimation with lossy measurements: jump estimators for jump systems , 2003, IEEE Trans. Autom. Control..

[56]  Daniel Liberzon,et al.  Switching in Systems and Control , 2003, Systems & Control: Foundations & Applications.

[57]  Hong Ye,et al.  Scheduling of networked control systems , 2001 .

[58]  Jonathan William Gillard,et al.  Circular and Linear Regression: Fitting Circles and Lines by Least Squares , 2011 .

[59]  Kelli A. Crews Baumgartner,et al.  Control and Optimization of Track Coverage in Underwater Sensor Networks , 2007 .

[60]  J. Imae,et al.  H ∞ norm computation for LTV systems using nonlinear optimal control algorithms , 1996 .

[61]  D. Baĭnov,et al.  Systems with impulse effect : stability, theory, and applications , 1989 .

[62]  January,et al.  A Tutorial on Bayesian Estimation and Tracking Techniques Applicable to Nonlinear and Non-Gaussian Processes , 2005 .

[63]  Ricardo G. Sanfelice,et al.  On the effect and robustness of zero-crossing detection algorithms in simulation of hybrid systems jumping on surfaces , 2012, 2012 American Control Conference (ACC).

[64]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[65]  Rafael Fierro,et al.  Adaptive sampling for tracking in pursuit-evasion games , 2011, 2011 IEEE International Symposium on Intelligent Control.

[66]  Richard S. Sutton,et al.  Dimensions of Reinforcement Learning , 1998 .

[67]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[68]  F. Daum Nonlinear filters: beyond the Kalman filter , 2005, IEEE Aerospace and Electronic Systems Magazine.

[69]  Michael D. Lemmon,et al.  Event-Triggered Feedback in Control, Estimation, and Optimization , 2010 .

[70]  Kristi A. Morgansen,et al.  Cooperative Estimation for Coordinated Target Tracking in a Cluttered Environment , 2009, Mob. Networks Appl..

[71]  Jorge Cortes,et al.  Self-triggered coordination of robotic networks for optimal deployment , 2012, Autom..

[72]  Simon Haykin,et al.  Neural Networks and Learning Machines , 2010 .

[73]  Randy A. Freeman,et al.  On the relationships between induced l∞-gain and various notions of dissipativity , 2004 .

[74]  Panos J. Antsaklis,et al.  On communication requirements for multi-agent consensus seeking , 2006 .

[75]  Arthur L. Samuel,et al.  Some Studies in Machine Learning Using the Game of Checkers , 1967, IBM J. Res. Dev..

[76]  R.M. Murray,et al.  Estimation for Nonlinear Dynamical Systems over Packet-Dropping Networks , 2007, 2007 American Control Conference.

[77]  Bart De Schutter,et al.  Reinforcement Learning and Dynamic Programming Using Function Approximators , 2010 .

[78]  Panos J. Antsaklis,et al.  Output Synchronization of Multi-Agent Systems with Event-Driven Communication : Communication Delay and Signal Quantization , 2011 .

[79]  Vassilios V. Dimakopoulos,et al.  A Peer-to-Peer Approach to Resource Discovery in Multi-agent Systems , 2003, CIA.

[80]  Vijay Kumar,et al.  Time scales and stability in networked multi-robot systems , 2011, 2011 IEEE International Conference on Robotics and Automation.

[81]  Lingfeng Wang,et al.  Tracking with Distributed Sets of Proximity Sensors using Geometric Invariants , 2004 .

[82]  Rangasami L. Kashyap,et al.  Multiple target tracking using maximum likelihood principle , 1995, IEEE Trans. Signal Process..

[83]  Joel W. Burdick,et al.  Multi-agent probabilistic search in a sequential decision-theoretic framework , 2008, 2008 IEEE International Conference on Robotics and Automation.

[84]  Gautam Biswas,et al.  Maximum likelihood detection with intermittent observations , 2009, 2009 43rd Annual Conference on Information Sciences and Systems.

[85]  Eduardo Sontag,et al.  Further Equivalences and Semiglobal Versions of Integral Input to State Stability , 1999, math/9908066.

[86]  Thai Son Hoang,et al.  Developing topology discovery in Event-B , 2009, Sci. Comput. Program..

[87]  Roger Wattenhofer,et al.  What Is the Use of Collision Detection (in Wireless Networks)? , 2010, DISC.

[88]  Dragan Nesic,et al.  Input-output stability properties of networked control systems , 2004, IEEE Transactions on Automatic Control.

[89]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[90]  Paulo Tabuada,et al.  Event-Triggered Real-Time Scheduling of Stabilizing Control Tasks , 2007, IEEE Transactions on Automatic Control.

[91]  Randal W. Beard,et al.  Distributed Consensus in Multi-vehicle Cooperative Control - Theory and Applications , 2007, Communications and Control Engineering.

[92]  Håkan Hjalmarsson,et al.  From experiment design to closed-loop control , 2005, Autom..

[93]  Peter Vamplew,et al.  Global Versus Local Constructive Function Approximation for On-Line Reinforcement Learning , 2005, Australian Conference on Artificial Intelligence.

[94]  Dragan Nesic,et al.  Stability Analysis of Hybrid Systems Via Small-Gain Theorems , 2006, HSCC.

[95]  Rafael Fierro,et al.  Cooperative multi-target tracking via hybrid modeling and geometric optimization , 2009, 2009 17th Mediterranean Conference on Control and Automation.

[96]  Nuno C. Martins Finite gain lp stabilization requires analog control , 2006, Syst. Control. Lett..

[97]  Gordon F. Royle,et al.  Algebraic Graph Theory , 2001, Graduate texts in mathematics.

[98]  Dragan Nesic,et al.  Stability of Wireless and Wireline Networked Control Systems , 2007, IEEE Transactions on Automatic Control.

[99]  Andrea Gasparri,et al.  Decentralized stabilization of heterogeneous linear multi-agent systems , 2010, 2010 IEEE International Conference on Robotics and Automation.

[100]  Raymond A. DeCarlo,et al.  Optimal control of switching systems , 2005, Autom..

[101]  Joel M. Esposito,et al.  Simulation and control of hybrid systems with applications to mobile robotics , 2002 .

[102]  A. Doucet,et al.  A Tutorial on Particle Filtering and Smoothing: Fifteen years later , 2008 .

[103]  Rafael Fierro,et al.  Stability of feedback linearization under intermittent information: A target-pursuit case , 2011, Proceedings of the 2011 American Control Conference.

[104]  E. Frazzoli,et al.  A hybrid control framework for robust maneuver-based motion planning , 2008, 2008 American Control Conference.

[105]  H. Blom An Efficient Decision-Making-Free Filter for Processes with Abrupt Changes , 1985 .

[106]  Volkan Isler,et al.  The role of information in the cop-robber game , 2008, Theor. Comput. Sci..

[107]  Venkatesh Saligrama,et al.  Reliable Tracking With Intermittent Communications , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[108]  Andrei Szabo,et al.  Performance comparison of nonlinear filters for indoor WLAN positioning , 2008, 2008 11th International Conference on Information Fusion.

[109]  Karl Henrik Johansson,et al.  Distributed event-based control for interconnected linear systems , 2011, IEEE Conference on Decision and Control and European Control Conference.

[110]  A. Rantzer,et al.  Optimal control of hybrid systems , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[111]  Geoffrey J. Gordon Stable Function Approximation in Dynamic Programming , 1995, ICML.

[112]  Daniel W. C. Ho,et al.  Variance-constrained filtering for uncertain stochastic systems with missing measurements , 2003, IEEE Trans. Autom. Control..

[113]  Meeko Oishi,et al.  User-Interfaces for Hybrid Systems: Analysis and Design through Hybrid Reachability , 2003 .

[114]  Charles W. Therrien,et al.  Probability and Random Processes for Electrical and Computer Engineers , 2011 .

[115]  Camillo J. Taylor,et al.  A vision-based formation control framework , 2002, IEEE Trans. Robotics Autom..

[116]  Sandra Hirche,et al.  A distributed controller approach for delay-independent stability of networked control systems , 2009, Autom..

[117]  Stephen P. Boyd,et al.  Min-max approximate dynamic programming , 2011, 2011 IEEE International Symposium on Computer-Aided Control System Design (CACSD).

[118]  Geoffrey A. Hollinger,et al.  Multi-robot coordination with periodic connectivity , 2010, 2010 IEEE International Conference on Robotics and Automation.