Leader-Follower Formations: Uncalibrated Vision-Based Localization and Control

This paper focuses on leader-follower formations of mobile robots equipped with panoramic cameras and extend earlier works in the literature addressing both the vision-based localization and control problems. First, a new sufficient analytical condition for localizability is proved and used to shed light on the geometrical meaning of formation localization using uncalibrated vision sensors, here performed with the unscented Kalman filter. Second, we design a feedback control law based on dynamic extension in order to extend the applicability of our control scheme also to the case of distant robots.

[1]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[2]  A. Krener,et al.  Nonlinear controllability and observability , 1977 .

[3]  J. Descusse,et al.  Decoupling with Dynamic Compensation for Strong Invertible Affine Non Linear Systems , 1985 .

[4]  Arjan van der Schaft,et al.  Non-linear dynamical control systems , 1990 .

[5]  Antonio Bicchi,et al.  On the observability of mobile vehicles localization , 1998 .

[6]  B. Ghosh,et al.  Observability of perspective dynamical systems , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[7]  A. Bicchi,et al.  Observability and Nonlinear Observers for Mobile Robot Localization 1 , 2000 .

[8]  Pradeep K. Khosla,et al.  Localization techniques for a team of small robots , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[9]  Camillo J. Taylor,et al.  A vision-based formation control framework , 2002, IEEE Trans. Robotics Autom..

[10]  J. Hespanha.  State estimation and control for systems with perspective outputs , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[11]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[12]  Jeffrey K. Uhlmann,et al.  Unscented filtering and nonlinear estimation , 2004, Proceedings of the IEEE.

[13]  S. Shankar Sastry,et al.  Following the flock [formation control] , 2004, IEEE Robotics & Automation Magazine.

[14]  Gaurav S. Sukhatme,et al.  Ad-hoc localization using ranging and sectoring , 2004, IEEE INFOCOM 2004.

[15]  René Vidal,et al.  Distributed Formation Control with Omnidirectional Vision-Based Motion Segmentation and Visual Servoing , 2004 .

[16]  A. D. Lewis,et al.  Geometric Control of Mechanical Systems , 2004, IEEE Transactions on Automatic Control.

[17]  Francesco Bullo,et al.  Simple mechanical control systems , 2005 .

[18]  George J. Pappas,et al.  Vision-based Localization of Leader-Follower Formations , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[19]  H. Musoff,et al.  Unscented Kalman Filter , 2015 .

[20]  Nahum Shimkin,et al.  Nonlinear Control Systems , 2008 .