A Hybrid Controller for Vision-Based Navigation of Autonomous Vehicles in Urban Environments

This paper presents a new hybrid control approach for vision-based navigation applied to autonomous robotic automobiles in urban environments. It is composed by a visual servoing (VS) for road lane following (as deliberative control) and a dynamic window approach (DWA) for obstacle avoidance (as reactive control). Typically, VS applications do not change the velocities to stop the robot in dangerous situations or avoid obstacles while performing the navigation task. However, in several urban conditions, these are elements that must be dealt with to guarantee the safe movement of the car. As a solution for this problem, in this paper, a line-following VS controller will be used to perform road lane following tasks with obstacle avoidance, validating its control outputs in a new image-based dynamic window approach (IDWA). The final solution combines the benefits of both controllers (VS+IDWA) for optimal lane following and fast obstacle avoidance, taking into account the car kinematics and some dynamics constraints. Experiments in a challenging scenario with both simulated and real experimental car show the viability of the proposed methodology.

[1]  Michael Himmelsbach,et al.  Driving with Tentacles - Integral Structures for Sensing and Motion , 2008, The DARPA Urban Challenge.

[2]  François Chaumette,et al.  Potential problems of stability and convergence in image-based and position-based visual servoing , 1997 .

[3]  Patrick Rives,et al.  Visual servoing based on epipolar geometry , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[4]  Julius Ziegler,et al.  Making Bertha Drive—An Autonomous Journey on a Historic Route , 2014, IEEE Intelligent Transportation Systems Magazine.

[5]  David Folio,et al.  A redundancy-based scheme to perform safe vision-based tasks amidst obstacles , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[6]  Roland Siegwart,et al.  Real-time obstacle avoidance for polygonal robots with a reduced dynamic window , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[7]  Patrick Rives,et al.  Visual servoing over unknown, unstructured, large-scale scenes , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[8]  Peter I. Corke,et al.  Visual servoing of a car-like vehicle - an application of omnidirectional vision , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[9]  Francisco Bonin-Font,et al.  Visual Navigation for Mobile Robots: A Survey , 2008, J. Intell. Robotic Syst..

[10]  E. Malis,et al.  2 1/2 D Visual Servoing , 1999 .

[11]  Philippe Souères,et al.  A controller to perform a visually guided tracking task in a cluttered environment , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[12]  Michael Himmelsbach,et al.  Driving with tentacles: Integral structures for sensing and motion , 2008 .

[13]  Philippe Martinet,et al.  Autonomous Navigation of Vehicles from a Visual Memory Using a Generic Camera Model , 2009, IEEE Transactions on Intelligent Transportation Systems.

[14]  Danilo Alves de Lima,et al.  Autonomous vehicle global navigation approach associating sensor based control and digital maps , 2014, 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO 2014).

[15]  Danilo Alves de Lima,et al.  An image based dynamic window approach for local navigation of an autonomous vehicle in urban environments , 2014, ICRA 2014.

[16]  Sukhan Lee,et al.  Automatic lane following with a single camera , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[17]  Andrea Cherubini,et al.  Visual navigation of a mobile robot with laser-based collision avoidance , 2013, Int. J. Robotics Res..

[18]  Attawith Sudsang,et al.  Robust local obstacle avoidance for mobile robot based on Dynamic Window approach , 2013, 2013 10th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology.

[19]  Francois Chaumette,et al.  Potential problems of unstability and divergence in image-based and position-based visual servoing , 1999, 1999 European Control Conference (ECC).

[20]  Ivan Petrovic,et al.  Dynamic window based approach to mobile robot motion control in the presence of moving obstacles , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[21]  Giuseppe Oriolo,et al.  Visual servoing for path reaching with nonholonomic robots , 2011, Robotica.

[22]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[23]  Sanjiv Singh,et al.  Editorial : [for the Special issue on the 2007 DARPA Urban Challenge, Part I] , 2008 .

[24]  Ouahiba Azouaoui,et al.  Car-like robot navigation at high speed , 2007, 2007 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[25]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[26]  Danilo Alves de Lima,et al.  A Visual Servoing approach for road lane following with obstacle avoidance , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[27]  Alberto Elfes,et al.  Using occupancy grids for mobile robot perception and navigation , 1989, Computer.

[28]  Andrea Cherubini,et al.  Autonomous Visual Navigation and Laser-Based Moving Obstacle Avoidance , 2014, IEEE Transactions on Intelligent Transportation Systems.

[29]  Patrick Rives,et al.  HIGH-SPEED VEHICLE GUIDANCE BASED ON VISION , 1993 .

[30]  Danilo Alves de Lima,et al.  Navigation of an Autonomous Car Using Vector Fields and the Dynamic Window Approach , 2013 .

[31]  Wolfram Burgard,et al.  The dynamic window approach to collision avoidance , 1997, IEEE Robotics Autom. Mag..

[32]  Sanjiv Singh,et al.  Editorial : [Special issue on the 2007 DARPA Urban Challenge, Part II] , 2008 .

[33]  Oliver Brock,et al.  High-speed navigation using the global dynamic window approach , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[34]  Giuseppe Oriolo,et al.  An image-based visual servoing scheme for following paths with nonholonomic mobile robots , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.