Autonomous Vehicles Navigation with Visual Target Tracking: Technical Approaches

This paper surveys the developments of last 10 years in the area of vision based target tracking for autonomous vehicles navigation. First, the motivations and applications of using vision based target tracking for autonomous vehicles navigation are presented in the introduction section. It can be concluded that it is very necessary to develop robust visual target tracking based navigation algorithms for the broad applications of autonomous vehicles. Then this paper reviews the recent techniques in three different categories: vision based target tracking for the applications of land, underwater and aerial vehicles navigation. Next, the increasing trends of using data fusion for visual target tracking based autonomous vehicles navigation are discussed. Through data fusion the tracking performance is improved and becomes more robust. Based on the review, the remaining research challenges are summarized and future research directions are investigated.

[1]  Kiichiro Izumida,et al.  A combination of monocular CCD camera and inertial-sensor for range estimation , 2002, IEEE 2002 28th Annual Conference of the Industrial Electronics Society. IECON 02.

[2]  P.J. Escamilla-Ambrosio,et al.  A multiple-sensor multiple-target tracking approach for the autotaxi system , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[3]  Hideki Hashimoto,et al.  Physical agent for human following in intelligent sensor network , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  S. Shankar Sastry,et al.  LANDING AN UNMANNED AIR VEHICLE: VISION BASED MOTION ESTIMATION AND NONLINEAR CONTROL , 1999 .

[5]  Jun Wang,et al.  Obstacle avoidance for kinematically redundant manipulators using a dual neural network , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[6]  Patrick Rives,et al.  Underwater pipe inspection task using visual servoing techniques , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[7]  Y. Dube,et al.  An Autonomous Mobile Robot , 1992, Singapore International Conference on Intelligent Control and Instrumentation [Proceedings 1992].

[8]  Myung Hwangbo,et al.  Visual self-localization for indoor mobile robots using natural lines , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[9]  Henrik Karlsson,et al.  Robust and efficient tracking in image sequences using a Kalman filter and an affine motion model , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Wolfram Burgard,et al.  Using the CONDENSATION algorithm for robust, vision-based mobile robot localization , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[11]  Zhihua Qu,et al.  A new analytical solution to mobile robot trajectory generation in the presence of moving obstacles , 2004, IEEE Transactions on Robotics.

[12]  Kiichiro Izumida,et al.  The use of CNN models and vertical rectification for a direct trigonometric recovery of 3D scene geometry from a stream of images , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[13]  Avinash C. Kak,et al.  Person Tracking with a Mobile Robot using Two Uncalibrated Independently Moving Cameras , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[14]  Krzysztof Skrzypczyk.  Game theory based target following by a team of robots , 2004, Proceedings of the Fourth International Workshop on Robot Motion and Control (IEEE Cat. No.04EX891).

[15]  Ren C. Luo,et al.  Multisensor fusion and integration: approaches, applications, and future research directions , 2002 .

[16]  Bruno Sinopoli,et al.  Vision based navigation for an unmanned aerial vehicle , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[17]  Tamaki Ura,et al.  Underwater robots for cable following , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[18]  Masayuki Inaba,et al.  Online humanoid walking control system and a moving goal tracking experiment , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[19]  Gerard Leng,et al.  Coordinated movement of multiple robots for searching a cluttered environment , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[20]  Gaurav S. Sukhatme,et al.  Towards vision-based safe landing for an autonomous helicopter , 2002, Robotics Auton. Syst..

[21]  Gaurav S. Sukhatme,et al.  Vision-based autonomous landing of an unmanned aerial vehicle , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[22]  S. Shankar Sastry,et al.  A vision system for landing an unmanned aerial vehicle , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[23]  Petter Ögren,et al.  A convergent dynamic window approach to obstacle avoidance , 2005, IEEE Transactions on Robotics.

[24]  Tzuu-Hseng S. Li,et al.  Fuzzy target tracking control of autonomous mobile robots by using infrared sensors , 2004, IEEE Transactions on Fuzzy Systems.

[25]  Avinash C. Kak,et al.  Vision for Mobile Robot Navigation: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Gregory R. Scholz,et al.  Profile sensing with an actuated whisker , 2004, IEEE Transactions on Robotics and Automation.

[27]  Fumio Miyazaki,et al.  GAG (gaining angle of gaze) strategy for ball tracking and catching task , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Saburo Tsuji,et al.  Finding landmarks autonomously along a route , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[29]  Gaurav S. Sukhatme,et al.  Visually guided landing of an unmanned aerial vehicle , 2003, IEEE Trans. Robotics Autom..

[30]  In-So Kweon,et al.  Color landmark based self-localization for indoor mobile robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[31]  Darius Burschka,et al.  Principles and practice of real-time visual tracking for navigation and mapping , 2004, International Workshop on Robot Sensing, 2004. ROSE 2004..

[32]  Sylvie Treuillet,et al.  A biprocessor-oriented vision-based target tracking system , 2002, IEEE Trans. Ind. Electron..

[33]  S.X. Yang,et al.  A neural network approach to complete coverage path planning , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[34]  Subhash Challa,et al.  Recent Developments in Vision Based Target Tracking for Autonomous Vehicles Navigation , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[35]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[36]  Héctor H. González-Baños,et al.  Real-time tracking of an unpredictable target amidst unknown obstacles , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..

[37]  Edward Grant,et al.  Passive sonar applications: target tracking and navigation of an autonomous robot , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[38]  Gregory Dudek,et al.  Mobile robot localization from learned landmarks , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[39]  Kouhei Ohnishi,et al.  Human cooperative wheelchair for haptic interaction based on dual compliance control , 2004, IEEE Transactions on Industrial Electronics.

[40]  Rafael Murrieta-Cid,et al.  Landmark identification and tracking in natural environment , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[41]  A. Betser,et al.  Automatic tracking of flying vehicles using geodesic snakes and Kalman filtering , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[42]  Pedro U. Lima,et al.  Avoiding obstacles - multisensor navigation for nonholonomic robots in cluttered environments , 2004, IEEE Robotics & Automation Magazine.

[43]  Tieniu Tan,et al.  Efficient image gradient based vehicle localization , 2000, IEEE Trans. Image Process..

[44]  Avinash C. Kak,et al.  Vision-guided mobile robot navigation using retroactive updating of position uncertainty , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[45]  Tzila Shamir,et al.  How should an autonomous vehicle overtake a slower moving vehicle: design and analysis of an optimal trajectory , 2004, IEEE Transactions on Automatic Control.

[46]  Hugh F. Durrant-Whyte,et al.  Simultaneous Localization, Mapping and Moving Object Tracking , 2007, Int. J. Robotics Res..

[47]  Héctor H. González-Baños,et al.  Real-time combinatorial tracking of a target moving unpredictably among obstacles , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[48]  Manuel Mazo,et al.  Multi-robot tracking of a moving object using directional sensors , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[49]  Florent Lamiraux,et al.  Reactive path deformation for nonholonomic mobile robots , 2004, IEEE Transactions on Robotics.

[50]  Charles E. Thorpe,et al.  Simultaneous localization and mapping with detection and tracking of moving objects , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[51]  Gaurav S. Sukhatme,et al.  A region-based approach for cooperative multi-target tracking in a structured environment , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[52]  Yoshiaki Shirai,et al.  Two-hand gesture recognition using coupled switching linear model , 2002, Object recognition supported by user interaction for service robots.

[53]  Junzhi Yu,et al.  A parallel algorithm for visual tracking of multiple free-swimming robot fishes based on color information , 2003, IEEE International Conference on Robotics, Intelligent Systems and Signal Processing, 2003. Proceedings. 2003.

[54]  Christoph Stiller,et al.  Fusing optical flow and stereo disparity for object tracking , 2002, Proceedings. The IEEE 5th International Conference on Intelligent Transportation Systems.

[55]  Charles M. Higgins,et al.  A biomimetic VLSI sensor for visual tracking of small moving targets , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[56]  Rolf Dieter Schraft,et al.  Mobile robot assistants , 2004, IEEE Robotics & Automation Magazine.

[57]  Bir Bhanu,et al.  Multistrategy fusion using mixture model for moving object detection , 2001, Conference Documentation International Conference on Multisensor Fusion and Integration for Intelligent Systems. MFI 2001 (Cat. No.01TH8590).

[58]  Masahiro Tomono.  Path planning with target finding by single camera under map uncertainty , 2003, Proceedings 2003 IEEE International Symposium on Computational Intelligence in Robotics and Automation. Computational Intelligence in Robotics and Automation for the New Millennium (Cat. No.03EX694).

[59]  Fan. Yang.  Vision-based target tracking and navigation system for autonomous underwater vehicles , 2002 .

[60]  Balasuriya B.A.A.P.  Computer vision for autonomous underwater vehicle navigation , 1998 .

[61]  Antonio Marín-Hernández,et al.  Collaborative tracking for robotic tasks , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[62]  Joo Kooi Tan,et al.  Real-time human motion recognition by aerial robot , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[63]  Robert E. Mahony,et al.  A bearing-only control law for stable docking of unicycles , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[64]  Kunikatsu Takase,et al.  Robust tracking for camera control on an irregular terrain vehicle , 2002, Proceedings of the 41st SICE Annual Conference. SICE 2002..

[65]  Cyril Cauchois,et al.  Mobile robot localization based on multi target tracking , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[66]  A. Shirkhodaie,et al.  Cooperative visual team working and target tracking of mobile robots , 2002, Proceedings of the Thirty-Fourth Southeastern Symposium on System Theory (Cat. No.02EX540).

[67]  Peter Wall,et al.  Mobile robot navigation using self-similar landmarks , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[68]  Darius Burschka,et al.  Scene classification from dense disparity maps in indoor environments , 2002, Object recognition supported by user interaction for service robots.

[69]  Subhash Challa,et al.  Visual Information and Camera Motion Fusion for 3D Target Tracking , 2004 .

[70]  Hideki Hashimoto,et al.  Human-following mobile robot in a distributed intelligent sensor network , 2004, IEEE Transactions on Industrial Electronics.

[71]  Hiroshi Mizoguchi,et al.  Visual tracking of human back and shoulder for person following robot , 2003, Proceedings 2003 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM 2003).

[72]  S. Shankar Sastry,et al.  Multiple view motion estimation and control for landing an unmanned aerial vehicle , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[73]  Alejandro Sarmiento,et al.  On the existence of a strategy to maintain a moving target within the sensing range of an observer reacting with delay , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[74]  R. Rysdyk,et al.  Flight path following guidance for unmanned air vehicles with pan-tilt camera for target observation , 2003, Digital Avionics Systems Conference, 2003. DASC '03. The 22nd.

[75]  Yaakov Bar-Shalom,et al.  Update with out-of-sequence measurements in tracking: exact solution , 2000, SPIE Defense + Commercial Sensing.

[76]  Ming Yang,et al.  Real-time vision based ego-motion estimation for outdoor mobile robot , 2004, Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No.04EX788).

[77]  Kodagoda Ranadheera Sarath Kodagoda.,et al.  Multi-sensor integration and fusion in mobile robot navigation. , 2004 .

[78]  Kazuyuki Morioka,et al.  Physical distance based human robot interaction in intelligent environment , 2002, IEEE 2002 28th Annual Conference of the Industrial Electronics Society. IECON 02.

[79]  Roland Siegwart,et al.  The interactive autonomous mobile system RoboX , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[80]  Shuji Hashimoto,et al.  Real-time vision system for autonomous mobile robot , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[81]  Yuan Kui,et al.  A fast and robust vision system for autonomous mobile robots , 2003, IEEE International Conference on Robotics, Intelligent Systems and Signal Processing, 2003. Proceedings. 2003.

[82]  Gaurav S. Sukhatme,et al.  Landing on a Moving Target Using an Autonomous Helicopter , 2003, FSR.