Vision-Based Human Directed Robot Guidance

VISION-BASED HUMAN DIRECTED ROBOT GUIDANCE Richard B. Arthur Department of Computer Science Master of Science This paper describes methods to track a user-defined point in the vision of a robot as it drives forward. This tracking allows a robot to keep itself directed at that point while driving so that it can get to that user-defined point. I develop and present two new multi-scale algorithms for tracking arbitrary points between two frames of video, as well as through a video sequence. The multi-scale algorithms do not use the traditional pyramid image, but instead use a data structure called an integral image (also known as a summed area table). The first algorithm uses edge-detection to track the movement of the tracking point between frames of video. The second algorithm uses a modified version of the Moravec operator to track the movement of the tracking point between frames of video. Both of these algorithms can track the user-specified point very quickly. Implemented on a conventional desktop, tracking can proceed at a rate of at least 20 frames per second.

[1]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[2]  Yoram Koren,et al.  The vector field histogram-fast obstacle avoidance for mobile robots , 1991, IEEE Trans. Robotics Autom..

[3]  E. Malis,et al.  2 1/2 D Visual Servoing , 1999 .

[4]  Keiji Nagatani,et al.  Topological simultaneous localization and mapping (SLAM): toward exact localization without explicit localization , 2001, IEEE Trans. Robotics Autom..

[5]  Geok Soon Hong,et al.  A pragmatic 3D visual servoing system , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[6]  Yoram Koren,et al.  Real-time obstacle avoidance for fact mobile robots , 1989, IEEE Trans. Syst. Man Cybern..

[7]  Y.D. Kwon,et al.  An obstacle avoidance algorithm for mobile robot: the improved weighted safety vector field method , 1995, Proceedings of Tenth International Symposium on Intelligent Control.

[8]  Javier Minguez,et al.  Nearness diagram navigation (ND): a new real time collision avoidance approach , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[9]  Robert E. Mahony,et al.  Visual servoing using linear features for under-actuated rigid body dynamics , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[10]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[11]  François Chaumette,et al.  2½D visual servoing , 1999, IEEE Trans. Robotics Autom..

[12]  Sherman Y. T. Lang,et al.  Visual correction of orientation error for a mobile robot , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[13]  Yangquan Chen,et al.  Visual servoing of an omni-directional mobile robot for alignment with parking lot lines , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[14]  Ian D. Reid,et al.  Steering and Navigation Behaviours Using Fixation , 1996, BMVC.

[15]  Andrew E. Johnson,et al.  Machine vision for autonomous small body navigation , 2000, 2000 IEEE Aerospace Conference. Proceedings (Cat. No.00TH8484).

[16]  S P Levine,et al.  The NavChair Assistive Wheelchair Navigation System. , 1999, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[17]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[18]  Andrew J. Davison,et al.  Mobile Robot Navigation Using Active Vision , 1998 .

[19]  Yasushi Yagi,et al.  Evaluating effectivity of map generation by tracking vertical edges in omnidirectional image sequence , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[20]  Javier González,et al.  Two-dimensional landmark-based position estimation from a single image , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[21]  Avinash C. Kak,et al.  Vision-based navigation by a mobile robot with obstacle avoidance using single-camera vision and ultrasonic sensing , 1998, IEEE Trans. Robotics Autom..

[22]  Koren,et al.  Real-Time Obstacle Avoidance for Fast Mobile Robots , 2022 .

[23]  Philippe Martinet,et al.  Stacking Jacobians properly in stereo visual servoing , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[24]  Hans P. Moravec.  Obstacle avoidance and navigation in the real world by a seeing robot rover , 1980 .

[25]  Jens-Steffen Gutmann,et al.  Model-based object tracking using stereo vision , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[26]  Ian D. Reid,et al.  Real-time Visual Recovery of Pose using Line Tracking in Multiple Cameras , 1998, BMVC.

[27]  Vicente Matellán Olivera,et al.  Implementing Human-Acceptable Navigational Behavior and a Fuzzy Controller for an Autonomous Robot , 2001 .

[28]  Karim Faez,et al.  Fast edge-based stereo matching algorithm based on search space reduction , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[29]  Henrik I. Christensen,et al.  Laser based pose tracking , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[30]  Vijay Kumar,et al.  Real-time vision-based control of a nonholonomic mobile robot , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[31]  Radu Horaud,et al.  Visual Servoing from Lines , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[32]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[33]  Terrence Fong,et al.  Multi-robot remote driving with collaborative control , 2003, IEEE Trans. Ind. Electron..

[34]  K. Achour,et al.  A multiscale stereovision algorithm for a mobile robot , 1998, IECON '98. Proceedings of the 24th Annual Conference of the IEEE Industrial Electronics Society (Cat. No.98CH36200).

[35]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[36]  F. Miyazaki,et al.  Visual servoing for non-holonomic mobile robots , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[37]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .