Omnidirectional Vision for Mobile Robot Navigation

Machine vision has been widely studied, leading to the discovery of many image-processing and identification techniques. Together with this, rapid advances in computer processing speed have triggered a growing need for vision sensor data and faster robot response. In considering omnidirectional camera use in machine vision, we have studied omnidirectional image features in depth to determine correlation between parameters and ways to flatten 3-dimensional images into 2 dimensions. We also discuss ways to process omnidirectional images based on their individual features.

[1]  Yasushi Yagi,et al.  Stabilization for mobile robot by using omnidirectional optical flow , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[2]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[4]  J. Gaspar,et al.  Omni-directional vision for robot navigation , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[5]  Saburo Tsuji,et al.  Panoramic representation for route recognition by a mobile robot , 1992, International Journal of Computer Vision.

[6]  David G. Lowe,et al.  Robust model-based motion tracking through the integration of search and estimation , 1992, International Journal of Computer Vision.

[7]  Hans-Hellmut Nagel,et al.  Model-based object tracking in monocular image sequences of road traffic scenes , 1993, International Journal of Computer 11263on.

[8]  Clark F. Olson,et al.  View-Based Recognition Using an Eigenspace Approximation to the Hausdorff Measure , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Edward M. Riseman,et al.  Image-based homing , 1991, IEEE Control Systems.

[10]  Shree K. Nayar,et al.  Generation of Perspective and Panoramic Video from Omnidirectional Video , 1997 .

[11]  Alexandre Bernardino,et al.  Vision Algorithms for OMNIVIEWS Cameras , 2001 .

[12]  Winston Nelson,et al.  Continuous-curvature paths for autonomous vehicles , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[13]  Jean-Paul Laumond,et al.  Primitives for smoothing mobile robot trajectories , 1995, IEEE Trans. Robotics Autom..

[14]  Shree K. Nayar,et al.  Stereo with mirrors , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[15]  J. Stephen Judd,et al.  A robust landmark-based system for vehicle location using low-bandwidth vision , 1998, Robotics Auton. Syst..

[16]  Giulio Sandini,et al.  Visual Behaviors for Docking , 1997, Comput. Vis. Image Underst..

[17]  Ruzena Bajcsy,et al.  Catadioptric sensors that approximate wide-angle perspective projections , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[18]  Roberto Cipolla,et al.  Automatic 3D Modelling of Architecture , 2000, BMVC.

[19]  David J. Kriegman,et al.  Structure and Motion from Line Segments in Multiple Images , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Anna Kochan.  HelpMate to ease hospital delivery and collection tasks, and assist with security , 1997 .

[21]  J. Okamoto,et al.  Constant resolution omnidirectional cameras , 2002, Proceedings of the IEEE Workshop on Omnidirectional Vision 2002. Held in conjunction with ECCV'02.

[22]  Dariu Gavrila,et al.  Real-time object detection for "smart" vehicles , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[23]  Minas E. Spetsakis,et al.  Structure from motion using line correspondences , 1990, International Journal of Computer Vision.

[24]  Naokazu Yokoya,et al.  Memory-based self-localization using omnidirectional images , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[25]  Czech Technical,et al.  Mirror Design for an Omnidirectional Camera with a Uniform Cylindrical Projection when Using the SVAVISCA Sensor , 2001 .

[26]  I. Reid,et al.  Single view metrology , 1999, ICCV 1999.

[27]  Illah R. Nourbakhsh,et al.  Appearance-based place recognition for topological localization , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[28]  Antonio Criminisi,et al.  Creating Architectural Models from Images , 1999, Comput. Graph. Forum.

[29]  Avinash C. Kak,et al.  Fast vision-guided mobile robot navigation using model-based reasoning and prediction of uncertainties , 1992, CVGIP Image Underst..

[30]  Claus B. Madsen,et al.  Optimal landmark selection for triangulation of robot position , 1998, Robotics Auton. Syst..

[31]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[32]  J. Aloimonos,et al.  Finding motion parameters from spherical motion fields (or the advantages of having eyes in the back of your head) , 1988, Biological Cybernetics.

[33]  Stephen J. Maybank,et al.  A Method for Interactive 3D Reconstruction of Piecewise Planar Objects from Single Images , 1999, BMVC.

[34]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[35]  Tarak Gandhi,et al.  Driver's view and vehicle surround estimation using omnidirectional video stream , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[36]  O. Cuisenaire.  Distance transformations: fast algorithms and applications to medical image processing , 1999 .

[37]  Kostas Daniilidis,et al.  A Unifying Theory for Central Panoramic Systems and Practical Applications , 2000, ECCV.

[38]  Shigang Li,et al.  Qualitative representation of outdoor environment along route , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[39]  Roberto Cipolla,et al.  An Interactive System for Constraint-Based Modelling , 2000, British Machine Vision Conference.

[40]  James L. Crowley,et al.  Appearance based processes for visual navigation , 1997 .

[41]  Benjamin Kuipers,et al.  Modeling Spatial Knowledge , 1978, IJCAI.

[42]  F. E. Peters,et al.  DIOCLES, On Burning Mirrors: The Arabic Translation of the Lost Greek Original , 2012 .

[43]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[44]  John B. Moore,et al.  Resolution invariant surfaces for panoramic vision systems , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[45]  José Santos-Victor,et al.  Vision-based navigation and environmental representations with an omnidirectional camera , 2000, IEEE Trans. Robotics Autom..

[46]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[47]  David W. Murray,et al.  Mobile Robot Localisation Using Active Vision , 1998, ECCV.

[48]  Shree K. Nayar,et al.  A theory of catadioptric image formation , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[49]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[50]  Shree K. Nayar,et al.  Folded catadioptric cameras , 1999, CVPR 1999.

[51]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[52]  Selim Benhimane,et al.  A new approach to vision-based robot control with omni-directional cameras , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[53]  Gerd Hirzinger,et al.  Real-time visual tracking of 3D objects with dynamic handling of occlusion , 1997, Proceedings of International Conference on Robotics and Automation.

[54]  Jana Kosecka.  Visually guided navigation , 1997, Robotics Auton. Syst..

[55]  Maja J. Mataric,et al.  The Robotics Primer , 2007 .

[56]  Hiroshi Ishiguro,et al.  Representing environment through target-guided navigation , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[57]  Richard Szeliski,et al.  3-D Scene Data Recovery Using Omnidirectional Multibaseline Stereo , 2004, International Journal of Computer Vision.

[58]  Y. Kanayama,et al.  Smooth Local Path Planning for Autonomous Vehicles , 1990, Autonomous Robot Vehicles.

[59]  Olivier Faugeras,et al.  Building a 3D world model with a mobile robot: 3D line segment representation and integration , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[60]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[61]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[62]  B. Caprile,et al.  Using vanishing points for camera calibration , 1990, International Journal of Computer Vision.

[63]  Gunilla Borgefors,et al.  Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[64]  Avinash C. Kak,et al.  Vision for Mobile Robot Navigation: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[65]  José Santos-Victor,et al.  OMNIVIEWS Mirror Design and Software Tools , 2001 .

[66]  Donald B. Gennery,et al.  Visual tracking of known three-dimensional objects , 1992, International Journal of Computer Vision.

[67]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[68]  José Santos-Victor,et al.  Topological Maps for Visual Navigation , 1999, ICVS.

[69]  Ehud Rivlin,et al.  Localization and Homing Using Combinations of Model Views , 1995, Artif. Intell..

[70]  José Gaspar,et al.  Visual Path Following with a Catadioptric Panoramic Camera , 1999 .

[71]  S. Wehner,et al.  Insect navigation: use of maps or Ariadne's thread ? , 1990 .

[72]  M. Srinivasan,et al.  Range estimation with a panoramic visual sensor , 1997 .

[73]  Yiannis Aloimonos,et al.  Ambiguity in Structure from Motion: Sphere versus Plane , 1998, International Journal of Computer Vision.

[74]  Hiroshi Ishiguro,et al.  Image-based memory of environment , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[75]  Patrick Bouthemy,et al.  Active Camera Self-orientation using Dynamic Image Parameters , 1994, ECCV.

[76]  William Rucklidge,et al.  Efficient Visual Recognition Using the Hausdorff Distance , 1996, Lecture Notes in Computer Science.

[77]  Hugh F. Durrant-Whyte,et al.  Mobile robot localization by tracking geometric beacons , 1991, IEEE Trans. Robotics Autom..

[78]  Peter F. Sturm,et al.  Critical motion sequences for monocular self-calibration and uncalibrated Euclidean reconstruction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[79]  Margrit Betke,et al.  Mobile robot localization using landmarks , 1997, IEEE Trans. Robotics Autom..

[80]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[81]  Hiroshi Murase,et al.  Visual learning and recognition of 3-d objects from appearance , 2005, International Journal of Computer Vision.

[82]  Giulio Sandini,et al.  Divergent stereo in autonomous navigation: From bees to robots , 1995, International Journal of Computer Vision.

[83]  Yasushi Yagi,et al.  Building local floor map by use of ultrasonic and omni-directional vision sensor , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[84]  Václav Hlavác,et al.  Zero Phase Representation of Panoramic Images for Image Vased Localization , 1999, CAIP.

[85]  Shree K. Nayar,et al.  Ego-motion and omnidirectional cameras , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[86]  Masayuki Inaba,et al.  Visual navigation using view-sequenced route representation , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[87]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[88]  Ernest L. Hall,et al.  Guidance Of A Mobile Robot Using An Omnidirectional Vision Navigation System , 1987, Other Conferences.