Spatio-temporal bird's-eye view images using multiple fish-eye cameras

In camera images for urban search and rescue (USAR) robots teleoperation, it is important to reduce blind spots and get surroundings as much as possible because of safety requirements. We propose a method to create synthesized bird's-eye view images from multiple fish-eye cameras as spatiotemporal data which can reduce blind spots. In practical use, it is very important to get images robustly even when some troubles such as camera broken and network disturbances occur. This method develops showing bird's-eye view images robustly even if some of images are not acquired by compensating past stored spatio-temporal data to these images. Effectiveness of the proposed method is verified through experiments.

[1]  Evangelos E. Milios,et al.  Robot Pose Estimation in Unknown Environments by Matching 2D Range Scans , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[2]  S. Ali A. Moosavian,et al.  Design and Manufacturing of a Mobile Rescue Robot , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Hiroshi Yamada,et al.  Wraparound View System for Motor Vehicles , 2010 .

[4]  Claude Sammut,et al.  Effective user interface design for rescue robotics , 2006, HRI '06.

[5]  Satoshi Tadokoro,et al.  Rescue robotics challenge , 2010, 2010 IEEE Workshop on Advanced Robotics and its Social Impacts.

[6]  Thomas B. Sheridan Teleoperation, Telerobotics, and Telepresence: A Progress Report , 1992 .

[7]  Seiga Kiribayashi,et al.  Redesign of rescue mobile robot Quince , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[8]  F. Matsuno,et al.  A teleoperation interface using past images for outdoor environment , 2008, 2008 SICE Annual Conference.

[9]  Seiga Kiribayashi,et al.  Redesign of rescue mobile robot Quince -Toward emergency response to the nuclear accident at Fukushima Daiichi Nuclear Power Station on March 2011- , 2011 .

[10]  Edward Jones,et al.  Equidistant Fish-Eye Calibration and Rectification by Vanishing Point Extraction , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Yong-Sheng Chen,et al.  Bird's-Eye View Vision System for Vehicle Surrounding Monitoring , 2008, RobVis.

[13]  Fumitoshi Matsuno,et al.  A Novel Teleoperation Method for a Mobile Robot Using Real Image Data Records , 2004, 2004 IEEE International Conference on Robotics and Biomimetics.

[14]  H. Hongo,et al.  A Practical Calibration Method for Top View Image Generation , 2008, 2008 Digest of Technical Papers - International Conference on Consumer Electronics.

[15]  Tomas Pajdla,et al.  Monitoring surrounding areas of truck-trailer c ombinations , 2007 .