Development of an omni-directional 3D camera for robot navigation

A novel structured light based omnidirectional 3D camera was developed, which consists of a projector, a camera, and two hyperbolic mirrors. Compared with traditional single-directional 3D sensors, such as kinect, the developed sensor could scan fully 360 degree in its surrounding without any blind area. A panoramic view was fused with dense 3D information could be provided to the operator. Furthermore, A single-shot surface coding method was also developed for such a sensor. Real-time 3D perception for moving objects could be achieved by the proposed coding method. Light rings embedded with different angular frequencies and intensities are emitted from the projector to environment through the hyperbolic mirror. Taking advantage of the epipolar constraints, the invariance of the phase angle is utilized to establish the correspondence and then trangulized to obtain depths information. Compared with existing omnidirectional 3D sensors, the proposed method remained real-time sensing and also obtained dense 3D samples. The proposed 3D camera has been implemented and the experimental results have been analyzed and discussed.

[1]  Joaquim Salvi,et al.  A robust-coded pattern projection for dynamic 3D scene measurement , 1998, Pattern Recognit. Lett..

[2]  E. Petriu,et al.  Object recognition using pseudo-random color encoded structured light , 2000, Proceedings of the 17th IEEE Instrumentation and Measurement Technology Conference [Cat. No. 00CH37066].

[3]  Sang Wook Lee,et al.  High-Contrast Color-Stripe Pattern for Rapid Structured-Light Range Imaging , 2004, ECCV.

[4]  Zhigang Zhu Omnidirectional Stereo Vision , 2001 .

[5]  Pierre Payeur,et al.  Structured Light Stereoscopic Imaging with Dynamic Pseudo-random Patterns , 2009, ICIAR.

[6]  Chi Zhang,et al.  Real-time 3D shape inspection system of automotive parts based on structured light pattern , 2011 .

[7]  Shree K. Nayar,et al.  A theory of catadioptric image formation , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[8]  Saburo Tsuji,et al.  Panoramic representation for route recognition by a mobile robot , 1992, International Journal of Computer Vision.

[9]  Shree K. Nayar,et al.  Real-Time Omnidirectional and Panoramic Stereo , 1998 .

[10]  Ruzena Bajcsy,et al.  Single-viewpoint, catadioptric cone mirror omnidirectional imaging theory and analysis. , 2006, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  Jing Xu,et al.  Windshield shape inspection using structured light patterns from two diffuse planar light sources , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  H. Ukida,et al.  Omni-directional 3D Measurement by Hyperbolic Mirror Cameras and Pattern Projection , 2008, 2008 IEEE Instrumentation and Measurement Technology Conference.

[13]  Antonio Adán,et al.  Disordered patterns projection for 3D motion recovering , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[14]  A. Adán,et al.  Disordered patterns projection for 3D motion recovering , 2004 .

[15]  R. Orghidan Catadioptric stereo based on structured light projection , 2006 .

[16]  M.A. Tehrani,et al.  A New Approach to 3D Modeling Using Structured Light Pattern , 2008, 2008 3rd International Conference on Information and Communication Technologies: From Theory to Applications.