A novel laser vision sensor for omnidirectional 3D measurement

Abstract The combination of omnidirectional imaging and structured-light vision technique provides an efficient solution for omnidirectional 3D measurement. However, the existing omnidirectional structured-light vision sensors are constructed on the basis of curved mirrors, such as parabolic mirrors and conic mirrors, which inevitably generate two obvious problems: first, the difficulty of camera calibration is undoubtedly increased because the camera mathematical model becomes nonlinear and the traditional camera model is no longer applicable in those cases and second, the measurement accuracies of those sensors are far worse than those of traditional structured-light sensors since the captured images are severely warp-deformed. To solve these problems, we developed a novel omnidirectional laser vision sensor by adopting plane mirrors instead of curved mirrors so that the simple traditional camera model can still be used, and more important, the measurement accuracy can be maintained at the same level with the traditional structured-light vision. With respect to the sensor designing, the omnidirectional camera is constructed by a traditional perspective camera and a pyramid reflector, which is made up of four identical plane mirrors of isosceles triangular shape. Moreover, four laser projectors are used to project structured-light to the surrounding scene by the way of splicing. The sensor is calibrated by a 2D planar target and a quasi-3D target. The experimental results show that the relative calibration and measurement errors of the sensor are less than 0.08% and 0.16% respectively. It is proved that complete omnidirectional 3D measurement with high accuracy is feasible with the proposed sensor system.

[1]  Hyungsuck Cho An Active Omni-directional Range Sensor forMobile Robot Navigation , 1997 .

[2]  Shree K. Nayar,et al.  A Theory of Single-Viewpoint Catadioptric Image Formation , 1999, International Journal of Computer Vision.

[3]  Fuqiang Zhou,et al.  A novel optimization method of camera parameters used for vision measurement , 2012 .

[4]  Bin Wu,et al.  A novel method for round steel measurement with a multi-line structured light vision sensor , 2010 .

[5]  Y. M. Zhang,et al.  Weld pool surface depth measurement using a calibrated camera and structured light , 2007 .

[6]  Euripides G. M. Petrakis,et al.  A survey on industrial vision systems, applications, tools , 2003, Image Vis. Comput..

[7]  Edward Jones,et al.  Equidistant (ftheta) fish-eye perspective with application in distortion centre estimation , 2010, Image Vis. Comput..

[8]  Carsten Steger,et al.  An Unbiased Detector of Curvilinear Structures , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Xianyu Su,et al.  Catadioptric omnidirectional system with un-distorted imaging for horizontal scene , 2002, SPIE/COS Photonics Asia.

[10]  Guangjun Zhang,et al.  Complete calibration of a structured light stripe vision sensor through planar target of unknown orientations , 2005, Image Vis. Comput..

[11]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  J. Okamoto,et al.  Constant resolution omnidirectional cameras , 2002, Proceedings of the IEEE Workshop on Omnidirectional Vision 2002. Held in conjunction with ECCV'02.

[13]  Leonard McMillan,et al.  Multi‐Perspective Modelling, Rendering and Imaging , 2010, Comput. Graph. Forum.

[14]  Yoshiaki Shirai,et al.  Recognition of polyhedrons with a range finder , 1971, IJCAI.

[15]  Salvatore Baglio,et al.  Measurements of sandy bed scour processes in an oscillating flow by using structured light , 2000 .

[16]  Gonzalo Pajares,et al.  Combining Support Vector Machines and simulated annealing for stereovision matching with fish eye lenses in forest environments , 2011, Expert Syst. Appl..

[17]  Guangjun Zhang,et al.  3D vision inspection for internal surface based on circle structured light , 2005 .

[18]  Radu Orghidan,et al.  Modelling and accuracy estimation of a new omnidirectional depth computation sensor , 2006, Pattern Recognit. Lett..

[19]  Reinhard Klette,et al.  Stereo panorama acquisition and automatic image disparity adjustment for stereoscopic visualization , 2009, Multimedia Tools and Applications.

[20]  Soo-Yeong Yi,et al.  Real-time omni-directional distance measurement with active panoramic vision , 2007 .