Data fusion between a 2D laser profile sensor and a camera

This paper describes a color extension of a 2D laser profile sensor by extracting the corresponding color from a camera image. For these purpose, we developed a routine for an extrinsic calibration between the profile sensor and the camera. Based on the resulting translation and rotation vectors a belonging pixel can be calculated for each profile point. Consequently, the color for each profile point can be extracted from the image. This approach is used to extend the geometric data of a robotic based 3D scanning system by color data.

[1]  Martin Jägersand,et al.  A comparative analysis of geometric and image-based volumetric and intensity data registration algorithms , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[2]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Roland Siegwart,et al.  Extrinsic self calibration of a camera and a 3D laser range finder from natural scenes , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Diego Viejo,et al.  Portable 3D laser-camera calibration system with color fusion for SLAM , 2013 .

[5]  Rui P. Rocha,et al.  Data Fusion Calibration for a 3D Laser Range Finder and a Camera using Inertial Data , 2009, ECMR.

[6]  Sören Larsson,et al.  Motion control and data capturing for laser scanning with an industrial robot , 2006, Robotics Auton. Syst..

[7]  Katsushi Ikeuchi,et al.  Fusion of a camera and a laser range sensor for vehicle recognition , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[8]  Robert Pless,et al.  Extrinsic calibration of a camera and laser range finder (improves camera calibration) , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[9]  M. García-Alegre,et al.  Real-Time Fusion of Visual Images and Laser Data Images for Safe Navigation in Outdoor Environments , 2011 .

[10]  Tieniu Tan,et al.  Recovery of Intrinsic and Extrinsic Camera Parameters using Perspective Views of Rectangles , 1995, BMVC.

[11]  Sheng Zhu,et al.  A Robotic System for Surface Measurement Via 3D Laser Scanner , 2012 .

[12]  Ming Chen,et al.  Calibration of a multiple axes 3-D laser scanning system consisting of robot, portable laser scanner and turntable , 2011 .

[13]  Yingping Huang,et al.  Calibration of laser scanner and camera fusion system for intelligent vehicles using Nelder–Mead optimization , 2013 .

[14]  Jianwei Zhang,et al.  Multi sensor fusion of camera and 3D laser range finder for object recognition , 2010, 2010 IEEE Conference on Multisensor Fusion and Integration.

[15]  Li Dong,et al.  The Calibration Algorithm of a 3D Color Measurement System based on the Line Feature , 2009 .

[16]  Theodor Borangiu,et al.  Robot Arms with 3D Vision Capabilities , 2010 .

[17]  Patrick Rives,et al.  Calibration between a central catadioptric camera and a laser range finder for robotic applications , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..