Laser range scanner based on self-calibration techniques using coplanarities and metric constraints

In this paper, we propose a novel method to achieve both dense 3D reconstruction of the scene and estimation of the camera intrinsic parameters by using coplanarities and other constraints (e.g., orthogonalities or parallelisms) derived from relations between planes in the scene and reflected curves of line lasers captured by a single camera. In our study, we categorize coplanarities in the scene into two types: implicit coplanarities, which can be observed as reflected curves of line lasers, and explicit coplanarities, which are, for example, observed as walls of a building. By using both types of coplanarities, we can construct simultaneous equations and can solve them up to four degrees of freedom. To upgrade the solution to the Euclidean space and estimate the camera intrinsic parameters, we can use metric constraints such as orthogonalities of the planes. Such metric constraints are given by, for example, observing the corners of rectangular boxes in the scene, or using special laser projecting device composed of two line lasers whose laser planes are configured to be perpendicular.

[1]  Georg Biegelbauer,et al.  Automated Simultaneous Calibration of a Multi-View Laser Stripe Profiler , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[2]  Shengyong Chen,et al.  Self recalibration of a structured light vision system from a single view , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[3]  Yi-Ping Hung,et al.  New calibration-free approach for augmented reality based on parameterized cuboid structure , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  Eric Wahl,et al.  The DLR multisensory Hand-Guided Device: the Laser Stripe Profiler , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[5]  Stephen J. Maybank,et al.  A Method for Interactive 3D Reconstruction of Piecewise Planar Objects from Single Images , 1999, BMVC.

[6]  Robert B. Fisher,et al.  A low-cost range finder using a visually located, structured light source , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[7]  David J. Kriegman,et al.  What Shadows Reveal about Object Structure , 1998, ECCV.

[8]  Andrew Zisserman,et al.  Metric rectification for perspective images of planes , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[9]  Ryo Furukawa,et al.  Interactive shape acquisition using marker attached laser projector , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[10]  Ryo Furukawa,et al.  Self-Calibration of Multiple Laser Planes for 3D Scene Reconstruction , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[11]  Soon Ki Jung,et al.  Calibration-free approach to 3D reconstruction using light stripe projections on a cube frame , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[12]  Ken-ichi Anjyo,et al.  Tour into the picture: using a spidery mesh interface to make animation from a single image , 1997, SIGGRAPH.

[13]  Ian D. Reid.  Projective calibration of a laser-stripe range finder , 1996, Image Vis. Comput..

[14]  Ryo Furukawa,et al.  Dense 3D Reconstruction method using Coplanarities and Metric Constraints for Line Laser Scanning , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[15]  Ryo Furukawa,et al.  Uncalibrated multiple image stereo system with arbitrarily movable camera and projector for wide range scanning , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[16]  A. McIvor.  Nonlinear calibration of a laser stripe profiler , 2002 .

[17]  Peter F. Sturm,et al.  Camera Calibration and 3D Reconstruction from Single Images Using Parallelepipeds , 2001, ICCV.

[18]  Pietro Perona,et al.  3D photography on your desk , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[19]  François Blais.  Review of 20 years of range sensor development , 2004, J. Electronic Imaging.

[20]  José Santos-Victor,et al.  Algebraic Aspects of Reconstruction of Structured Scenes from One or More Views , 2001 .

[21]  Gilles Trombettoni,et al.  Scene modeling based on constraint system decomposition techniques , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[22]  Patrick Hébert.  A self-referenced hand-held range sensor , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[23]  Bernard Mourrain,et al.  An Application of Automatic Theorem Proving in Computer Vision , 1998, Automated Deduction in Geometry.

[24]  E. Grossmann,et al.  Single and Multi-View Reconstruction of Structured Scenes , 2002 .

[25]  David Fofi,et al.  Uncalibrated vision based on structured light , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[26]  Markus Brandner,et al.  State of the art on vision-based structured light systems for 3D measurements , 2005, International Workshop on Robotic Sensors: Robotic and Sensor Environments, 2005..