Integrating multiple sensors for the closed-loop three-dimensional digitization

In this article, we present a set of novel techniques, which include (1) sensor-stage calibration, (2) high-level script programming for the flexible control of data sensing, and (3) a framework for dynamic data sensing, visualization and shape modeling. It enables the integration of multiple three-dimensional sensors into one controlled three-dimensional digitization system for the closed-loop of data sensing and shape modeling. In this system, point, line, and area sensors with different sensing coverage, accuracies, and resolutions can be integrated into a multi-stage platform on which data acquisition from each sensor can be programmed in a controlled manner. In this manner, the closed-loop of data sensing and shape modeling can be achieved, which can significantly improve the overall digitization efficiency and shape modeling quality. Finally, two three-dimensional digitization examples of such multi-sensor system are demonstrated, (1) complementary integration of multiple sensors for three-dimensional digitization and (2) the closed-loop of dynamic data sensing and shape modeling to significantly improve overall sensing efficiency and shape modeling quality.

[1]  Prabhjot Singh,et al.  Multimodal Industrial Inspection and Analysis , 2007, J. Comput. Inf. Sci. Eng..

[2]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[3]  Sang Wook Lee,et al.  ICP Registration Using Invariant Features , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Quan Pan,et al.  Multiresolution modeling and estimation of multisensor data , 2004, IEEE Trans. Signal Process..

[5]  Chia-Hsiang Menq,et al.  Multiple-sensor integration for rapid and high-precision coordinate metrology , 2000 .

[6]  Luca Mastrogiacomo,et al.  MScMS-II: an innovative IR-based indoor coordinate measuring system for large-scale metrology applications , 2011 .

[7]  Yunbao Huang,et al.  Dynamic B-spline surface reconstruction: Closing the sensing-and-modeling loop in 3D digitization , 2007, Comput. Aided Des..

[8]  Rajesh Subramanian,et al.  Integrating a Vision System With a Coordinate Measuring Machine to Automate the Datum Alignment Process , 2005, DAC 2005.

[9]  Yunbao Huang,et al.  A dynamic sensing-and-modeling approach to three-dimensional point-and area-sensor integration , 2007 .

[10]  Chia-Hsiang Menq,et al.  Multiple-Sensor Planning and Information Integration for Automatic Coordinate Metrology , 2001, J. Comput. Inf. Sci. Eng..

[11]  Robert Pless,et al.  Extrinsic Auto-calibration of a Camera and Laser Range Finder , 2003 .

[12]  Luca Mastrogiacomo,et al.  Network localization procedures for experimental evaluation of mobile spatial coordinate measuring system (MScMS) , 2010 .

[13]  Robert Pless,et al.  Extrinsic calibration of a camera and laser range finder (improves camera calibration) , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[14]  Xiangqian Jiang,et al.  Multisensor data fusion in dimensional metrology , 2009 .

[15]  Kevin B. Smith,et al.  Point Laser Triangulation Probe Calibration for Coordinate Metrology , 2000 .

[16]  Yunbao Huang,et al.  A Dynamic Sensing-and-Modeling Approach to 3D Point- and Area-Sensor Integration , 2006 .

[17]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[18]  Yunbao Huang,et al.  Multi-sensor calibration through iterative registration and fusion , 2009, Comput. Aided Des..

[19]  Kevin G. Harding.  Sine wave artifact as a means of calibrating structured light systems , 1999, Optics East.

[20]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  William G. Rippey,et al.  An Integrated Vision Touch-Probe System for Dimensional Inspection Tasks , 1995 .