Discontinuity-preserving decoding of one-shot shape acquisition using regularized color

Abstract The 3D scene acquisition is becoming increasingly crucial in practical application. In this paper, a new method is proposed to measure the surface of objects, which just require one color pattern image. In our decoding method, advancements are made at two steps. First, color identification is modeled as an unsupervised classification problem and K-means are adopted on a new color feature, called regularized color. It is insensitive to surface orientation, illumination direction and illumination intensity for matte, dull surfaces. Second, a discontinuity-preserving method is proposed in the sequence matching, which is based on the window voting to judge correct correspondences and potential borders. In the experiments, this new color feature is compared with RGB, normalized color, HSI. Their class separability measurements are evaluated by scattering criteria and Bhattacharyya distance. The results show that regularized color has much higher discriminating power than RGB and equivalent performance with HSI. Our matching method is also compared with the traditional local matching methods. The results affirm that ours has higher accuracies on six different objects.

[1]  Joaquim Salvi,et al.  A robust-coded pattern projection for dynamic 3D scene measurement , 1998, Pattern Recognit. Lett..

[2]  Bernard Muschielok,et al.  The 4MOST instrument concept overview , 2014, Astronomical Telescopes and Instrumentation.

[3]  Jianwei Zhang,et al.  Vision Processing for Realtime 3-D Data Acquisition Based on Coded Structured Light , 2008, IEEE Transactions on Image Processing.

[4]  Kim L. Boyer,et al.  Color-Encoded Structured Light for Rapid Active Ranging , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Xu Zhang,et al.  Projector calibration from the camera image point of view , 2009 .

[6]  Ja-Ling Wu,et al.  Range data acquisition using color structured lighting and stereo vision , 1997, Image Vis. Comput..

[7]  Luc Van Gool,et al.  Real-time range acquisition by adaptive structured light , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Peter Eisert,et al.  Adaptive color classification for structured light systems , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[9]  Xu Zhang,et al.  Indirect decoding edges for one-shot shape acquisition. , 2011, Journal of the Optical Society of America. A, Optics, image science, and vision.

[10]  François Blais Review of 20 years of range sensor development , 2004, J. Electronic Imaging.

[11]  Christophe Collewet,et al.  Optimised De Bruijn patterns for one-shot shape acquisition , 2005, Image Vis. Comput..

[12]  Marc Levoy,et al.  Better optical triangulation through spacetime analysis , 1995, Proceedings of IEEE International Conference on Computer Vision.

[13]  Robert B. Fisher,et al.  A Comparison of Algorithms for Subpixel Peak Detection , 1996 .

[14]  Joseph Shamir,et al.  Range Imaging With Adaptive Color Structured Light , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[16]  Joaquim Salvi,et al.  A state of the art in structured light patterns for surface profilometry , 2010, Pattern Recognit..

[17]  L. Van Gool,et al.  A graph cut based adaptive structured light approach for real-time range acquisition , 2004 .

[18]  Qican Zhang,et al.  Dynamic 3-D shape measurement method: A review , 2010 .

[19]  Pierre Graebling,et al.  Robust Structured Light Coding for 3D Reconstruction , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[20]  Xu Zhang,et al.  Determination of edge correspondence using color codes for one-shot shape acquisition , 2011 .

[21]  Yasushi Yagi,et al.  Dynamic scene shape reconstruction using a single structured light pattern , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Heinz Hugli,et al.  Generation And Use Of Color Pseudo Random Sequences For Coding Structured Light In Active Ranging , 1989, Other Conferences.

[23]  Szymon Rusinkiewicz,et al.  Stripe boundary codes for real-time structured-light range scanning of moving objects , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[24]  Song Zhang Recent progresses on real-time 3D shape measurement using digital fringe projection techniques , 2010 .

[25]  Jing Li Wang,et al.  Color image segmentation: advances and prospects , 2001, Pattern Recognit..

[26]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[27]  Hao Li,et al.  Structured Light Based Reconstruction under Local Spatial Coherence Assumption , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[28]  Cengizhan Ozturk,et al.  Structured Light Using Pseudorandom Codes , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Li Zhang,et al.  Rapid shape acquisition using color structured light and multi-pass dynamic programming , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[30]  Peter Eisert,et al.  Fast and High Resolution 3D Face Scanning , 2007, 2007 IEEE International Conference on Image Processing.

[31]  Mumin Song,et al.  Overview of three-dimensional shape measurement using optical methods , 2000 .

[32]  Xu Zhang,et al.  Robust Calibration of a Color Structured Light System Using Color Correction , 2009, ICIRA.

[33]  Sang Wook Lee,et al.  High-Contrast Color-Stripe Pattern for Rapid Structured-Light Range Imaging , 2004, ECCV.