Decoding positional and color information from a coded pattern

The paper presents decoding positional and color information using visual coded patterns for efficient geometric calibration and color consistency across multiple cameras. The patterns are generated from an alphabet of basis colors placed in unique spatial configurations called ChromaCodes. The imaged patterns are automatically decoded to derive the information needed for both geometric and color calibration. Previous 2-D structured patterns are typically designed for obtaining only geometry whereas the proposed patterns capture color information as well. Moreover, the unique decodability of the codes allows them to overcome the problem of pattern visibility in all views and enables effective geometric calibration and color consistency with even partial and/or occluded view of the pattern. Experimental results demonstrate that a single shot of the pattern is sufficient to encapsulate enough information to compute both geometry and color across one or more cameras, especially important for real-time or interactive applications.

[1]  Tuvi Etzion,et al.  Constructions for perfect maps and pseudorandom arrays , 1988, IEEE Trans. Inf. Theory.

[2]  Dieter Schmalstieg,et al.  Pose tracking from natural features on mobile phones , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[3]  Cengizhan Ozturk,et al.  Structured Light Using Pseudorandom Codes , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Li Zhang,et al.  Rapid shape acquisition using color structured light and multi-pass dynamic programming , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[5]  Jiaya Jia,et al.  Poisson matting , 2004, SIGGRAPH 2004.

[6]  Fan Chung Graham,et al.  Universal cycles for combinatorial structures , 1992, Discret. Math..

[7]  F. MacWilliams,et al.  Pseudo-random sequences and arrays , 1976, Proceedings of the IEEE.

[8]  Ran-Zan Wang,et al.  A Vision-Based Augmented-Reality System For Multiuser Collaborative Environments , 2008, IEEE Transactions on Multimedia.

[9]  Kasper Claes,et al.  Robot positioning using structural light patterns suitable for self calibration and 3d tracking , 2007 .

[10]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[11]  Joaquim Salvi,et al.  Recent progress in coded structured light as a technique to solve the correspondence problem: a survey , 1998, Pattern Recognit..

[12]  James F. Blinn,et al.  Blue screen matting , 1996, SIGGRAPH.

[13]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Joost van de Weijer,et al.  Edge and corner detection by photometric quasi-invariants , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[16]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[17]  Dani Lischinski,et al.  Spectral Matting , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Chris J. Mitchell,et al.  Coding Schemes for Two-Dimensional Position Sensing , 1992 .

[19]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[20]  Joaquim Salvi,et al.  A robust-coded pattern projection for dynamic 3D scene measurement , 1998, Pattern Recognit. Lett..