Dense depth estimation using adaptive structured light and cooperative algorithm

In this paper we propose a new depth estimation approach using adaptive structured light. A random noise adaptive structured light pattern is projected onto objects and then two cameras capture stereo images. The adaptive colors are acquired using principle component analysis in the RGB color space of the image of the scene. By using inverse principle component analysis on the images with structured light, the desirable structured light information can be maximally retrieved. By combining the original three RGB channels of the scene under adaptive structured light with a fourth channel generated using inverse principle component analysis we can use the cooperative algorithm to generate a dense depth map. In order to keep clear depth discontinuities and alleviate noise in the depth map, we aggregate the local match score with shiftable windows. Experimental results show our approach performs well on images of real-world objects with strong colors and complex textures that have been captured under ambient light conditions.

[1]  Tomaso Poggio,et al.  Cooperative computation of stereo disparity , 1988 .

[2]  Yasushi Yagi,et al.  Dynamic scene shape reconstruction using a single structured light pattern , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Aaron F. Bobick,et al.  Large Occlusion Stereo , 1999, International Journal of Computer Vision.

[4]  Philippe Bekaert,et al.  Depth from sliding projections , 2009, CVPR.

[5]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[6]  Szymon Rusinkiewicz,et al.  Viewpoint-Coded Structured Light , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Luc Van Gool,et al.  Real-time range acquisition by adaptive structured light , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Szymon Rusinkiewicz,et al.  Spacetime Stereo: A Unifying Framework for Depth from Triangulation , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Markus H. Gross,et al.  Scalable 3D video of dynamic scenes , 2005, The Visual Computer.

[10]  Joaquim Salvi,et al.  Recent progress in coded structured light as a technique to solve the correspondence problem: a survey , 1998, Pattern Recognit..

[11]  Jianwei Zhang,et al.  Vision Processing for Realtime 3-D Data Acquisition Based on Coded Structured Light , 2008, IEEE Transactions on Image Processing.

[12]  Song Zhang,et al.  High-Resolution, Real-time 3D Shape Acquisition , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[13]  Joseph Shamir,et al.  Range Imaging With Adaptive Color Structured Light , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Ye Zhang,et al.  Stereo Matching with Segmentation-Based Cooperation , 2002, ECCV.

[15]  Luc Van Gool,et al.  Real-time range scanning of deformable surfaces by adaptively coded structured light , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[16]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[17]  Yasushi Yagi,et al.  A Sensor for Simultaneously Capturing Texture and Shape by Projecting Structured Infrared Light , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[18]  Ronald Chung,et al.  Determining Both Surface Position and Orientation in Structured-Light-Based Sensing , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[20]  Takeo Kanade,et al.  A Cooperative Algorithm for Stereo Matching and Occlusion Detection , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Li Zhang,et al.  Rapid shape acquisition using color structured light and multi-pass dynamic programming , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[22]  Alan M. McIvor,et al.  Accurate 3D measurement using a structured light system , 1998, Image Vis. Comput..