Tracking and Matching Connected Components from 3D Video

This work presents a method for the detection, tracking and spatial matching of connected components in a 3D video stream. The video image information is combined with 3D sites in order to align pieces of surfaces that are seen in subsequent frames. This is a key step in 3D video analysis for enabling several applications such as compression, geometric integration and scene reconstruction, to name a few. Our approach is to detect salient features in both image and world spaces for further alignment of texture and geometry. We use a projector-camera system to obtain high quality texture and geometry at 30 fps. Successful experimental results corroborating our method are shown.

[1]  Luiz Velho,et al.  ( b , s )-BCSL : Structured Light Color Boundary Coding for 3 D Photography , 2002 .

[2]  Fu-Pen Chiang,et al.  High-speed 3-D shape measurement based on digital fringe projection , 2003 .

[3]  Frank Ade,et al.  OBJECT DETECTION AND TRACKING IN RANGE IMAGE SEQUENCES BY SEPARATION OF IMAGE FEATURES , 1998 .

[4]  Christian Früh,et al.  Capturing 2½D Depth and Texture of Time-Varying Scenes Using Structured Infrared Light , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[5]  Luiz Velho,et al.  A Camera-Projector System for Real-Time 3D Video , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[6]  Paulo R. S. Mendonça,et al.  Model-Based Hand Tracking Using an Unscented Kalman Filter , 2001, BMVC.

[7]  Steven M. Seitz,et al.  Spacetime faces , 2004, ACM Trans. Graph..

[8]  Voicu Popescu,et al.  Interactive scene modeling from dense color and sparse depth , 2004, SIGGRAPH '04.

[9]  Luc Van Gool,et al.  Blue-c: a spatially immersive display and 3D video portal for telepresence , 2003, IPT/EGVE.

[10]  Luiz Velho,et al.  Structured Light Color Boundary Coding for 3D Photography , 2002, VMV.

[11]  Christian Früh,et al.  Capturing 2 1/2 D depth and texture of time-varying scenes using structured infrared light , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[12]  Ramesh Raskar,et al.  Image-based visual hulls , 2000, SIGGRAPH.

[13]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..