Projected light beams tracking for efficient 3D reconstruction

A machine vision system based on a CCD camera combined with a light beam matrix is developed to output the 3D representation of a scene. This paper focuses on the problem of image spot labelling: matching between image spots and light beams is required for the triangulation procedure. A previous part of our work addressed the labelling problem through discrete relaxation. Each frame is analyzed independently and the labelling process considers all the possible combinations at each time. A major contribution, focused in this paper, concerns the insertion of another constraint based on image spot motion over time in order to improve the robustness of the labelling process. Motion prediction of image spots is deduced from previous images and allowed to reduce the possible labelling combinations in the current frame. Beam tracking results are discussed and 3D reconstructions are then presented.

[1]  Jean-José Orteu,et al.  Camera calibration from multiple views of a 2D object, using a global nonlinear minimization method , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[2]  Kim L. Boyer,et al.  Color-Encoded Structured Light for Rapid Active Ranging , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Gongzhu Hu,et al.  3-D Surface Solution Using Structured Light and Constraint Propagation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  A. Willsky,et al.  A generalized likelihood ratio approach to the detection and estimation of jumps in linear systems , 1976 .

[5]  Thorsten von Eicken,et al.  技術解説 IEEE Computer , 1999 .

[6]  K. Bazargan,et al.  Techniques in display holography , 1986 .

[7]  F. Lerasle,et al.  Car cockpit 3D reconstruction by a structured light sensor , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[8]  H. Damasio,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence: Special Issue on Perceptual Organization in Computer Vision , 1998 .

[9]  Stephen A. Benton,et al.  Practical Holography XVI and Holographic Materials VIII , 2002 .

[10]  Andrew S. Glassner,et al.  Proceedings of the 27th annual conference on Computer graphics and interactive techniques , 1994, SIGGRAPH 1994.

[11]  Jerome P. Rosenfeld,et al.  High-Speed Space Encoding Projector For 3D Imaging , 1987, Other Conferences.

[12]  J William,et al.  IEEE Computer Graphics and Applications , 2019, Computer.

[13]  S. Inokuchi,et al.  Range-imaging system for 3-D object recognition , 1984 .