Feature points matching for face reconstruction based on the window unique property of pseudo-random coded image

Abstract Structured light vision systems have been successfully used for accurate measurement of the 3D surfaces of an object, in which a pseudo-random coded structured light image pattern is projected onto the target object through a projector, and the coded information image produced by its surface is captured by a CCD camera in order to recover its 3D surfaces. In this kind of computer vision technology, 3D face reconstruction is a hot research topic. This paper presents a method for feature points matching used in 3D reconstruction. In this method, the feature points can be identified exclusively taking advantage of the window unique property of a pseudo-random array. Thus, the matching problem can be solved by finding the correspondence between 2D coordinates of feature points in the pixel image and those in the code of the projected template. Then, the 3D reconstruction can be carried out with only a single image with the benefit of easy operation and simple calculation. An experiment for 3D face reconstruction with simulated data is given. The performances show that this method has high matching precision for object matching of feature points.

[1]  Ma Shiwei,et al.  A Novel Method of Corner Detection for Multicolor Pseudo-random Encoded Image , 2007, 2007 8th International Conference on Electronic Measurement and Instruments.

[2]  Georgy L. Gimel'farb,et al.  Comparison of Active Structure Lighting Mono and Stereo Camera Systems: Application to 3D Face Acquisition , 2006, 2006 Seventh Mexican International Conference on Computer Science.

[3]  M. Ejiri.  Robotics and machine vision for the future-an industrial view , 2001, 2001 IEEE/ASME International Conference on Advanced Intelligent Mechatronics. Proceedings (Cat. No.01TH8556).

[4]  Carlos Sagues,et al.  Uncalibrated vision based on lines for robot navigation , 2001 .

[5]  Yoshiaki Shirai,et al.  Three-Dimensional Computer Vision , 1987, Symbolic Computation.

[6]  A. E. Brain,et al.  The measurement and use of registered reflectance and range data in scene analysis , 1977, Proceedings of the IEEE.

[7]  Li Zhang,et al.  Rapid shape acquisition using color structured light and multi-pass dynamic programming , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[8]  Lilong Cai,et al.  A calibration method for uncoupling projector and camera of a structured light system , 2008, 2008 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[9]  Emil M. Petriu,et al.  Robust pseudo-random coded colored structured light technique for 3D object model recovery , 2008, 2008 International Workshop on Robotic and Sensors Environments.

[10]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[11]  Wu Lin.  Sub-pixels corner detection for camera calibration , 2006 .

[12]  F. MacWilliams,et al.  Pseudo-random sequences and arrays , 1976, Proceedings of the IEEE.

[13]  Jianwei Zhang,et al.  Vision Processing for Realtime 3-D Data Acquisition Based on Coded Structured Light , 2008, IEEE Transactions on Image Processing.

[14]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[15]  Liang Zhang.  Fast Stereo Matching Algorithm for Intermediate View Reconstruction of Stereoscopic Television Images , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Roger Y. Tsai.  Multiframe Image Point Matching and 3-D Surface Reconstruction , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.