Fast and robust online three-dimensional measurement based on feature correspondence

Abstract. Online three-dimensional (3D) measurement plays an important role in industry. When phase-shifting profilometry is employed in online 3D measurement, pixel matching is an important step to keep objects at the same coordinate value. However, the correlation operation and marker feature matching algorithms may take a long time, increasing the complexity. So a fast and robust online 3D measurement based on feature correspondence is proposed. In this method, only one frame of the sinusoidal fringe pattern is projected onto the measured object, and image correction technique is employed to rectify pixel size. Then five frames of deformed patterns with equivalent displacement are captured by the camera, and the corresponding modulation patterns are extracted. The oriented fast and rotated brief feature algorithm is used to extract the matching pair of feature points, and the improved grid-based motion statistical feature algorithm can better eliminate the false match to achieve pixel matching. In this way, five frames of deformed patterns with an equivalent shifted-phase can be extracted. Finally, the 3D shape of the measured object is reconstructed by the five-step equivalent phase-shifting algorithm. Experimental results verify the effectiveness and feasibility of the proposed method.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Hsin-Chu Liu,et al.  Optical three-dimensional sensing by phase measuring profilometry , 1989 .

[3]  Y. Wan,et al.  Intrinsic feature revelation of phase-to-height mapping in phase measuring profilometry , 2018, Optics & Laser Technology.

[4]  Jiang Zhao,et al.  Dynamic phase measuring profilometry for rigid objects based on simulated annealing. , 2020, Applied optics.

[5]  Jiang Zhao,et al.  Fast 3D measurement based on improved optical flow for dynamic objects. , 2020, Optics express.

[6]  Kuang Peng,et al.  A new method using orthogonal two-frequency grating in online 3D measurement , 2016 .

[7]  Yiping Cao,et al.  Online Phase Measurement Profilometry for a Fast-Moving Object , 2021, Applied Sciences.

[8]  Beiwen Li,et al.  Single-shot absolute 3D shape measurement with Fourier transform profilometry. , 2016, Applied optics.

[9]  Hang,et al.  Absolute three-dimensional shape measurement with a known object , 2017 .

[10]  M. Takeda,et al.  Fourier transform profilometry for the automatic measurement of 3-D object shapes. , 1983, Applied optics.

[11]  Enhong Chen,et al.  Phase-shifting profilometry for the robust 3-D shape measurement of moving objects. , 2019, Optics express.

[12]  É. Vincent,et al.  Detecting planar homographies in an image pair , 2001, ISPA 2001. Proceedings of the 2nd International Symposium on Image and Signal Processing and Analysis. In conjunction with 23rd International Conference on Information Technology Interfaces (IEEE Cat..

[13]  Han Yuan,et al.  Online phase measuring profilometry for rectilinear moving object by image correction , 2015 .

[14]  An improved Stoilov algorithm based on probability and statistics , 2015 .

[15]  Kuang Peng,et al.  An on-line phase measuring profilometry for objects moving with straight-line motion , 2015 .

[16]  Ziping Liu,et al.  Motion-induced error compensation for phase shifting profilometry. , 2018, Optics express.

[17]  Alan L. Yuille,et al.  The Motion Coherence Theory , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[18]  Satoshi Tomioka,et al.  Phase unwrapping algorithm based on singularity compensation for three-dimensional shape measurement , 2012 .

[19]  Xu Zheng,et al.  An on-line phase measuring profilometry: Processed modulation using for pixel matching , 2013 .

[20]  Qian Luo,et al.  Fringe projection profilometry based on a novel phase shift method. , 2011, Optics express.

[21]  Yasuyuki Matsushita,et al.  GMS: Grid-Based Motion Statistics for Fast, Ultra-robust Feature Correspondence , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Jiangtao Xi,et al.  General model for phase shifting profilometry with an object in motion. , 2018, Applied optics.

[23]  Xianyu Su,et al.  Real-time calibration algorithm for phase shifting in phase-measuring profilometry , 2001 .

[24]  Cheng Chen,et al.  A dual-frequency online PMP method with phase-shifting parallel to moving direction of measured object , 2017 .

[25]  Kuang Peng,et al.  A new pixel matching method using the entire modulation of the measured object in online PMP , 2014 .

[26]  Yo-Sung Ho,et al.  Automatic look-up table based real-time phase unwrapping for phase measuring profilometry and optimal reference frequency selection. , 2019, Optics express.

[27]  Jiangtao Xi,et al.  Automated approach for the surface profile measurement of moving objects based on PSP. , 2017, Optics express.

[28]  Minh N. Do,et al.  Bilateral Functions for Global Motion Modeling , 2014, ECCV.

[29]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[30]  Shouhuan Zhou,et al.  Online fringe projection profilometry based on scale-invariant feature transform , 2016 .

[31]  D J Bone,et al.  Fourier fringe analysis: the two-dimensional phase unwrapping problem. , 1991, Applied optics.

[32]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[33]  G. Stoilov,et al.  Phase-stepping interferometry: Five-frame algorithm with an arbitrary step , 1997 .

[34]  Kuang Peng,et al.  A new pixel matching method using the modulation of shadow areas in online 3D measurement , 2013 .

[35]  Ho-Hyun Park,et al.  Corner classification using Harris algorithm , 2011 .

[36]  Jonathan Kofman,et al.  Real-time 3D surface-shape measurement using background-modulated modified Fourier transform profilometry with geometry-constraint , 2019, Optics and Lasers in Engineering.