Rapid Hand Shape Reconstruction with Chebyshev Phase Shifting

Human hand motion and shape sensing is an area of high interest in medical communities and for human interaction researchers. Measurement of small hand movements could help professionals to quantize the stage of conditions like Parkinson's Disease (PD) and Essential Tremor (ET). Similar data is also useful for designers of human interaction algorithms to infer information about hand pose and gesture recognition. In this paper we present a structured light sensor capable of measuring hand shape and color at 121 FPS. Our algorithm uses a novel structured light method developed by us, called Chebyshev Phase Shifting (CPS). This method uses a digital projector and a camera to create high-resolution color 3D models from sequences of color images. We show how to encode CPS patterns in three RGB images for a reduced acquisition time, enabling high speed capture. We have built a prototype to measure rapid trembling hands. Our results show our prototype accurately captures fast tremors similar to those of PD patients. Color 3D model sequences recorded at high speed with our sensor will be used to study hand kinematic properties in a future.

[1]  V. Srinivasan,et al.  Automated phase-measuring profilometry: a phase mapping approach. , 1985, Applied optics.

[2]  Shree K. Nayar,et al.  Micro Phase Shifting , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Song Zhang.  3D range data compression with a virtual fringe projection system , 2015, Sensing Technologies + Applications.

[4]  Joseph Shamir,et al.  Range Imaging With Adaptive Color Structured Light , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Joaquim Salvi,et al.  A state of the art in structured light patterns for surface profilometry , 2010, Pattern Recognit..

[6]  Joaquim Salvi,et al.  Efficient and Low-Cost 3D Structured Light System Based on a Modified Number-Theoretic Approach , 2009, EURASIP J. Adv. Signal Process..

[7]  Gabriel Taubin,et al.  Simple, Accurate, and Robust Projector-Camera Calibration , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[8]  Fu-Pen Chiang,et al.  Color phase-shifting technique for three-dimensional shape measurement , 2006 .

[9]  Gabriel Taubin,et al.  Embedded phase shifting: Robust phase shifting with embedded signals , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  In-So Kweon,et al.  Dense Depth and Albedo from a Single-Shot Structured Light , 2015, 2015 International Conference on 3D Vision.

[11]  David W. Capson,et al.  Surface profile measurement using color fringe projection , 1991, Machine Vision and Applications.

[12]  Jeffrey L. Posdamer,et al.  Surface measurement by space-encoded projected beam systems , 1982, Comput. Graph. Image Process..

[13]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[14]  T. Hastie,et al.  Quantitative measurements of alternating finger tapping in Parkinson's disease correlate with UPDRS motor disability and reveal the improvement in fine motor control from medication and deep brain stimulation , 2005, Movement disorders : official journal of the Movement Disorder Society.

[15]  J M Huntley,et al.  Temporal phase unwrapping: application to surface profiling of discontinuous objects. , 1997, Applied optics.

[16]  Fu-Pen Chiang,et al.  Color-encoded digital fringe projection technique for high-speed three-dimensional surface contouring , 1999 .

[17]  J. Jankovic.  Parkinson’s disease: clinical features and diagnosis , 2008, Journal of Neurology, Neurosurgery, and Psychiatry.

[18]  Ashok Veeraraghavan,et al.  Structured light 3D scanning in the presence of global illumination , 2011, CVPR 2011.

[19]  S. Inokuchi,et al.  Range-imaging system for 3-D object recognition , 1984 .

[20]  Li Zhang,et al.  Rapid shape acquisition using color structured light and multi-pass dynamic programming , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.