Fast hand recognition method using limited area of IR projection pattern

We have been developing a rapid proto-typing display system which can verify an appearance of final product in finishing and painting industry. In this system, it is necessary to measure detail information of hand position and shape to recognize the worker's instruction. Therefore, we apply a rapid hand measurement which combine a roughly detecting of hand position and shape by spatial encoding method with IR projection. For detecting of hand position, non-linearity interval strips are used for detecting objects that are lower than constant height. The interval of strips is devised in relation to an angle of camera axis to make equal the height in detecting. For detecting of hand shape, the temporal and spatial encoding pattern is projected only an area of hand position. This measurement is enough rough because our prototyping display system need only to classify the shape of tracing, touching, pushing, and picking. Therefore, the limited process with limited area is possible to reconstruct the shape of hand very fast. A practical result shows that the position and shape recognition is performed about one second; and operator comment that such the time delay doesn't become a stress as for actual hand operation.

[1]  Juneho Yi,et al.  Structured Light Based Depth Edge Detection for Object Shape Recovery , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[2]  Shoji Yamamoto,et al.  Fast BTF rendering for appearance-based display using dichromatic reflection model , 2006, Color Imaging Conference.

[3]  Pd Pierre Lévy,et al.  Towards a definition of Kansei , 2006 .

[4]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[6]  Jianbo Shi,et al.  Tele-Graffiti: A Camera-Projector Based Remote Sketching System with Hand-Based User Interface and Automatic Session Summarization , 2003, International Journal of Computer Vision.

[7]  Hanqing Lu,et al.  Virtual Mouse - Inputting Device by Hand Gesture Tracking and Recognition , 2000, ICMI.

[8]  S. Inokuchi,et al.  Three-dimensional surface measurement by space encoding range imaging , 1985 .

[9]  Shoji Yamamoto,et al.  Projector-Based Color Simulator for Print Industry , 2006, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[10]  Katsushi Ikeuchi,et al.  Determining Surface Orientations of Specular Surfaces by Using the Photometric Stereo Method , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Shoji Yamamoto,et al.  Real-time Control of Appearance on an Object Using a High-Luminance PC Projector and Graphics Hardware , 2005, International Conference on Communications in Computing.

[12]  Yoichi Sato,et al.  Fast tracking of hands and fingertips in infrared images for augmented desk interface , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[13]  William T. Freeman,et al.  Television control by hand gestures , 1994 .