EigenNail for Finger Force Direction Recognition

This paper presents a technique termed eigennails to classify fingertip force during contact based on the coloration patterns in the fingernail and surrounding skin. Fingertip force is classified into six directions: no force, normal force only, two directions (left/right) of lateral shear force, and two directions (forward/backward) of longitudinal shear forces. Based on the face recognition technique eigenfaces, a small number of eigennails are sufficient to express the color pattern features for shear force direction classification. Results show that 98% of 960 fingernail images of 8 different subjects are correctly classified. The lowest imaging resolution without sacrificing classification accuracy is found to be 10-by-10.

[1]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[2]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..

[3]  H. Asada,et al.  THE COMMON PATTERNS OF BLOOD PERFUSION IN THE FINGERNAIL BED SUBJECT TO FINGERTIP TOUCH FORCE AND FINGER POSTURE , 2006 .

[4]  James L. Crowley,et al.  Finger Tracking as an Input Device for Augmented Reality , 1995 .

[5]  Paul A. Beardsley,et al.  Computer Vision for Interactive Computer Graphics , 1998, IEEE Computer Graphics and Applications.

[6]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[7]  Thenkurussi Kesavadas,et al.  Measuring Fingertip Forces by Imaging the Fingernail , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[8]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[9]  Yu Sun,et al.  Dynamic features and prediction model for imaging the fingernail to measure fingertip forces , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[10]  H. Harry Asada,et al.  Understanding of fingernail-bone interaction and fingertip hemodynamics for fingernail sensor design , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[11]  François Bérard,et al.  Bare-hand human-computer interaction , 2001, PUI '01.

[12]  H. Harry Asada,et al.  Measurement of finger posture and three-axis fingertip touch force using fingernail sensors , 2004, IEEE Transactions on Robotics and Automation.