Force prediction by fingernail imaging using active appearance models

This paper investigates the effect of two different parameters on the registration and force prediction accuracy of using Active Appearance Models (AAM) to align fingernail images. First, the color channel used to form the AAM is varied between (1) an averaged grayscale image, (2) the red channel, (3) the green channel and (4) the blue channel. Second, the number of landmark points used to create the AAM is varied between 6 and 75. The color channel is found to have an effect on the registration accuracy and the force prediction error. The green, blue and grayscale images are approximately equivalent, while the red images have a larger error across all metrics used. The number of landmark points may be reduced to 25 with no significant effect on either the registration accuracy or the force prediction error, though further reduction has shown some effect. With this information, a simpler registration model can be used that requires fewer calculations.

[1]  A Cliquet,et al.  A low-cost instrumented glove for monitoring forces during object manipulation. , 1997, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[2]  Marco Santello,et al.  Task-dependent modulation of multi-digit force coordination patterns. , 2003, Journal of neurophysiology.

[3]  H. Asada,et al.  THE COMMON PATTERNS OF BLOOD PERFUSION IN THE FINGERNAIL BED SUBJECT TO FINGERTIP TOUCH FORCE AND FINGER POSTURE , 2006 .

[4]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[5]  C Pylatiuk,et al.  Distribution of grip force in three different functional prehension patterns , 2006, Journal of medical engineering & technology.

[6]  M. Santello,et al.  Anticipatory Planning and Control of Grasp Positions and Forces for Dexterous Two-Digit Manipulation , 2010, The Journal of Neuroscience.

[7]  Yu Sun,et al.  Predicting Fingertip Forces by Imaging Coloration Changes in the Fingernail and Surrounding Skin , 2008, IEEE Transactions on Biomedical Engineering.

[8]  Stephen A. Mascaro,et al.  Fingernail image registration using Active Appearance Models , 2013, 2013 IEEE International Conference on Robotics and Automation.

[9]  Bjarne K. Ersbøll,et al.  FAME-a flexible appearance modeling environment , 2003, IEEE Transactions on Medical Imaging.

[10]  Stephen A. Mascaro,et al.  Optimization of fingernail sensing technique based on optical experimentation and modeling , 2011, 2011 IEEE Sensors Applications Symposium.

[11]  Thenkurussi Kesavadas,et al.  Measuring Fingertip Forces by Imaging the Fingernail , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[12]  Martha Flanders,et al.  Effects of object compliance on three-digit grasping. , 2009, Journal of neurophysiology.

[13]  Stephen A. Mascaro,et al.  Estimation of Fingertip Force Direction With Computer Vision , 2009, IEEE Transactions on Robotics.

[14]  Stephen A. Mascaro,et al.  3D force prediction using fingernail imaging with automated calibration , 2010, 2010 IEEE Haptics Symposium.

[15]  Yu Sun,et al.  3-D force control on the human fingerpad using a magnetic levitation device for fingernail imaging calibration , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.