ThimbleSense: A Fingertip-Wearable Tactile Sensor for Grasp Analysis

Accurate measurement of contact forces between hand and grasped objects is crucial to study sensorimotor control during grasp and manipulation. In this work, we introduce ThimbleSense, a prototype of individual-digit wearable force/torque sensor based on the principle of intrinsic tactile sensing. By exploiting the integration of this approach with an active marker-based motion capture system, the proposed device simultaneously measures absolute position and orientation of the fingertip, which in turn yields measurements of contacts and force components expressed in a global reference frame. The main advantage of this approach with respect to more conventional solutions is its versatility. Specifically, ThimbleSense can be used to study grasping and manipulation of a wide variety of objects, while still retaining complete force/torque measurements. Nevertheless, validation of the proposed device is a necessary step before it can be used for experimental purposes. In this work, we present the results of a series of experiments designed to validate the accuracy of ThimbleSense measurements and evaluate the effects of distortion of tactile afferent inputs caused by the device's rigid shells on grasp forces.

[1]  Marco Santello,et al.  Transfer of Learned Manipulation following Changes in Degrees of Freedom , 2011, The Journal of Neuroscience.

[2]  Antonio Bicchi,et al.  On the problem of decomposing grasp and manipulation forces in multiple whole-limb manipulation , 1994, Robotics Auton. Syst..

[3]  J. F. Soechting,et al.  Two virtual fingers in the control of the tripod grasp. , 2001, Journal of neurophysiology.

[4]  R. Howe,et al.  Human grasp choice and robotic grasp analysis , 1990 .

[5]  Marco Santello,et al.  Manipulation after object rotation reveals independent sensorimotor memory representations of digit positions and forces. , 2010, Journal of neurophysiology.

[6]  Friedrich M. Wahl,et al.  On-line rigid object recognition and pose estimation based on inertial parameters , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  John Kenneth Salisbury,et al.  Contact Sensing from Force Measurements , 1990, Int. J. Robotics Res..

[8]  D. Wolpert,et al.  Principles of sensorimotor learning , 2011, Nature Reviews Neuroscience.

[9]  Paolo Dario,et al.  A Survey of Glove-Based Systems and Their Applications , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  Martha Flanders,et al.  Effects of object compliance on three-digit grasping. , 2009, Journal of neurophysiology.

[11]  R. Johansson,et al.  Responses in glabrous skin mechanoreceptors during precision grip in humans , 2004, Experimental Brain Research.

[12]  Stefan Glasauer,et al.  How predictive is grip force control in the complete absence of somatosensory feedback? , 2004, Brain : a journal of neurology.

[13]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[14]  Stephen A. Mascaro,et al.  Force prediction by fingernail imaging using active appearance models , 2013, 2013 World Haptics Conference (WHC).

[15]  R. Klatzky,et al.  Haptic identification of common objects: Effects of constraining the manual exploration process , 2004, Perception & psychophysics.

[16]  Carl D. Meyer,et al.  Matrix Analysis and Applied Linear Algebra , 2000 .

[17]  이형석,et al.  Motion Capture System의 비교 분석 및 소개 , 2002 .

[18]  J. F. Soechting,et al.  Force synergies for multifingered grasping , 2000, Experimental Brain Research.

[19]  R. S. Johansson,et al.  Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects , 2004, Experimental Brain Research.

[20]  Robert B. Fisher,et al.  Estimating 3-D rigid body transformations: a comparison of four major algorithms , 1997, Machine Vision and Applications.

[21]  Edoardo Battaglia,et al.  ThimbleSense: An individual-digit wearable tactile sensor for experimental grasp studies , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[22]  J. F. Soechting,et al.  Multi-digit control of contact forces during rotation of a hand-held object. , 2008, Journal of neurophysiology.

[23]  M. Santello,et al.  Anticipatory Planning and Control of Grasp Positions and Forces for Dexterous Two-Digit Manipulation , 2010, The Journal of Neuroscience.

[24]  R. Johansson,et al.  First spikes in ensembles of human tactile afferents code complex spatial fingertip events , 2004, Nature Neuroscience.

[25]  Miles C. Bowman,et al.  Control strategies in object manipulation tasks , 2006, Current Opinion in Neurobiology.

[26]  John Hollerbach,et al.  Rigid body load identification for manipulators , 1985, 1985 24th IEEE Conference on Decision and Control.

[27]  Mark L Latash,et al.  Multifinger Prehension: An Overview , 2008, Journal of motor behavior.