Dataset of Tactile Signatures of the Human Right Hand in Twenty-One Activities of Daily Living Using a High Spatial Resolution Pressure Sensor

Successful grasping with multi-fingered prosthetic or robotic hands remains a challenge to be solved for the effective use of these hands in unstructured environments. To this end, currently available tactile sensors need to improve their sensitivity, robustness, and spatial resolution, but a better knowledge of the distribution of contact forces in the human hand in grasping tasks is also necessary. The human tactile signatures can inform models for an efficient control of the artificial hands. In this study we present and analyze a dataset of tactile signatures of the human hand in twenty-one representative activities of daily living, obtained using a commercial high spatial resolution pressure sensor. The experiments were repeated for twenty-two subjects. The whole dataset includes more than one hundred million pressure data. The effect of the task and the subject on the grip force and the contribution to this grip force made by the different hand regions were analyzed. We also propose a method to effectively synchronize the measurements from different subjects and a method to represent the tactile signature of each task, highlighting the hand regions mainly involved in the task. The correlations between hand regions and between different tasks were also analyzed.

[1]  Fong-Chin Su,et al.  The Force Synergy of Human Digits in Static and Dynamic Cylindrical Grasps , 2013, PloS one.

[2]  Yang Yang,et al.  A Deep Learning Approach to Grasping the Invisible , 2020, IEEE Robotics and Automation Letters.

[3]  Pavol Bezak,et al.  Advanced Robotic Grasping System Using Deep Learning , 2014 .

[4]  M. Latash,et al.  Effects of friction at the digit-object interface on the digit forces in multi-finger prehension , 2006, Experimental Brain Research.

[5]  Danica Kragic,et al.  Learning the tactile signatures of prototypical object parts for robust part-based grasping of novel objects , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Kaiyong Zhao,et al.  Vision-based robotic grasping from object localization, object pose estimation to grasp estimation for parallel grippers: a review , 2020, Artificial Intelligence Review.

[7]  Ren G Dong,et al.  Analysis of the effects of surface stiffness on the contact interaction between a finger and a cylindrical handle using a three-dimensional hybrid model. , 2014, Medical engineering & physics.

[8]  Maria Bauzá,et al.  Tactile Regrasp: Grasp Adjustments via Simulated Tactile Transformations , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  Gong Zhang,et al.  A review: machine learning on robotic grasping , 2019, International Conference on Machine Vision.

[10]  Peter K. Allen,et al.  Stable grasping under pose uncertainty using tactile feedback , 2014, Auton. Robots.

[11]  Veronica J. Santos,et al.  Independent digit contributions to rotational manipulation in a three-digit pouring task requiring dynamic stability , 2015, Experimental Brain Research.

[12]  Sergey Levine,et al.  Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection , 2016, Int. J. Robotics Res..

[13]  Joachim Hermsdörfer,et al.  Anticipatory scaling of grip forces when lifting objects of everyday life , 2011, Experimental Brain Research.

[14]  Kenji Tahara,et al.  Grasp and dexterous manipulation of multi-fingered robotic hands: a review from a control view point , 2017, Adv. Robotics.

[15]  R W McGorry,et al.  Power grip strength as a function of tool handle orientation and location , 2007, Ergonomics.

[16]  Wojciech Matusik,et al.  Learning the signatures of the human grasp using a scalable tactile glove , 2019, Nature.

[17]  Akhtar Khurshid,et al.  Robotic Grasping and Fine Manipulation Using Soft Fingertip , 2011 .

[18]  C Pylatiuk,et al.  Distribution of grip force in three different functional prehension patterns , 2006, Journal of medical engineering & technology.

[19]  Antonio Pérez-González,et al.  Grip force and force sharing in two different manipulation tasks with bottles , 2017, Ergonomics.

[20]  Gregory P Slota,et al.  Radial force distribution changes associated with tangential force production in cylindrical grasping, and the importance of anatomical registration. , 2012, Journal of biomechanics.

[21]  Qian Wan Improving Tactile Sensing for Robotic Grasping , 2019 .

[22]  Danilo Corrêa Silva,et al.  Evaluation of two wheelchair hand rim models: contact pressure distribution in straight line and curve trajectories , 2019, Ergonomics.

[23]  J. F. Soechting,et al.  Force synergies for multifingered grasping , 2000, Experimental Brain Research.

[24]  Ashutosh Saxena,et al.  Robotic Grasping of Novel Objects , 2006, NIPS.

[25]  Volker Dietz,et al.  Neural coordination of bilateral power and precision finger movements , 2020, The European journal of neuroscience.

[26]  Yong-Ku Kong,et al.  Handle grip span for optimising finger-specific force capability as a function of hand size , 2009, Ergonomics.

[27]  Danica Kragic,et al.  Learning of grasp adaptation through experience and tactile sensing , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  T. Armstrong,et al.  Quantification of hand grasp force using a pressure mapping system. , 2012, Work.

[29]  Yong-Ku Kong,et al.  Evaluation of total grip strength and individual finger forces on opposing (A-type) handles among Koreans , 2014, Ergonomics.

[30]  Hugo Gamboa,et al.  Time Alignment Measurement for Time Series , 2018, Pattern Recognit..