Data-driven human grasp movement analysis

Humans tend to simplify the space of possible grasps they can perform. Yet, the description of human hand motions is very complex, and methods to reduce this complexity have attracted much attention in the motor control literature. Important implications in robot hand design and programming have also generated a wide interest in the robotics research community. Early studies prevalently used direct analysis methods such as visual inspection to define grasp taxonomies. More recently, analytical methods have been employed to perform grasping data dimensionality reduction. In this paper, we present a methodology to reconcile these two distinct and apparently incompatible approaches under a unified framework: this allows us to obtain a data-generated grasp taxonomy along with low-dimensional representations which could be used for human grasping data classification and posture reconstruction, as well as for simplifying grasp planning algorithms and robotic hands programming.

[1]  H. Harry Asada,et al.  Inter-finger coordination and postural synergies in robot hands via mechanical implementation of principal components analysis , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[3]  Ales Leonardis,et al.  Visual learning and recognition of a probabilistic spatio-temporal model of cyclic human locomotion , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[4]  T. Auton Applied Functional Data Analysis: Methods and Case Studies , 2004 .

[5]  Aaron M. Dollar,et al.  Grasp Frequency and Usage in Daily Household and Machine Shop Tasks , 2013, IEEE Transactions on Haptics.

[6]  Danica Kragic,et al.  Grasp Recognition for Programming by Demonstration , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[7]  Tom M. Mitchell,et al.  Feature selection for grasp recognition from optical markers , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Magnus Egerstedt,et al.  Time and output warping of control systems: Comparing and imitating motions , 2010, ACC 2010.

[9]  Matteo Bianchi,et al.  Synergy-based hand pose sensing: Reconstruction enhancement , 2012, Int. J. Robotics Res..

[10]  Wei Dai,et al.  Functional analysis of grasping motion , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Aaron M. Dollar,et al.  A Hand-Centric Classification of Human and Robot Dexterous Manipulation , 2013, IEEE Transactions on Haptics.

[12]  Andrea Fusiello,et al.  Robust Multiple Structures Estimation with J-Linkage , 2008, ECCV.

[13]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[14]  Zhi-Hong Mao,et al.  Dimensionality Reduction in Control and Coordination of the Human Hand , 2008, IEEE Transactions on Biomedical Engineering.

[15]  Matei T. Ciocarlie,et al.  Hand Posture Subspaces for Dexterous Robotic Grasping , 2009, Int. J. Robotics Res..

[16]  J. Fischer,et al.  The Prehensile Movements of the Human Hand , 2014 .

[17]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[18]  Maja J. Mataric,et al.  Deriving action and behavior primitives from human motion data , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Manuel G. Catalano,et al.  Grasping with Soft Hands , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[20]  Katsushi Ikeuchi,et al.  A Hidden Markov Model Based Sensor Fusion Approach for Recognizing Continuous Human Grasping Sequences , 2003 .

[21]  Amy J Bastian,et al.  Multidigit Movement Synergies of the Human Hand in an Unconstrained Haptic Exploration Task , 2008, The Journal of Neuroscience.

[22]  Jernej Barbic,et al.  Segmenting Motion Capture Data into Distinct Behaviors , 2004, Graphics Interface.

[23]  I. Jolliffe Principal Component Analysis and Factor Analysis , 1986 .

[24]  Horst Bischof,et al.  Multiple eigenspaces , 2002, Pattern Recognit..

[25]  Manuel G. Catalano,et al.  Adaptive synergies for the design and control of the Pisa/IIT SoftHand , 2014, Int. J. Robotics Res..

[26]  Minas V. Liarokapis,et al.  HandCorpus, a New Open-Access Repository for Sharing Experimental Data and Results on Human and Arti , 2013, WHC 2013.

[27]  Stefan Schaal,et al.  Robot Programming by Demonstration , 2009, Springer Handbook of Robotics.

[28]  Zhi-Hong Mao,et al.  Temporal Postural Synergies of the Hand in Rapid Grasping Tasks , 2010, IEEE Transactions on Information Technology in Biomedicine.

[29]  Matteo Bianchi,et al.  A data-driven kinematic model of the human hand with soft-tissue artifact compensation mechanism for grasp synergy analysis , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[30]  Matteo Bianchi,et al.  Synergy-based hand pose sensing: Optimal glove design , 2012, Int. J. Robotics Res..