Modelling natural and artificial hands with synergies

We report on recent work in modelling the process of grasping and active touch by natural and artificial hands. Starting from observations made in human hands about the correlation of degrees of freedom in patterns of more frequent use (postural synergies), we consider the implications of a geometrical model accounting for such data, which is applicable to the pre-grasping phase occurring when shaping the hand before actual contact with the grasped object. To extend applicability of the synergy model to study force distribution in the actual grasp, we introduce a modified model including the mechanical compliance of the hand's musculotendinous system. Numerical results obtained by this model indicate that the same principal synergies observed from pre-grasp postural data are also fundamental in achieving proper grasp force distribution. To illustrate the concept of synergies in the dual domain of haptic sensing, we provide a review of models of how the complexity and heterogeneity of sensory information from touch can be harnessed in simplified, tractable abstractions. These abstractions are amenable to fast processing to enable quick reflexes as well as elaboration of high-level percepts. Applications of the synergy model to the design and control of artificial hands and tactile sensors are illustrated.

[1]  M. Peterson,et al.  Inhibitory competition in figure-ground perception: context and convexity. , 2008, Journal of vision.

[2]  A. Bicchi,et al.  Tactile flow explains haptic counterparts of common visual illusions , 2008, Brain Research Bulletin.

[3]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[4]  Marc H Schieber,et al.  Hand function: peripheral and central constraints on performance. , 2004, Journal of applied physiology.

[5]  R. Klatzky,et al.  Haptic identification of common objects: Effects of constraining the manual exploration process , 2004, Perception & psychophysics.

[6]  Antonio Bicchi,et al.  Experimental Evaluation of Friction Data with an Articulated Hand and Intrinsic Contact Sensors , 1993 .

[7]  Antonio Bicchi,et al.  Analysis and optimization of tendinous actuation for biomorphically designed robotic systems , 2000, Robotica.

[8]  Suguru Arimoto,et al.  Feedback control for object manipulation by a pair of soft tip fingers , 2002, Robotica.

[9]  Antonio Bicchi,et al.  On the role of hand synergies in the optimal choice of grasping forces , 2010, Auton. Robots.

[10]  D Marr,et al.  Directional selectivity and its use in early visual processing , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[11]  Amy J Bastian,et al.  Multidigit Movement Synergies of the Human Hand in an Unconstrained Haptic Exploration Task , 2008, The Journal of Neuroscience.

[12]  M T Turvey,et al.  Obtaining information by dynamic (effortful) touching , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[13]  J H Jackson,et al.  REMARKS on the RELATIONS of DIFFERENT DIVISIONS of the CENTRAL NERVOUS SYSTEM to ONE ANOTHER and to PARTS of the BODY , 1898, British medical journal.

[14]  BENJAMIN WARD RICHARDSON,et al.  Aristotle on the Parts of Animals , 1882, Nature.

[15]  J. K. Salisbury,et al.  Kinematic and Force Analysis of Articulated Mechanical Hands , 1983 .

[16]  M. Turvey Action and perception at the level of synergies. , 2007, Human movement science.

[17]  Antonio Bicchi,et al.  Haptic discrimination of softness in teleoperation: the role of the contact area spread rate , 2000, IEEE Trans. Robotics Autom..

[18]  Domenico Prattichizzo,et al.  Multi-point Interaction with Real and Virtual Objects , 2005, Springer Tracts in Advanced Robotics.

[19]  N. A. Bernshteĭn The co-ordination and regulation of movements , 1967 .

[20]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[21]  Antonio Bicchi,et al.  The role of contact area spread rate in haptic discrimination of softness , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[22]  Peter K. Allen,et al.  Graspit! A versatile simulator for robotic grasping , 2004, IEEE Robotics & Automation Magazine.

[23]  Rieko Osu,et al.  CNS Learns Stable, Accurate, and Efficient Movements Using a Simple Algorithm , 2008, The Journal of Neuroscience.

[24]  Gregor Schöner,et al.  The uncontrolled manifold concept: identifying control variables for a functional task , 1999, Experimental Brain Research.

[25]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[26]  John Kenneth Salisbury,et al.  Contact Sensing from Force Measurements , 1990, Int. J. Robotics Res..

[27]  Marco Santello,et al.  Patterns of Hand Motion during Grasping and the Influence of Sensory Guidance , 2002, The Journal of Neuroscience.

[28]  M. Srinivasan,et al.  Tactual discrimination of softness. , 1995, Journal of neurophysiology.

[29]  M. Ernst,et al.  The statistical determinants of adaptation rate in human reaching. , 2008, Journal of vision.

[30]  Roberta L Klatzky,et al.  Haptic object perception: spatial dimensionality and relation to vision , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[31]  Vincent Hayward,et al.  Is there a ‘plenhaptic’ function? , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[32]  Vijay Kumar,et al.  Robotic grasping and contact: a review , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[33]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[34]  Wolfram Burgard,et al.  Robotics: Science and Systems XV , 2010 .

[35]  Matei T. Ciocarlie,et al.  Dimensionality reduction for hand-independent dexterous robotic grasping , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[36]  G. Lakoff,et al.  Philosophy in the flesh : the embodied mind and its challenge to Western thought , 1999 .

[37]  Antonio Bicchi,et al.  Tactile Flow and Haptic Discrimination of Softness , 2005, Multi-point Interaction with Real and Virtual Objects.

[38]  D. C. Schoen The Hand , 2009, Orthopedic nursing.

[39]  Matteo Bianchi,et al.  Rendering Softness: Integration of Kinesthetic and Cutaneous Information in a Haptic Device , 2010, IEEE Transactions on Haptics.

[40]  Paul Weiss,et al.  SELF-DIFFERENTIATION OF THE BASIC PATTERNS OF COORDINATION , 1968 .

[41]  Antonio Bicchi,et al.  Rolling bodies with regular surface: controllability theory and applications , 2000, IEEE Trans. Autom. Control..

[42]  H. Harry Asada,et al.  Inter-finger coordination and postural synergies in robot hands via mechanical implementation of principal components analysis , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[43]  T. Easton On the normal use of reflexes. , 1972, American scientist.

[44]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[45]  S. Gruber,et al.  Robot hands and the mechanics of manipulation , 1987, Proceedings of the IEEE.