Bio-inspired grasp control in a robotic hand with massive sensorial input

The capability of grasping and lifting an object in a suitable, stable and controlled way is an outstanding feature for a robot, and thus far, one of the major problems to be solved in robotics. No robotic tools able to perform an advanced control of the grasp as, for instance, the human hand does, have been demonstrated to date. Due to its capital importance in science and in many applications, namely from biomedics to manufacturing, the issue has been matter of deep scientific investigations in both the field of neurophysiology and robotics. While the former is contributing with a profound understanding of the dynamics of real-time control of the slippage and grasp force in the human hand, the latter tries more and more to reproduce, or take inspiration by, the nature’s approach, by means of hardware and software technology. On this regard, one of the major constraints robotics has to overcome is the real-time processing of a large amounts of data generated by the tactile sensors while grasping, which poses serious problems to the available computational power. In this paper a bio-inspired approach to tactile data processing has been followed in order to design and test a hardware–software robotic architecture that works on the parallel processing of a large amount of tactile sensing signals. The working principle of the architecture bases on the cellular nonlinear/neural network (CNN) paradigm, while using both hand shape and spatial–temporal features obtained from an array of microfabricated force sensors, in order to control the sensory-motor coordination of the robotic system. Prototypical grasping tasks were selected to measure the system performances applied to a computer-interfaced robotic hand. Successful grasps of several objects, completely unknown to the robot, e.g. soft and deformable objects like plastic bottles, soft balls, and Japanese tofu, have been demonstrated.

[1]  R. Johansson Tactile sensibility in the human hand: receptive field characteristics of mechanoreceptive units in the glabrous skin area. , 1978, The Journal of physiology.

[2]  R. Johansson,et al.  Spatial properties of the population of mechanoreceptive units in the glabrous skin of the human hand , 1980, Brain Research.

[3]  J. Rothwell Principles of Neural Science , 1982 .

[4]  Lin-Bao Yang,et al.  Cellular neural networks: theory , 1988 .

[5]  Leon O. Chua,et al.  Cellular neural networks: applications , 1988 .

[6]  Mark R. Cutkosky,et al.  Sensing skin acceleration for slip and texture perception , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[7]  M. Srinivasan,et al.  Tactile detection of slip: surface microgeometry and peripheral neural codes. , 1990, Journal of neurophysiology.

[8]  John Kenneth Salisbury,et al.  Experimental Evaluation of Friction Characteristics with an Articulated Robotic Hand , 1991, ISER.

[9]  Tamás Roska,et al.  The use of CNN models in the subcortical visual pathway. (Reseach report of the Dual and Neural Computing Systems Laboratory DNS-16-1992) , 1993 .

[10]  R. Johansson,et al.  Predictive feed-forward sensory control during grasping and manipulation in man , 1993 .

[11]  Leon O. Chua,et al.  The CNN paradigm , 1993 .

[12]  Robert D. Howe,et al.  Tactile sensing and control of robotic manipulation , 1993, Adv. Robotics.

[13]  John Kenneth Salisbury,et al.  Application of Change Detection to Dynamic Contact Sensing , 1994, Int. J. Robotics Res..

[14]  Lorenzo Marconi,et al.  Slip detection by tactile sensors: algorithms and experimental results , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[15]  Roland S. Johansson,et al.  Sensory Control of Dexterous Manipulation in Humans , 1996 .

[16]  M. Cutkosky,et al.  Manipulation Control with Dynamic Tactile Sensing , 1997 .

[17]  P Jenmalm,et al.  Visual and Somatosensory Information about Object Shape Control Manipulative Fingertip Forces , 1997, The Journal of Neuroscience.

[18]  Matteo Campanella,et al.  Detection of incipient object slippage by skin-like sensing and neural network processing , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[19]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[20]  R. Johansson,et al.  Control of grasp stability in humans under different frictional conditions during multidigit manipulation. , 1999, Journal of neurophysiology.

[21]  Nikos A. Aspragathos,et al.  Fuzzy logic grasp control using tactile sensors , 2001 .

[22]  S. Schultz Principles of Neural Science, 4th ed. , 2001 .

[23]  Maria Chiara Carrozza,et al.  A Human-like Robotic Manipulation System Implementing Human Models of Sensory-Motor Coordination , 2002 .

[24]  Joel L. Davis,et al.  Neurotechnology for Biomimetic Robots , 2002 .

[25]  Roland S Johansson,et al.  Predictions Specify Reactive Control of Individual Digits in Manipulation , 2002, The Journal of Neuroscience.

[26]  Leon O. Chua,et al.  Cellular Neural Networks and Visual Computing: Foundations and Applications , 2002 .

[27]  Yoji Umetani,et al.  Identification of Incipient Slip Phenomena Based on The Circuit Output Signals of PVDF Film Strips E , 2004 .

[28]  Ángel Rodríguez-Vázquez,et al.  ACE16k: the third generation of mixed-signal SIMD-CNN ACE chips toward VSoCs , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[29]  R. Johansson,et al.  Control of grip force during restraint of an object held between finger and thumb: responses of cutaneous afferents from the digits , 1996, Experimental Brain Research.

[30]  R. S. Johansson,et al.  Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects , 2004, Experimental Brain Research.

[31]  R. Johansson,et al.  Signals in tactile afferents from the fingers eliciting adaptive motor responses during precision grip , 2004, Experimental Brain Research.

[32]  R. Johansson,et al.  First spikes in ensembles of human tactile afferents code complex spatial fingertip events , 2004, Nature Neuroscience.

[33]  R. Johansson,et al.  Responses in glabrous skin mechanoreceptors during precision grip in humans , 2004, Experimental Brain Research.

[34]  Tsukasa Ogasawara,et al.  A fingerprint pointing device utilizing the deformation of the fingertip during the incipient slip , 2005, IEEE Transactions on Robotics.

[35]  G. Teti,et al.  A bio-inspired sensory-motor neural model for a neuro-robotic manipulation platform , 2005, ICAR '05. Proceedings., 12th International Conference on Advanced Robotics, 2005..

[36]  Ferenc Kovács,et al.  3D tactile sensor array processed by CNN-UM: a fast method for detecting and identifying slippage and twisting motion , 2006, Int. J. Circuit Theory Appl..

[37]  Minoru Asada,et al.  Anthropomorphic robotic soft fingertip with randomly distributed receptors , 2006, Robotics Auton. Syst..

[38]  Paolo Dario,et al.  Extension to End-effector Position and Orientation Control of a Learning-based Neurocontroller for a Humanoid Arm , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[39]  Lucia Beccai,et al.  Experimental Analysis of a Soft Compliant Tactile Microsensor to be Integrated in an Anthropomorphic Artificial Hand , 2006 .

[40]  Silvestro Micera,et al.  Design of a cybernetic hand for perception and action , 2006, Biological Cybernetics.

[41]  Lucia Beccai,et al.  A miniaturized and flexible optoelectronic sensing system for tactile skin , 2007 .

[42]  Charles C. Kemp,et al.  Challenges for robot manipulation in human environments [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[43]  Arianna Menciassi,et al.  A Micro-Optical Transducer for Sensing Applications , 2008 .

[44]  P. Dario,et al.  Development and Experimental Analysis of a Soft Compliant Tactile Microsensor for Anthropomorphic Artificial Hand , 2008, IEEE/ASME Transactions on Mechatronics.

[45]  S. Roccella,et al.  Bio-inspired sensorization of a biomechatronic robot hand for the grasp-and-lift task , 2008, Brain Research Bulletin.