Tactile Sensing and Control of Robotic Manipulator Integrating Fiber Bragg Grating Strain-Sensor

Tactile sensing is an instrumental modality of robotic manipulation, as it provides information that is not accessible via remote sensors such as cameras or lidars. Touch is particularly crucial in unstructured environments, where the robot's internal representation of manipulated objects is uncertain. In this study we present the sensorization of an existing artificial hand, with the aim to achieve fine control of robotic limbs and perception of object's physical properties. Tactile feedback is conveyed by means of a soft sensor integrated at the fingertip of a robotic hand. The sensor consists of an optical fiber, housing Fiber Bragg Gratings (FBGs) transducers, embedded into a soft polymeric material integrated on a rigid hand. Through several tasks involving grasps of different objects in various conditions, the ability of the system to acquire information is assessed. Results show that a classifier based on the sensor outputs of the robotic hand is capable of accurately detecting both size and rigidity of the operated objects (99.36 and 100% accuracy, respectively). Furthermore, the outputs provide evidence of the ability to grab fragile objects without breakage or slippage e and to perform dynamic manipulative tasks, that involve the adaptation of fingers position based on the grasped objects' condition.

[1]  Sergio Silvestri,et al.  Optical-Fiber Measurement Systems for Medical Applications , 2011 .

[2]  Chulki Kim,et al.  A dome-shaped piezoelectric tactile sensor arrays fabricated by an air inflation technique , 2014 .

[3]  Ian A. Gravagne,et al.  Goldfinger: a non-anthropomorphic, dextrous robot hand , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[4]  Antonio Bicchi,et al.  Hands for dexterous manipulation and robust grasping: a difficult road toward simplicity , 2000, IEEE Trans. Robotics Autom..

[5]  Emiliano Schena,et al.  Medical Smart Textiles Based on Fiber Optic Technology: An Overview , 2015, Journal of functional biomaterials.

[6]  Giulio Sandini,et al.  Tactile Sensing—From Humans to Humanoids , 2010, IEEE Transactions on Robotics.

[7]  Marcia Muller,et al.  Tactile Sensor Array with Fiber Bragg Gratings in Quasi-Distributed Sensing , 2018, J. Sensors.

[8]  A. Loi,et al.  Piezoelectric polymer transducer arrays for flexible tactile sensors , 2012, 2012 IEEE Sensors.

[9]  S. Corbellini,et al.  Piezoresistive flexible composite for robotic tactile applications , 2014 .

[10]  Hong Liu,et al.  DLR-Hand II: next generation of a dextrous robot hand , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[11]  Véronique Perdereau,et al.  Tactile sensing in dexterous robot hands - Review , 2015, Robotics Auton. Syst..

[12]  Takao Someya,et al.  Bionic skins using flexible organic devices , 2014, 2014 IEEE 27th International Conference on Micro Electro Mechanical Systems (MEMS).

[13]  Mohammad A. Qasaimeh,et al.  PVDF-Based Microfabricated Tactile Sensor for Minimally Invasive Surgery , 2009, Journal of Microelectromechanical Systems.

[14]  Eduardo Palermo,et al.  Neuromorphic haptic glove and platform with gestural control for tactile sensory feedback in medical telepresence applications , 2018, 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[15]  Joel W. Burdick,et al.  Team RoboSimian: Semi‐autonomous Mobile Manipulation at the 2015 DARPA Robotics Challenge Finals , 2017, J. Field Robotics.

[16]  P. Ajayan,et al.  CORRIGENDUM: Super-stretchable, Transparent Carbon Nanotube-Based Capacitive Strain Sensors for Human Motion Detection , 2013, Scientific Reports.

[17]  Mark A. Arnold Fiber-Optic Chemical Sensors , 1992 .

[18]  Ravinder Dahiya,et al.  Tactile sensing for robotic applications , 2008 .

[19]  Giorgio Metta,et al.  Methods and Technologies for the Implementation of Large-Scale Robot Tactile Sensors , 2011, IEEE Transactions on Robotics.

[20]  Hongbin Liu,et al.  Research on pressure tactile sensing technology based on fiber Bragg grating array , 2015 .

[21]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[22]  Marcia Muller,et al.  Sparse Force Mapping System Based on Compressive Sensing , 2017, IEEE Transactions on Instrumentation and Measurement.

[23]  Octavian Postolache,et al.  Tactile Sensors for Robotic Applications , 2013 .

[24]  Kaspar Althoefer,et al.  Tactile sensing for dexterous in-hand manipulation in robotics-A review , 2011 .

[25]  Qi Jiang,et al.  Design and Experimental Research on Small-Structures of Tactile Sensor Array Unit Based on Fiber Bragg Grating , 2017, IEEE Sensors Journal.

[26]  Hiroyuki Shinoda,et al.  Robot skin based on touch-area-sensitive tactile element , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[27]  Jung-Ju Lee,et al.  System Design and Evaluation of the Robot Tactile Sensor Using the Microbending Fiber Optic Sensors , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[28]  J. Sirohi,et al.  Fundamental Understanding of Piezoelectric Strain Sensors , 1999, Smart Structures.

[29]  J. Heo,et al.  Tactile sensor arrays using fiber Bragg grating sensors , 2006 .

[30]  Daniel M. Vogt,et al.  Design and Characterization of a Soft Multi-Axis Force Sensor Using Embedded Microfluidic Channels , 2013, IEEE Sensors Journal.

[31]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[32]  Siamak Najarian,et al.  Tactile Sensor for Robotic Applications , 2009 .

[33]  R. Johansson,et al.  Responses of mechanoreceptive afferent units in the glabrous skin of the human hand to sinusoidal skin displacements , 1982, Brain Research.

[34]  Mark R. Cutkosky,et al.  Biologically inspired tactile classification of object-hand and object-world interactions , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[35]  Brian W. Satzinger,et al.  Mobile Manipulation and Mobility as Manipulation—Design and Algorithms of RoboSimian , 2015, J. Field Robotics.

[36]  Paul Ciprian Patic,et al.  THE BARRETTHAND GRASPER - PROGRAMMABLY FLEXIBLE PART HANDLING AND ASSEMBLY , 2006 .

[37]  R. Winland,et al.  Feedback. , 2020, General dentistry.

[38]  Hongliang Ren,et al.  A High-Sensitivity Tactile Sensor Array Based on Fiber Bragg Grating Sensing for Tissue Palpation in Minimally Invasive Surgery , 2018, IEEE/ASME Transactions on Mechatronics.

[39]  Mark R. Cutkosky,et al.  Force and Tactile Sensors , 2008, Springer Handbook of Robotics.

[40]  P.M. Mendes,et al.  PVC Smart Sensing Foil for Advanced Strain Measurements , 2010, IEEE Sensors Journal.

[41]  Russell H. Taylor,et al.  Miniature fiber-optic force sensor based on low-coherence Fabry-Pérot interferometry for vitreoretinal microsurgery , 2012, Biomedical optics express.

[42]  Kaspar Althoefer,et al.  MRI-Compatible Fiber-Optic Force Sensors for Catheterization Procedures , 2010, IEEE Sensors Journal.

[43]  Claudio Melchiorri,et al.  The UB Hand II control system: design features and experimental results , 1994, Proceedings of IECON'94 - 20th Annual Conference of IEEE Industrial Electronics.

[44]  Chang Liu,et al.  Recent Progress in Technologies for Tactile Sensors , 2018, Sensors.

[45]  Ruben D. Ponce Wong,et al.  Sensors and Actuators A: Physical , 2022 .

[46]  Ming-Shyan Wang,et al.  Flexible tactile sensor for the grasping control of robot fingers , 2013, 2013 International Conference on Advanced Robotics and Intelligent Systems.

[47]  Yaonan Wang,et al.  Multi-Component FBG-Based Force Sensing Systems by Comparison With Other Sensing Technologies: A Review , 2018, IEEE Sensors Journal.

[48]  Sachin Chitta,et al.  Human-Inspired Robotic Grasp Control With Tactile Sensing , 2011, IEEE Transactions on Robotics.

[49]  William B. Spillman,et al.  Fiber optic sensors : an introduction for engineers and scientists , 2011 .

[50]  O. Wolfbeis,et al.  Fiber-optic chemical sensors and biosensors (2008-2012). , 2013, Analytical chemistry.

[51]  Nicola Vitiello,et al.  Feedforward Neural Network for Force Coding of an MRI-Compatible Tactile Sensor Array Based on Fiber Bragg Grating , 2015, J. Sensors.

[52]  S. Pirozzi Multi-point force sensor based on crossed optical fibers , 2012 .

[53]  Merve Acer,et al.  Development and characterization of silicone embedded distributed piezoelectric sensors for contact detection , 2015 .

[54]  Y. Yang,et al.  A flexible tactile and shear sensing array fabricated using a novel buckypaper patterning technique , 2015 .

[55]  Jan Wikander,et al.  Tactile sensing in intelligent robotic manipulation - a review , 2005, Ind. Robot.

[56]  Jorge Pomares,et al.  Control Framework for Dexterous Manipulation Using Dynamic Visual Servoing and Tactile Sensors' Feedback , 2014, Sensors.

[57]  Lucia Beccai,et al.  A miniaturized and flexible optoelectronic sensing system for tactile skin , 2007 .

[58]  P. Rossini,et al.  Intraneural stimulation elicits discrimination of textural features by artificial fingertip in intact and amputee humans , 2016, eLife.

[59]  R. Johansson,et al.  Tactile sensibility in the human hand: relative and absolute densities of four types of mechanoreceptive units in glabrous skin. , 1979, The Journal of physiology.

[60]  O. Wolfbeis Fiber-optic chemical sensors and biosensors. , 2004, Analytical chemistry.