A Review of Tactile Information: Perception and Action Through Touch

Tactile sensing is a key sensor modality for robots interacting with their surroundings. These sensors provide a rich and diverse set of data signals that contain detailed information collected from contacts between the robot and its environment. The data are however not limited to individual contacts and can be used to extract a wide range of information about the objects in the environment as well as the actions of the robot during the interactions. In this article, we provide an overview of tactile information and its applications in robotics. We present a hierarchy consisting of raw, contact, object, and action levels to structure the tactile information, with higher-level information often building upon lower-level information. We discuss different types of information that can be extracted at each level of the hierarchy. The article also includes an overview of different types of robot applications and the types of tactile information that they employ. Finally we end the article with a discussion for future tactile applications which are still beyond the current capabilities of robots.

[1]  Giulio Sandini,et al.  An embedded artificial skin for humanoid robots , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[2]  Helge J. Ritter,et al.  Distinguishing sliding from slipping during object pushing , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Danica Kragic,et al.  Enhancing visual perception of shape through tactile glances , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Nikolaos G. Tsagarakis,et al.  Center-of-Mass-Based Grasp Pose Adaptation Using 3D Range and Force/Torque Sensing , 2018, Int. J. Humanoid Robotics.

[5]  Ning Chen,et al.  Local object shape from tactile sensing , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[6]  Masatoshi Ishikawa,et al.  High-Speed High-Precision Proximity Sensor for Detection of Tilt, Distance, and Contact , 2018, IEEE Robotics and Automation Letters.

[7]  Stefan Schaal,et al.  Data-Driven Online Decision Making for Autonomous Manipulation , 2015, Robotics: Science and Systems.

[8]  Aiguo Ming,et al.  Grasping force control of multi-fingered robot hand based on slip detection using tactile sensor , 2007, 2008 IEEE International Conference on Robotics and Automation.

[9]  Gaurav S. Sukhatme,et al.  Learning Manipulation Graphs from Demonstrations Using Multimodal Sensory Signals , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Gerald E. Loeb,et al.  Multimodal Tactile Sensor , 2014, The Human Hand as an Inspiration for Robot Hand Development.

[11]  Oliver Kroemer,et al.  In-Hand Object Pose Tracking via Contact Feedback and GPU-Accelerated Robotic Simulation , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Tsukasa Ogasawara,et al.  CPG-based manipulation: generation of rhythmic finger gaits from human observation , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[13]  Oliver Kroemer,et al.  Learning robot tactile sensing for object manipulation , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Raia Hadsell,et al.  From Pixels to Percepts: Highly Robust Edge Perception and Contour Following Using Deep Learning and an Optical Biomimetic Tactile Sensor , 2018, IEEE Robotics and Automation Letters.

[15]  T. Martin McGinnity,et al.  Reliable object handover through tactile force sensing and effort control in the Shadow Robot hand , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Alberto Rodriguez,et al.  Tactile Dexterity: Manipulation Primitives with Tactile Feedback , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Yuhua Zhang,et al.  Sensitivity enhancement of a micro-scale biomimetic tactile sensor with epidermal ridges , 2010 .

[18]  David J. Montana,et al.  The Kinematics of Contact and Grasp , 1988, Int. J. Robotics Res..

[19]  Sergey Levine,et al.  Learning Dexterous Manipulation Policies from Experience and Imitation , 2016, ArXiv.

[20]  Anders Robertsson,et al.  Robotic force estimation using motor torques and modeling of low velocity friction disturbances , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Minoru Asada,et al.  Compensation for tactile hysteresis using Gaussian process with sensory Markov property , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[22]  John M. Hollerbach,et al.  An integrated tactile and thermal sensor , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[23]  Vladimir J. Lumelsky,et al.  Development of sensitive skin for a 3D robot arm operating in an uncertain environment , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[24]  Gordon Cheng,et al.  Tactile-based active object discrimination and target object search in an unknown workspace , 2018, Autonomous Robots.

[25]  Ravi Balasubramanian,et al.  The Human Hand as an Inspiration for Robot Hand Development , 2014, Springer Tracts in Advanced Robotics.

[26]  Gaurav S. Sukhatme,et al.  Contact localization on grasped objects using tactile sensing , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[27]  Di Guo,et al.  Transmissive optical pretouch sensing for robotic grasping , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[28]  Vladimir J. Lumelsky,et al.  Motion planning for robot arm manipulators with proximity sensing , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[29]  Peter Englert,et al.  Active learning with query paths for tactile object shape exploration , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[30]  Robin Scott,et al.  External Force Estimation for Teleoperation Based on Proprioceptive Sensors , 2014 .

[31]  Helge J. Ritter,et al.  A highly sensitive 3D-shaped tactile sensor , 2013, 2013 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[32]  Sergey Levine,et al.  Manipulation by Feel: Touch-Based Control with Deep Predictive Models , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[33]  Maxime Chalon,et al.  EKF-based in-hand object localization from joint position and torque measurements , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[34]  Charles C. Kemp,et al.  Material Recognition from Heat Transfer given Varying Initial Conditions and Short-Duration Contact , 2015, Robotics: Science and Systems.

[35]  Kaspar Althoefer,et al.  Finger contact sensing and the application in dexterous hand manipulation , 2015, Autonomous Robots.

[36]  Loredana Zollo,et al.  Hierarchical reinforcement learning and central pattern generators for modeling the development of rhythmic manipulation skills , 2011, 2011 IEEE International Conference on Development and Learning (ICDL).

[37]  Mark H. Lee,et al.  A Survey of Robot Tactile Sensing Technology , 1989, Int. J. Robotics Res..

[38]  Charles C. Kemp,et al.  Tracking Human Pose During Robot-Assisted Dressing Using Single-Axis Capacitive Proximity Sensing , 2017, IEEE Robotics and Automation Letters.

[39]  Hong Zhang,et al.  Control of contact via tactile sensing , 2000, IEEE Trans. Robotics Autom..

[40]  Peter K. Allen,et al.  Learning grasp stability , 2012, 2012 IEEE International Conference on Robotics and Automation.

[41]  John Hollerbach,et al.  Rigid body load identification for manipulators , 1985, 1985 24th IEEE Conference on Decision and Control.

[42]  Shuji Hashimoto,et al.  Haptic Sensing Foot System for Humanoid Robot and Ground Recognition With One-Leg Balance , 2011, IEEE Transactions on Industrial Electronics.

[43]  Jan Wikander,et al.  Tactile sensing in intelligent robotic manipulation - a review , 2005, Ind. Robot.

[44]  Danfei Xu,et al.  Tactile identification of objects using Bayesian exploration , 2013, 2013 IEEE International Conference on Robotics and Automation.

[45]  Luigi Villani,et al.  A Conformable Force/Tactile Skin for Physical Human–Robot Interaction , 2016, IEEE Robotics and Automation Letters.

[46]  Miao Yu,et al.  Compliant multi-layer tactile sensing for enhanced identification of human touch , 2018, Smart Materials and Structures.

[47]  Gordon Cheng,et al.  Humanoids learn touch modalities identification via multi-modal robotic skin and robust tactile descriptors , 2015, Adv. Robotics.

[48]  Stefan Schaal,et al.  Skill learning and task outcome prediction for manipulation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[49]  Shigeki Sugano,et al.  Whole-body covering tactile interface for human robot coordination , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[50]  Stefan Schaal,et al.  Learning Sensor Feedback Models from Demonstrations via Phase-Modulated Neural Networks , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[51]  Zhiwei Luo,et al.  Development of the Tactile Sensor System of a Human-Interactive Robot “RI-MAN” , 2008, IEEE Transactions on Robotics.

[52]  Wolfram Burgard,et al.  Tactile Sensing for Mobile Manipulation , 2011, IEEE Transactions on Robotics.

[53]  S. Shankar Sastry,et al.  Kinematics and control of multifingered hands with rolling contact , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[54]  Hideaki Kawano,et al.  Object Shape and Force Estimation using Deep Learning and Optical Tactile Sensor , 2018 .

[55]  Jan Peters,et al.  Stable reinforcement learning with autoencoders for tactile and visual data , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[56]  Helge J. Ritter,et al.  A Control Framework for Tactile Servoing , 2013, Robotics: Science and Systems.

[57]  Nathan F. Lepora,et al.  Exploratory Tactile Servoing With Active Touch , 2017, IEEE Robotics and Automation Letters.

[58]  Jan Peters,et al.  Grip Stabilization of Novel Objects Using Slip Prediction , 2018, IEEE Transactions on Haptics.

[59]  Charles C. Kemp,et al.  Multimodal execution monitoring for anomaly detection during robot manipulation , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[60]  Stylianos Piperakis,et al.  Unsupervised Gait Phase Estimation for Humanoid Robot Walking* , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[61]  Aiguo Ming,et al.  High sensitivity initial slip sensor for dexterous grasp , 2010, 2010 IEEE International Conference on Robotics and Automation.

[62]  Jeffrey C. Trinkle,et al.  Dextrous manipulation by rolling and finger gaiting , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[63]  Minoru Asada,et al.  Learn to grasp utilizing anthropomorphic fingertips together with a vision sensor , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[64]  Mark Moll,et al.  Dynamic shape reconstruction using tactile sensors , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[65]  Gert Kootstra,et al.  Classification of rigid and deformable objects using a novel tactile sensor , 2011, 2011 15th International Conference on Advanced Robotics (ICAR).

[66]  Giulio Sandini,et al.  Tactile Sensing—From Humans to Humanoids , 2010, IEEE Transactions on Robotics.

[67]  Darwin G. Caldwell,et al.  Enhanced tactile feedback (tele-taction) using a multi-functional sensory system , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[68]  Tetsuyou Watanabe,et al.  Tough, bendable and stretchable tactile sensors array for covering robot surfaces , 2018, 2018 IEEE International Conference on Soft Robotics (RoboSoft).

[69]  Helge J. Ritter,et al.  Learning a tool's homogeneous transformation by tactile-based interaction , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[70]  Byron Boots,et al.  Robust Learning of Tactile Force Estimation through Robot Interaction , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[71]  KappassovZhanat,et al.  Tactile sensing in dexterous robot hands - Review , 2015 .

[72]  Woo-Chang Choi Polymer Micromachined Flexible Tactile Sensor for Three-Axial Loads Detection , 2010 .

[73]  Yong Yu,et al.  Estimation of mass and center of mass of graspless and shape-unknown object , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[74]  Máximo A. Roa,et al.  Grasp quality measures: review and performance , 2014, Autonomous Robots.

[75]  Robert Platt,et al.  Manipulation gaits: sequences of grasp control tasks , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[76]  Isao Shimoyama,et al.  A Tactile Sensor Using Piezoresistive Beams for Detection of the Coefficient of Static Friction , 2016, Sensors.

[77]  Robert D. Howe,et al.  Tactile sensing and control of robotic manipulation , 1993, Adv. Robotics.

[78]  Mark R. Cutkosky,et al.  Tactile Sensing and Terrain-Based Gait Control for Small Legged Robots , 2020, IEEE Transactions on Robotics.

[79]  Mark R. Cutkosky,et al.  Slip classification for dynamic tactile array sensors , 2016, Int. J. Robotics Res..

[80]  Van Anh Ho,et al.  What can be inferred from a tactile arrayed sensor in autonomous in-hand manipulation? , 2012, 2012 IEEE International Conference on Automation Science and Engineering (CASE).

[81]  Isao Shimoyama,et al.  Stretchable liquid tactile sensor for robot-joints , 2010, 2010 IEEE International Conference on Robotics and Automation.

[82]  Jakub W. Pachocki,et al.  Learning dexterous in-hand manipulation , 2018, Int. J. Robotics Res..

[83]  Advait Jain,et al.  Whole-arm tactile sensing for beneficial and acceptable contact during robotic assistance , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[84]  Gaurav S. Sukhatme,et al.  Learning to Switch Between Sensorimotor Primitives Using Multimodal Haptic Signals , 2016, SAB.

[85]  Christopher G. Atkeson,et al.  Implementing tactile behaviors using FingerVision , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[86]  Charles C. Kemp,et al.  Force and Thermal Sensing with a Fabric-based Skin , 2016 .

[87]  Tamim Asfour,et al.  A potential field approach to dexterous tactile exploration of unknown objects , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[88]  Van Anh Ho,et al.  Understanding Slip Perception of Soft Fingertips by Modeling and Simulating Stick-Slip Phenomenon , 2011, Robotics: Science and Systems.

[89]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[90]  Arne Wahrburg,et al.  Contact force estimation for robotic assembly using motor torques , 2014, 2014 IEEE International Conference on Automation Science and Engineering (CASE).

[91]  Siddhartha S. Srinivasa,et al.  Pose estimation for contact manipulation with manifold particle filters , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[92]  Gordon Cheng,et al.  A Tactile-Based Framework for Active Object Learning and Discrimination using Multimodal Robotic Skin , 2017, IEEE Robotics and Automation Letters.

[93]  Roland Siegwart,et al.  Haptic terrain classification for legged robots , 2010, 2010 IEEE International Conference on Robotics and Automation.

[94]  Mark R. Cutkosky,et al.  Force and Tactile Sensors , 2008, Springer Handbook of Robotics.

[95]  Gordon Cheng,et al.  TOMM: Tactile omnidirectional mobile manipulator , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[96]  Fernando Torres Medina,et al.  Finger Readjustment Algorithm for Object Manipulation Based on Tactile Information , 2013 .

[97]  Fumio Kanehiro,et al.  Cooperative works by a human and a humanoid robot , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[98]  Advait Jain,et al.  Tactile sensing over articulated joints with stretchable sensors , 2013, 2013 World Haptics Conference (WHC).

[99]  Shigeki Sugano,et al.  A Multimodal, Adjustable Sensitivity, Digital 3-Axis Skin Sensor Module , 2020, Sensors.

[100]  Gordon Cheng,et al.  In-hand object recognition via texture properties with robotic hands, artificial skin, and novel tactile descriptors , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[101]  R. Klatzky,et al.  Haptic perception: A tutorial , 2009, Attention, perception & psychophysics.

[102]  Fernando Torres,et al.  Adaptive tactile control for in-hand manipulation tasks of deformable objects , 2017 .

[103]  Shuji Hashimoto,et al.  Walking on the slopes with tactile sensing system for humanoid robot , 2010, ICCAS 2010.

[104]  Z. Stojiljkovic,et al.  Integrated Behavior of Artificial Skin , 1977, IEEE Transactions on Biomedical Engineering.

[105]  Giorgio Metta,et al.  A new design of a fingertip for the iCub hand , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[106]  Raphael Grimm,et al.  Visuo-Haptic Grasping of Unknown Objects based on Gaussian Process Implicit Surfaces and Deep Learning , 2019, 2019 IEEE-RAS 19th International Conference on Humanoid Robots (Humanoids).

[107]  Shigeki Sugano,et al.  Tactile object recognition using deep learning and dropout , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[108]  Hiroshi Mizoguchi,et al.  High-speed pressure sensor grid for humanoid robot foot , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[109]  Helge J. Ritter,et al.  Tactile Convolutional Networks for Online Slip and Rotation Detection , 2016, ICANN.

[110]  C.A. Brooks,et al.  Self-Supervised Classification for Planetary Rover Terrain Sensing , 2007, 2007 IEEE Aerospace Conference.

[111]  Helge J. Ritter,et al.  Using a Piezo-Resistive Tactile Sensor for Detection of Incipient Slippage , 2010, ISR/ROBOTIK.

[112]  Charles C. Kemp,et al.  A Handheld Device for the In Situ Acquisition of Multimodal Tactile Sensing Data , 2015, ArXiv.

[113]  Helge J. Ritter,et al.  Augmenting curved robot surfaces with soft tactile skin , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[114]  Aiguo Ming,et al.  Integrated control of a multi-fingered hand and arm using proximity sensors on the fingertips , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[115]  Claudio Melchiorri,et al.  Slip detection and control using tactile and force sensors , 2000 .

[116]  Gordon Cheng,et al.  Realizing whole-body tactile interactions with a self-organizing, multi-modal artificial skin on a humanoid robot , 2015, Adv. Robotics.

[117]  Jan Peters,et al.  Active tactile object exploration with Gaussian processes , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[118]  A. Kalamdani,et al.  Tactile sensing by the sole of the foot: part i: apparatus and initial experiments toward obtaining dynamic pressure maps useful for stabilizing standing, walking, and running of humanoid robots , 2006, 2006 IEEE International Workshop on Haptic Audio Visual Environments and their Applications (HAVE 2006).

[119]  Nathan F. Lepora,et al.  Model-Free Precise in-Hand Manipulation with a 3D-Printed Tactile Gripper , 2017, IEEE Robotics and Automation Letters.

[120]  Gerald E. Loeb,et al.  Haptic feature extraction from a biomimetic tactile sensor: Force, contact location and curvature , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[121]  Gaurav S. Sukhatme,et al.  Self-supervised regrasping using spatio-temporal tactile features and reinforcement learning , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[122]  Friedrich M. Wahl,et al.  On-line rigid object recognition and pose estimation based on inertial parameters , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[123]  Shuai Li,et al.  State estimation for dynamic systems with intermittent contact , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[124]  James M. Rehg,et al.  Inferring Object Properties with a Tactile-Sensing Array Given Varying Joint Stiffness and Velocity , 2014, Int. J. Humanoid Robotics.

[125]  Helge J. Ritter,et al.  Rotary object dexterous manipulation in hand: a feedback-based method , 2013, Int. J. Mechatronics Autom..

[126]  Aude Billard,et al.  Learning object-level impedance control for robust grasping and dexterous manipulation , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[127]  Jivko Sinapov,et al.  Deep Multi-Sensory Object Category Recognition Using Interactive Behavioral Exploration , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[128]  Fulvio Mastrogiovanni,et al.  Skin spatial calibration using force/torque measurements , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[129]  Robert B. Kelley,et al.  Using gripper mounted infrared proximity sensors for robot feedback control , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[130]  Tomonori Yamamoto,et al.  Use of tactile feedback to control exploratory movements to characterize object compliance , 2012, Front. Neurorobot..

[131]  Angel P. del Pobil,et al.  Reliable non-prehensile door opening through the combination of vision, tactile and force feedback , 2010, Auton. Robots.

[132]  Gordon Cheng,et al.  Robust Tactile Descriptors for Discriminating Objects From Textural Properties via Artificial Robotic Skin , 2018, IEEE Transactions on Robotics.

[133]  Sachin Chitta,et al.  Human-Inspired Robotic Grasp Control With Tactile Sensing , 2011, IEEE Transactions on Robotics.

[134]  Takashi Maeno,et al.  A Multi-Purpose Tactile Sensor Inspired by Human Finger for Texture and Tissue Stiffness Detection , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[135]  Isao Shimoyama,et al.  Evaluation of ground slippery condition during walk of bipedal robot using MEMS slip sensor , 2017, 2017 IEEE 30th International Conference on Micro Electro Mechanical Systems (MEMS).

[136]  Yong Yu,et al.  Estimation of Mass and Center of Mass of Unknown and Graspless Cylinder-like Object , 2004, Int. J. Inf. Acquis..

[137]  Matei Ciocarlie,et al.  Data-Driven Super-Resolution on a Tactile Dome , 2018, IEEE Robotics and Automation Letters.

[138]  Jorge Pomares,et al.  Control Framework for Dexterous Manipulation Using Dynamic Visual Servoing and Tactile Sensors' Feedback , 2014, Sensors.

[139]  Sungchul Kang,et al.  External force estimation using joint torque sensors for a robot manipulator , 2012, 2012 IEEE International Conference on Robotics and Automation.

[140]  Edward H. Adelson,et al.  3D Shape Perception from Monocular Vision, Touch, and Shape Priors , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[141]  Ciro Natale,et al.  Slipping Control Algorithms for Object Manipulation with Sensorized Parallel Grippers , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[142]  Flanagan,et al.  Sensorimotor Control of Grasping: Sensory control of object manipulation , 2009 .

[143]  Oliver Kroemer,et al.  Learning Audio Feedback for Estimating Amount and Flow of Granular Material , 2018, CoRL.

[144]  Mark Lee,et al.  Review Article Tactile sensing for mechatronics—a state of the art survey , 1999 .

[145]  Kazuo Tanie,et al.  Manipulation And Active Sensing By Pushing Using Tactile Feedback , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[146]  Ciro Natale,et al.  A Distributed Tactile Sensor for Intuitive Human-Robot Interfacing , 2017, J. Sensors.

[147]  Véronique Perdereau,et al.  Tactile sensing in dexterous robot hands - Review , 2015, Robotics Auton. Syst..

[148]  Christopher G. Atkeson,et al.  Combining finger vision and optical tactile sensing: Reducing and handling errors while cutting vegetables , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[149]  Jeffrey C. Trinkle,et al.  The application of particle filtering to grasping acquisition with visual occlusion and tactile sensing , 2012, 2012 IEEE International Conference on Robotics and Automation.

[150]  C.延克纳,et al.  The sensor device , 2015 .

[151]  R. Klatzky,et al.  Hand movements: A window into haptic object recognition , 1987, Cognitive Psychology.

[152]  Sethu Vijayakumar,et al.  Active estimation of object dynamics parameters with tactile sensors , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[153]  T. Martin McGinnity,et al.  Reliable robotic handovers through tactile sensing , 2019, Auton. Robots.

[154]  Jivko Sinapov,et al.  Vibrotactile Recognition and Categorization of Surfaces by a Humanoid Robot , 2011, IEEE Transactions on Robotics.

[155]  Kris Hauser Bayesian Tactile Exploration for Compliant Docking With Uncertain Shapes , 2018, Robotics: Science and Systems.

[156]  Nathan F. Lepora,et al.  Tactile manipulation with biomimetic active touch , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[157]  Gaurav S. Sukhatme,et al.  Force estimation and slip detection/classification for grip control using a biomimetic tactile sensor , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[158]  Daniel E. Koditschek,et al.  Disturbance detection, identification, and recovery by gait transition in legged robots , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[159]  Christoph H. Lampert,et al.  Learning Dynamic Tactile Sensing With Robust Vision-Based Training , 2011, IEEE Transactions on Robotics.

[160]  C. Kemp,et al.  Robot Manipulation of Human Tools : Autonomous Detection and Control of Task Relevant Features , 2006 .

[161]  Mark R. Cutkosky,et al.  Estimating friction using incipient slip sensing during a manipulation task , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[162]  Jeannette Bohg,et al.  Three-dimensional object reconstruction of symmetric objects by fusing visual and tactile sensing , 2014, Int. J. Robotics Res..

[163]  Oliver Kroemer,et al.  A kernel-based approach to learning contact distributions for robot manipulation tasks , 2018, Auton. Robots.

[164]  Oliver Kroemer,et al.  Probabilistic movement primitives for coordination of multiple human–robot collaborative tasks , 2017, Auton. Robots.

[165]  Anthony Stentz,et al.  Using sound to classify vehicle-terrain interactions in outdoor environments , 2012, 2012 IEEE International Conference on Robotics and Automation.

[166]  Gerald E. Loeb,et al.  Bayesian Exploration for Intelligent Identification of Textures , 2012, Front. Neurorobot..

[167]  Gordon Cheng,et al.  Active Tactile Transfer Learning for Object Discrimination in an Unstructured Environment Using Multimodal Robotic Skin , 2017, Int. J. Humanoid Robotics.

[168]  Yong Yu,et al.  Estimation of object inertia parameters on robot pushing operation , 2004, 2004 International Conference on Intelligent Mechatronics and Automation, 2004. Proceedings..

[169]  Giorgio Metta,et al.  Hierarchical grasp controller using tactile feedback , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[170]  Jan Peters,et al.  Evaluation of tactile feature extraction for interactive object recognition , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[171]  Mark Moll,et al.  Reconstructing shape from motion using tactile sensors , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[172]  Helge J. Ritter,et al.  A modular high-speed tactile sensor for human manipulation research , 2011, 2011 IEEE World Haptics Conference.

[173]  Giorgio Battistelli,et al.  Memory Unscented Particle Filter for 6-DOF Tactile Localization , 2017, IEEE Transactions on Robotics.

[174]  Ciro Natale,et al.  Control of linear and rotational slippage based on six-axis force/tactile sensor , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[175]  Ashutosh Saxena,et al.  Reactive grasping using optical proximity sensors , 2009, 2009 IEEE International Conference on Robotics and Automation.

[176]  Oliver Brock,et al.  Acoustic Sensing for Soft Pneumatic Actuators , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[177]  Jitendra Malik,et al.  More Than a Feeling: Learning to Grasp and Regrasp Using Vision and Touch , 2018, IEEE Robotics and Automation Letters.

[178]  Joshua R. Smith,et al.  Seashell effect pretouch sensing for robotic grasping , 2012, 2012 IEEE International Conference on Robotics and Automation.

[179]  Tokuji Okada,et al.  Object-Handling System for Manual Industry , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[180]  Andrew Owens,et al.  The Feeling of Success: Does Touch Sensing Help Predict Grasp Outcomes? , 2017, CoRL.

[181]  Gordon Cheng,et al.  Tactile-based object center of mass exploration and discrimination , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[182]  Tamim Asfour,et al.  Local implicit surface estimation for haptic exploration , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[183]  Yevgen Chebotar,et al.  Learning Latent Space Dynamics for Tactile Servoing , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[184]  Giorgio Metta,et al.  A tactile sensor for the fingertips of the humanoid robot iCub , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[185]  Danica Kragic,et al.  ST-HMP: Unsupervised Spatio-Temporal feature learning for tactile data , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[186]  Robert Platt,et al.  Null-Space Grasp Control: Theory and Experiments , 2010, IEEE Transactions on Robotics.

[187]  Marc Toussaint,et al.  Uncertainty aware grasping and tactile exploration , 2013, 2013 IEEE International Conference on Robotics and Automation.

[188]  Christopher G. Atkeson,et al.  Recent progress in tactile sensing and sensors for robotic manipulation: can we turn tactile sensing into vision?1 , 2019, Adv. Robotics.

[189]  Jan Peters,et al.  Learning robot in-hand manipulation with tactile features , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[190]  T. Martin McGinnity,et al.  Material classification based on thermal properties — A robot and human evaluation , 2013, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[191]  Heiko Hoffmann,et al.  Adaptive robotic tool use under variable grasps , 2014, Robotics Auton. Syst..

[192]  Shigeki Sugano,et al.  Covering a Robot Fingertip With uSkin: A Soft Electronic Skin With Distributed 3-Axis Force Sensitive Elements for Robot Hands , 2018, IEEE Robotics and Automation Letters.

[193]  Edward H. Adelson,et al.  Localization and manipulation of small parts using GelSight tactile sensing , 2014, IROS.

[194]  Jian Shi,et al.  Dynamic in-hand sliding manipulation , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[195]  Emanuele Menegatti,et al.  Teaching by touching: Interpretation of tactile instructions for motion development , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[196]  Gordon Cheng,et al.  Active Prior Tactile Knowledge Transfer for Learning Tactual Properties of New Objects , 2018, Sensors.

[197]  Mohit Sharma,et al.  Leveraging Multimodal Haptic Sensory Data for Robust Cutting , 2019, 2019 IEEE-RAS 19th International Conference on Humanoid Robots (Humanoids).

[198]  Oliver Kroemer,et al.  Soft Magnetic Skin for Continuous Deformation Sensing , 2019, Adv. Intell. Syst..

[199]  Ulrike Thomas,et al.  In-Hand Grasping Pose Estimation Using Particle Filters in Combination with Haptic Rendering Models , 2018, Int. J. Humanoid Robotics.

[200]  Yang Gao,et al.  Deep learning for tactile understanding from visual and haptic data , 2015, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[201]  Danica Kragic,et al.  Adaptive control for pivoting with visual and tactile feedback , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[202]  Takamitsu Matsubara,et al.  Active touch point selection with travel cost in tactile exploration for fast shape estimation of unknown objects , 2016, 2016 IEEE International Conference on Advanced Intelligent Mechatronics (AIM).

[203]  Il Hong Suh,et al.  A generalized motion/force planning strategy for multifingered hands using both rolling and sliding contacts , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[204]  Helge J. Ritter,et al.  Flexible and stretchable fabric-based tactile sensor , 2015, Robotics Auton. Syst..

[205]  Oussama Khatib,et al.  Bayesian estimation for autonomous object manipulation based on tactile sensors , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[206]  Mark R. Cutkosky,et al.  Practical Force-Motion Models for Sliding Manipulation , 1996, Int. J. Robotics Res..

[207]  M. Ohka,et al.  Determination of object stiffness control parameters in robot manipulation using a prototype optical three-axis tactile sensor , 2008, 2008 IEEE Sensors.

[208]  C. Karen Liu,et al.  Deep Haptic Model Predictive Control for Robot-Assisted Dressing , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[209]  R. Johansson,et al.  Tactile sensibility in the human hand: relative and absolute densities of four types of mechanoreceptive units in glabrous skin. , 1979, The Journal of physiology.

[210]  Edward H. Adelson,et al.  GelSight: High-Resolution Robot Tactile Sensors for Estimating Geometry and Force , 2017, Sensors.

[211]  Martin V. Butz,et al.  Self-supervised regrasping using spatio-temporal tactile features and reinforcement learning , 2016, IROS 2016.

[212]  Nathan F. Lepora,et al.  Active Bayesian Perception for Simultaneous Object Localization and Identification , 2013, Robotics: Science and Systems.

[213]  Helge J. Ritter,et al.  A Probabilistic Approach to Tactile Shape Reconstruction , 2011, IEEE Transactions on Robotics.

[214]  Raúl Suárez,et al.  Dexterous Manipulation of Unknown Objects Using Virtual Contact Points , 2019, Robotics.

[215]  Yu She,et al.  Cable Manipulation with a Tactile-Reactive Gripper , 2019, RSS 2020.

[216]  Alin Drimus,et al.  Object texture recognition by dynamic tactile sensing using active exploration , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[217]  K. Walas Terrain Classification and Negotiation with a Walking Robot , 2015, J. Intell. Robotic Syst..

[218]  Jonathan Rossiter,et al.  The TacTip Family: Soft Optical Tactile Sensors with 3D-Printed Biomimetic Morphologies , 2018, Soft robotics.

[219]  Masatoshi Ishikawa,et al.  Dynamic Pen Spinning Using a High-speed Multifingered Hand with High-speed Tactile Sensor , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[220]  Helge J. Ritter,et al.  Estimating an Articulated Tool's Kinematics via Visuo-Tactile Based Robotic Interactive Manipulation , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[221]  Marc Toussaint,et al.  Gaussian process implicit surfaces for shape estimation and grasping , 2011, 2011 IEEE International Conference on Robotics and Automation.

[222]  Helge J. Ritter,et al.  Grasp point optimization by online exploration of unknown object surface , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[223]  Andrew T. Miller,et al.  Integration of Vision , Force and Tactile Sensing for Grasping , 1999 .

[224]  Aude Billard,et al.  Multi-contact haptic exploration and grasping with tactile sensors , 2016, Robotics Auton. Syst..

[225]  Takanori Shibata,et al.  Physical and affective interaction between human and mental commit robot , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[226]  C. Karen Liu,et al.  Data-driven haptic perception for robot-assisted dressing , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[227]  G. De Maria,et al.  Force/tactile sensor for robotic applications , 2012 .

[228]  Nikolaus Correll,et al.  A Robotic Skin for Collision Avoidance and Affective Touch Recognition , 2018, IEEE Robotics and Automation Letters.

[229]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[230]  Bojan Nemec,et al.  Kinematic control algorithms for on-line obstacle avoidance for redundant manipulators , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[231]  Bruno Siciliano,et al.  The DEXMART hand: Mechatronic design and experimental evaluation of synergy-based control for human-like grasping , 2014, Int. J. Robotics Res..

[232]  Russ Tedrake,et al.  Soft-bubble: A highly compliant dense geometry tactile sensor for robot manipulation , 2019, 2019 2nd IEEE International Conference on Soft Robotics (RoboSoft).

[233]  Peter K. Allen,et al.  Stable grasping under pose uncertainty using tactile feedback , 2014, Auton. Robots.

[234]  Teruyuki Izumi,et al.  Hitting from any direction in 3-D space by a robot with a flexible link hammer , 1997, IEEE Trans. Robotics Autom..

[235]  Danica Kragic,et al.  Data-Driven Grasp Synthesis—A Survey , 2013, IEEE Transactions on Robotics.

[236]  E. D. Engeberg,et al.  Adaptive Sliding Mode Control for Prosthetic Hands to Simultaneously Prevent Slip and Minimize Deformation of Grasped Objects , 2013, IEEE/ASME Transactions on Mechatronics.

[237]  Allison M. Okamura,et al.  Haptic exploration of objects with rolling and sliding , 1997, Proceedings of International Conference on Robotics and Automation.

[238]  C. Karen Liu,et al.  Dexterous manipulation using both palm and fingers , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[239]  Gordon Cheng,et al.  Tactile-based manipulation of deformable objects with dynamic center of mass , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[240]  M. Cutkosky,et al.  Manipulation Control with Dynamic Tactile Sensing , 1997 .

[241]  Lorenzo Rosasco,et al.  Active perception: Building objects' models using tactile exploration , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[242]  Edward H. Adelson,et al.  Improved GelSight tactile sensor for measuring geometry and slip , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[243]  Jimmy A. Jørgensen,et al.  Assessing Grasp Stability Based on Learning and Haptic Data , 2011, IEEE Transactions on Robotics.

[244]  Thomas Schlegl,et al.  A Pretouch Sensing System for a Robot Grasper Using Magnetic and Capacitive Sensors , 2013, IEEE Transactions on Instrumentation and Measurement.

[245]  Ravinder Dahiya,et al.  Robotic Tactile Perception of Object Properties: A Review , 2017, ArXiv.

[246]  Michael Beetz,et al.  Improving robot manipulation through fingertip perception , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[247]  Wolfram Burgard,et al.  Deep Feature Learning for Acoustics-Based Terrain Classification , 2015, ISRR.

[248]  Gérard Poisson,et al.  Active calibration of tactile sensors mounted on a robotic hand , 2015, IROS 2015.

[249]  Katsuhiko Nakamura,et al.  A Tactile Sensor Instantaneously Evaluating Friction Coefficients , 2001 .

[250]  Alfonso García-Cerezo,et al.  Enhancing Perception with Tactile Object Recognition in Adaptive Grippers for Human–Robot Interaction , 2018, Sensors.

[251]  Fuchun Sun,et al.  Efficient Spatio-Temporal Tactile Object Recognition with Randomized Tiling Convolutional Networks in a Hierarchical Fusion Strategy , 2016, AAAI.