Robotic Tactile Perception of Object Properties: A Review

Touch sensing can help robots understand their sur- rounding environment, and in particular the objects they interact with. To this end, roboticists have, in the last few decades, developed several tactile sensing solutions, extensively reported in the literature. Research into interpreting the conveyed tactile information has also started to attract increasing attention in recent years. However, a comprehensive study on this topic is yet to be reported. In an effort to collect and summarize the major scientific achievements in the area, this survey extensively reviews current trends in robot tactile perception of object properties. Available tactile sensing technologies are briefly presented before an extensive review on tactile recognition of object properties. The object properties that are targeted by this review are shape, surface material and object pose. The role of touch sensing in combination with other sensing sources is also discussed. In this review, open issues are identified and future directions for applying tactile sensing in different tasks are suggested.

[1]  Jeannette Bohg,et al.  Fusing visual and tactile sensing for 3-D object reconstruction while grasping , 2013, 2013 IEEE International Conference on Robotics and Automation.

[2]  Amit Konar,et al.  Object-shape recognition and 3D reconstruction from tactile sensor images , 2014, Medical & Biological Engineering & Computing.

[3]  Marc Toussaint,et al.  Gaussian process implicit surfaces for shape estimation and grasping , 2011, 2011 IEEE International Conference on Robotics and Automation.

[4]  Edward H. Adelson,et al.  Estimating object hardness with a GelSight touch sensor , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  Danica Kragic,et al.  Learning the tactile signatures of prototypical object parts for robust part-based grasping of novel objects , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Danica Kragic,et al.  Learning Predictive State Representation for in-hand manipulation , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[7]  W. Grimson,et al.  Model-Based Recognition and Localization from Sparse Range or Tactile Data , 1984 .

[8]  Kaspar Althoefer,et al.  A computationally fast algorithm for local contact shape and pose classification using a tactile array sensor , 2012, 2012 IEEE International Conference on Robotics and Automation.

[9]  A. Ng,et al.  Touch Based Perception for Object Manipulation , 2007 .

[10]  Edward H. Adelson,et al.  Sensing and Recognizing Surface Textures Using a GelSight Sensor , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Kaspar Althoefer,et al.  Multi-axis stiffness sensing device for medical palpation , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Kaspar Althoefer,et al.  Rotation and translation invariant object recognition with a tactile sensor , 2014, IEEE SENSORS 2014 Proceedings.

[13]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Gregory Dudek,et al.  Surface sensing and classification for efficient mobile robot navigation , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[15]  Tsutomu Hasegawa,et al.  Real-time pose estimation of an object manipulated by multi-fingered hand using 3D stereo vision and tactile sensing , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[16]  W. S. McMath,et al.  Tactile sensor for geometric profile perception , 1991, Proceedings IECON '91: 1991 International Conference on Industrial Electronics, Control and Instrumentation.

[17]  Kaspar Althoefer,et al.  Novel Tactile-SIFT Descriptor for Object Shape Recognition , 2015, IEEE Sensors Journal.

[18]  David M. Siegel.  Finding the pose of an object in a hand , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[19]  Claudio Pacchierotti,et al.  Towards Wearability in Fingertip Haptics: A 3-DoF Wearable Device for Cutaneous Force Feedback , 2013, IEEE Transactions on Haptics.

[20]  Edward H. Adelson,et al.  Recognizing Materials Using Perceptually Inspired Features , 2013, International Journal of Computer Vision.

[21]  Craig Corcoran,et al.  A measurement model for tracking hand-object state during dexterous manipulation , 2010, 2010 IEEE International Conference on Robotics and Automation.

[22]  Frank Kirchner,et al.  Haptic Object Recognition in Underwater and Deep-sea Environments , 2015, J. Field Robotics.

[23]  Peter K. Allen,et al.  Integrating Vision and Touch for Object Recognition Tasks , 1988, Int. J. Robotics Res..

[24]  Robert D. Howe,et al.  A tactile sensor for localizing transient events in manipulation , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[25]  Sebastian Thrun,et al.  Simultaneous localization and mapping with unknown data association using FastSLAM , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[26]  Ronald S. Fearing,et al.  Using a cylindrical tactile sensor for determining curvature , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[27]  Abderrahmane Kheddar,et al.  Tactile interfaces: a state-of-the-art survey , 2004 .

[28]  Gerald E. Loeb,et al.  Bayesian Exploration for Intelligent Identification of Textures , 2012, Front. Neurorobot..

[29]  Jonathan E. Clark,et al.  Tactile surface classification for limbed robots using a pressure sensitive robot skin , 2015, Bioinspiration & biomimetics.

[30]  Kaspar Althoefer,et al.  Surface material recognition through haptic exploration using an intelligent contact sensing finger , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Giorgio Metta,et al.  Robotic Homunculus: Learning of Artificial Skin Representation in a Humanoid Robot Motivated by Primary Somatosensory Cortex , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[32]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Yiannis Demiris,et al.  Incrementally Learning Objects by Touch: Online Discriminative and Generative Models for Tactile-Based Recognition , 2014, IEEE Transactions on Haptics.

[34]  E. Adelson,et al.  Localization and Manipulation of Small Parts Using , 2014 .

[35]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[36]  Jivko Sinapov,et al.  Vibrotactile Recognition and Categorization of Surfaces by a Humanoid Robot , 2011, IEEE Transactions on Robotics.

[37]  Gordon Cheng,et al.  Humanoids learn touch modalities identification via multi-modal robotic skin and robust tactile descriptors , 2015, Adv. Robotics.

[38]  Helge J. Ritter,et al.  Acquisition and Application of a Tactile Database , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[39]  Christian Balkenius,et al.  Neural network models of haptic shape perception , 2007, Robotics Auton. Syst..

[40]  Kaspar Althoefer,et al.  Tactile image based contact shape recognition using neural network , 2012, 2012 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[41]  Wolfram Burgard,et al.  Object identification with tactile sensors using bag-of-features , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[42]  Tomoaki Nakamura,et al.  Online Object Categorization Using Multimodal Information Autonomously Acquired by a Mobile Robot , 2012, Adv. Robotics.

[43]  Kaspar Althoefer,et al.  Combining touch and vision for the estimation of an object's pose during manipulation , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[44]  Gregory D. Hager,et al.  Object mapping, recognition, and localization from tactile geometry , 2011, 2011 IEEE International Conference on Robotics and Automation.

[45]  Giorgio Metta,et al.  Methods and Technologies for the Implementation of Large-Scale Robot Tactile Sensors , 2011, IEEE Transactions on Robotics.

[46]  Siddhartha S. Srinivasa,et al.  Pose estimation for planar contact manipulation with manifold particle filters , 2015, Int. J. Robotics Res..

[47]  Federico Tombari,et al.  Unique Signatures of Histograms for Local Surface Description , 2010, ECCV.

[48]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[49]  Edward H. Adelson,et al.  Connecting Look and Feel: Associating the Visual and Tactile Properties of Physical Materials , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  Jimmy A. Jørgensen,et al.  Assessing Grasp Stability Based on Learning and Haptic Data , 2011, IEEE Transactions on Robotics.

[51]  Kaspar Althoefer,et al.  Tactile sensing for dexterous in-hand manipulation in robotics-A review , 2011 .

[52]  Kaspar Althoefer,et al.  Multi-fingered haptic palpation using pneumatic feedback actuators , 2014 .

[53]  Gordon Cheng,et al.  Humanoid Multimodal Tactile-Sensing Modules , 2011, IEEE Transactions on Robotics.

[54]  Tomonori Yamamoto,et al.  Use of tactile feedback to control exploratory movements to characterize object compliance , 2012, Front. Neurorobot..

[55]  Aaron M. Dollar,et al.  Single-Grasp Object Classification and Feature Extraction with Simple Robot Hands and Tactile Sensors , 2016, IEEE Transactions on Haptics.

[56]  Edward Adelson,et al.  Tracking objects with point clouds from vision and touch , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[57]  Mathew H. Evans,et al.  Tactile SLAM with a biomimetic whiskered robot , 2012, 2012 IEEE International Conference on Robotics and Automation.

[58]  Van Anh Ho,et al.  Experimental investigation of surface identification ability of a low-profile fabric tactile sensor , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[59]  Anthony G. Pipe,et al.  Biomimetic tactile target acquisition, tracking and capture , 2014, Robotics Auton. Syst..

[60]  Peter K. Allen,et al.  Blind grasping: Stable robotic grasping using tactile feedback and hand kinematics , 2011, 2011 IEEE International Conference on Robotics and Automation.

[61]  R. Klatzky,et al.  Haptic classification of common objects: Knowledge-driven exploration , 1990, Cognitive Psychology.

[62]  Danfei Xu,et al.  Tactile identification of objects using Bayesian exploration , 2013, 2013 IEEE International Conference on Robotics and Automation.

[63]  Robert Platt,et al.  Using Bayesian Filtering to Localize Flexible Materials During Manipulation , 2011, IEEE Transactions on Robotics.

[64]  James M. Rehg,et al.  Combining tactile sensing and vision for rapid haptic mapping , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[65]  Helge J. Ritter,et al.  Flexible and stretchable fabric-based tactile sensor , 2015, Robotics Auton. Syst..

[66]  Gregory D. Hager,et al.  Tactile-Object Recognition From Appearance Information , 2011, IEEE Transactions on Robotics.

[67]  Oussama Khatib,et al.  Bayesian estimation for autonomous object manipulation based on tactile sensors , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[68]  Emil M. Petriu,et al.  Active tactile perception of object surface geometric profiles , 1991 .

[69]  R. Dahiya,et al.  Printable stretchable interconnects , 2017 .

[70]  Andrew T. Miller,et al.  Integration of Vision , Force and Tactile Sensing for Grasping , 1999 .

[71]  Nitish V. Thakor,et al.  A kilohertz kilotaxel tactile sensor array for investigating spatiotemporal features in neuromorphic touch , 2015, 2015 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[72]  Shahram Payandeh,et al.  Shape Description of Curved Surfaces from Contact Sensing Using Surface Normals , 1999, Int. J. Robotics Res..

[73]  Giorgio Metta,et al.  Active contour following to explore object shape with robot touch , 2013, 2013 World Haptics Conference (WHC).

[74]  J. Paul Siebert,et al.  Recognising the clothing categories from free-configuration using Gaussian-Process-based interactive perception , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[75]  Angel P. del Pobil,et al.  Reliable non-prehensile door opening through the combination of vision, tactile and force feedback , 2010, Auton. Robots.

[76]  Joel W. Burdick,et al.  Fusion of stereo vision, force-torque, and joint sensors for estimation of in-hand object location , 2011, 2011 IEEE International Conference on Robotics and Automation.

[77]  Jonathan Rossiter,et al.  TACTIP - Tactile Fingertip Device, Texture Analysis through Optical Tracking of Skin Features , 2013, Living Machines.

[78]  Helge J. Ritter,et al.  A highly sensitive 3D-shaped tactile sensor , 2013, 2013 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[79]  Angel P. del Pobil,et al.  Vision-tactile-force integration and robot physical interaction , 2009, 2009 IEEE International Conference on Robotics and Automation.

[80]  Kuan-Ting Yu,et al.  Shape and pose recovery from planar pushing , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[81]  Danica Kragic,et al.  Learning tactile characterizations of object- and pose-specific grasps , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[82]  Nigel W. John,et al.  The Role of Haptics in Medical Training Simulators: A Survey of the State of the Art , 2011, IEEE Transactions on Haptics.

[83]  T. Hendler,et al.  Convergence of visual and tactile shape processing in the human lateral occipital complex. , 2002, Cerebral cortex.

[84]  Heinz Wörn,et al.  Haptic object recognition using passive joints and haptic key features , 2010, 2010 IEEE International Conference on Robotics and Automation.

[85]  Gaurav S. Sukhatme,et al.  Contact localization on grasped objects using tactile sensing , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[86]  Daniel Polani,et al.  Histogram based classification of tactile patterns on periodically distributed skin sensors for a humanoid robot , 2011, 2011 RO-MAN.

[87]  Chiara Bartolozzi,et al.  Robots with a sense of touch. , 2016, Nature materials.

[88]  Kenneth S. Roberts,et al.  Haptic object recognition using a multi-fingered dextrous hand , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[89]  Pejman Iravani,et al.  Bayesian tactile object recognition: Learning and recognising objects using a new inexpensive tactile sensor , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[90]  M. Hartmann,et al.  Ergodic Exploration Using Binary Sensing for Nonparametric Shape Estimation , 2017, IEEE Robotics and Automation Letters.

[91]  Christoph H. Lampert,et al.  Learning Dynamic Tactile Sensing With Robust Vision-Based Training , 2011, IEEE Transactions on Robotics.

[92]  Mari Velonaki,et al.  Touch modality interpretation for an EIT-based sensitive skin , 2011, 2011 IEEE International Conference on Robotics and Automation.

[93]  Kaspar Althoefer,et al.  In-Hand Object Pose Estimation Using Covariance-Based Tactile To Geometry Matching , 2016, IEEE Robotics and Automation Letters.

[94]  Yiannis Demiris,et al.  Online spatio-temporal Gaussian process experts with application to tactile classification , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[95]  Aude Billard,et al.  A survey of Tactile Human-Robot Interactions , 2010, Robotics Auton. Syst..

[96]  M. Kaltenbrunner,et al.  An ultra-lightweight design for imperceptible plastic electronics , 2013, Nature.

[97]  Giulio Sandini,et al.  Tactile Sensing—From Humans to Humanoids , 2010, IEEE Transactions on Robotics.

[98]  Trevor Darrell,et al.  Using robotic exploratory procedures to learn the meaning of haptic adjectives , 2013, 2013 IEEE International Conference on Robotics and Automation.

[99]  Andrew Owens,et al.  Shape-independent hardness estimation using deep learning and a GelSight tactile sensor , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[100]  Dominiek Reynaerts,et al.  Featureless classification of tactile contacts in a gripper using neural networks , 1996 .

[101]  Kaspar Althoefer,et al.  Finite-Element Modeling of Soft Tissue Rolling Indentation , 2011, IEEE Transactions on Biomedical Engineering.

[102]  Danica Kragic,et al.  Demonstration-based learning and control for automatic grasping , 2009, Intell. Serv. Robotics.

[103]  Gregory Dudek,et al.  A Simple Tactile Probe for Surface Identification by Mobile Robots , 2011, IEEE Transactions on Robotics.

[104]  Allison M. Okamura,et al.  Methods for intelligent localization and mapping during haptic exploration , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[105]  Yan-Bin Jia,et al.  Semidifferential Invariants for Tactile Recognition of Algebraic Curves , 2005, Int. J. Robotics Res..

[106]  Gunther Heidemann,et al.  Dynamic tactile sensing for object identification , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[107]  Oussama Khatib,et al.  Springer Handbook of Robotics , 2007, Springer Handbooks.

[108]  Danica Kragic,et al.  ST-HMP: Unsupervised Spatio-Temporal feature learning for tactile data , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[109]  Helge J. Ritter,et al.  Using entropy for dimension reduction of tactile data , 2009, 2009 International Conference on Advanced Robotics.

[110]  Nawid Jamali,et al.  Material classification by tactile sensing using surface textures , 2010, 2010 IEEE International Conference on Robotics and Automation.

[111]  Wei-Min Shen,et al.  An Inertia-Based Surface Identification System , 2010, 2010 IEEE International Conference on Robotics and Automation.

[112]  Katherine J. Kuchenbecker,et al.  Improving contact realism through event-based haptic feedback , 2006, IEEE Transactions on Visualization and Computer Graphics.

[113]  Brahim Chaib-draa,et al.  Autonomous tactile perception: A combined improved sensing and Bayesian nonparametric approach , 2014, Robotics Auton. Syst..

[114]  Helge J. Ritter,et al.  A Control Framework for Tactile Servoing , 2013, Robotics: Science and Systems.

[115]  Achint Aggarwal,et al.  Object Recognition and Localization: The Role of Tactile Sensors , 2014, Sensors.

[116]  Peter Allen.  Surface descriptions from vision and touch , 1984, ICRA.

[117]  Veronica J. Santos,et al.  Spatial Asymmetry in Tactile Sensor Skin Deformation Aids Perception of Edge Orientation During Haptic Exploration , 2014, IEEE Transactions on Haptics.

[118]  S. Lacey,et al.  Vision and Touch: Multiple or Multisensory Representations of Objects? , 2007, Perception.

[119]  Allison M. Okamura,et al.  Feature Detection for Haptic Exploration with Robotic Fingers , 2001, Int. J. Robotics Res..

[120]  Jan Peters,et al.  Evaluation of tactile feature extraction for interactive object recognition , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[121]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[122]  Helge J. Ritter,et al.  A modular high-speed tactile sensor for human manipulation research , 2011, 2011 IEEE World Haptics Conference.

[123]  R. Klatzky,et al.  Haptic perception: A tutorial , 2009, Attention, perception & psychophysics.

[124]  M. Ani Hsieh,et al.  A triangle histogram for object classification by tactile sensing , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[125]  Giorgio Battistelli,et al.  Memory Unscented Particle Filter for 6-DOF Tactile Localization , 2017, IEEE Transactions on Robotics.

[126]  Kaspar Althoefer,et al.  Iterative Closest Labeled Point for tactile object shape recognition , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[127]  Kaspar Althoefer,et al.  Stable Grip Control on Soft Objects With Time-Varying Stiffness , 2016, IEEE Transactions on Robotics.

[128]  Wolfram Burgard,et al.  Tactile Sensing for Mobile Manipulation , 2011, IEEE Transactions on Robotics.

[129]  Maurizio Valle,et al.  Real-time reconstruction of contact shapes for large area robot skin , 2013, 2013 IEEE International Conference on Robotics and Automation.

[130]  Danica Kragic,et al.  Learning of grasp adaptation through experience and tactile sensing , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[131]  Naoki Kawakami,et al.  Finger-Shaped GelForce: Sensor for Measuring Surface Traction Fields for Robotic Hand , 2010, IEEE Transactions on Haptics.

[132]  Siddhartha S. Srinivasa,et al.  Pose estimation for contact manipulation with manifold particle filters , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[133]  G. Metta,et al.  Towards Tactile Sensing System on Chip for Robotic Applications , 2011, IEEE Sensors Journal.

[134]  Christian Cipriani,et al.  Roughness Encoding for Discrimination of Surfaces in Artificial Active-Touch , 2011, IEEE Transactions on Robotics.

[135]  Shigeki Sugano,et al.  Tactile object recognition using deep learning and dropout , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[136]  Leandro Lorenzelli,et al.  Technologies for Printing Sensors and Electronics Over Large Flexible Substrates: A Review , 2015, IEEE Sensors Journal.

[137]  Kaspar Althoefer,et al.  Knock-Knock: Acoustic object recognition by using stacked denoising autoencoders , 2017, Neurocomputing.

[138]  R. Dahiya,et al.  Bending induced electrical response variations in ultra-thin flexible chips and device modeling , 2017 .

[139]  A. HuetLucie,et al.  Tactile Sensing with Whiskers of Various Shapes: Determining the Three-Dimensional Location of Object Contact Based on Mechanical Signals at the Whisker Base. , 2017 .

[140]  Edward H. Adelson,et al.  Exploring features in a Bayesian framework for material recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[141]  Edward H. Adelson,et al.  Microgeometry capture using an elastomeric sensor , 2011, SIGGRAPH 2011.

[142]  Frédéric Jurie,et al.  Sampling Strategies for Bag-of-Features Image Classification , 2006, ECCV.

[143]  Kaspar Althoefer,et al.  Global estimation of an object’s pose using tactile sensing , 2015, Adv. Robotics.

[144]  Fuchun Sun,et al.  Efficient Spatio-Temporal Tactile Object Recognition with Randomized Tiling Convolutional Networks in a Hierarchical Fusion Strategy , 2016, AAAI.

[145]  Ravinder Dahiya,et al.  Robotic Tactile Sensing: Technologies and System , 2012 .

[146]  Yamaguchi Akihiko,et al.  Combining finger vision and optical tactile sensing: Reducing and handling errors while cutting vegetables , 2016 .

[147]  Tamim Asfour,et al.  Multi-sensor and prediction fusion for contact detection and localization , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[148]  Claudio Pacchierotti,et al.  Improving transparency in passive teleoperation by combining cutaneous and kinesthetic force feedback , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[149]  Danica Kragic,et al.  Enhancing visual perception of shape through tactile glances , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[150]  Kaspar Althoefer,et al.  Tactile Object Recognition with Semi-Supervised Learning , 2015, ICIRA.

[151]  Kaspar Althoefer,et al.  Localizing the object contact through matching tactile features with visual map , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[152]  Heinz Wörn,et al.  Haptic object recognition for multi-fingered robot hands , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[153]  Danica Kragic,et al.  What's in the container? Classifying object contents from vision and touch , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[154]  Danica Kragic,et al.  A probabilistic framework for task-oriented grasp stability assessment , 2013, 2013 IEEE International Conference on Robotics and Automation.

[155]  Di Guo,et al.  Object Recognition Using Tactile Measurements: Kernel Sparse Coding Methods , 2016, IEEE Transactions on Instrumentation and Measurement.

[156]  Gordon Cheng,et al.  Humanoids learn object properties from robust tactile feature descriptors via multi-modal artificial skin , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[157]  Paul F. M. J. Verschure,et al.  A sensorimotor account of visual and tactile integration for object categorization and grasping , 2013, 2013 IEEE International Conference on Robotics and Automation.

[158]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[159]  Jonathan Rossiter,et al.  Development of a tactile sensor based on biologically inspired edge encoding , 2009, 2009 International Conference on Advanced Robotics.

[160]  Heinz Wörn,et al.  Opening a door with a humanoid robot using multi-sensory tactile feedback , 2008, 2008 IEEE International Conference on Robotics and Automation.

[161]  Scott T. Grafton,et al.  Involvement of visual cortex in tactile discrimination of orientation , 1999, Nature.

[162]  Van Anh Ho,et al.  What can be inferred from a tactile arrayed sensor in autonomous in-hand manipulation? , 2012, 2012 IEEE International Conference on Automation Science and Engineering (CASE).

[163]  Fulvio Mastrogiovanni,et al.  A framework for representing interaction tasks based on tactile data , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[164]  Helge J. Ritter,et al.  A Probabilistic Approach to Tactile Shape Reconstruction , 2011, IEEE Transactions on Robotics.

[165]  Kaspar Althoefer,et al.  Efficient Break-Away Friction Ratio and Slip Prediction Based on Haptic Surface Exploration , 2014, IEEE Transactions on Robotics.

[166]  Christian Balkenius,et al.  Sense of Touch in Robots With Self-Organizing Maps , 2011, IEEE Transactions on Robotics.

[167]  Mari Velonaki,et al.  Interpretation of the modality of touch on an artificial arm covered with an EIT-based sensitive skin , 2012, Int. J. Robotics Res..

[168]  Maurizio Valle,et al.  Tactile-Data Classification of Contact Materials Using Computational Intelligence , 2011, IEEE Transactions on Robotics.

[169]  Yan-Bin Jia,et al.  Surface Patch Reconstruction From “One-Dimensional” Tactile Data , 2010, IEEE Transactions on Automation Science and Engineering.

[170]  W. B. Tiest.  Tactual perception of material properties , 2010, Vision Research.

[171]  E. O. Polat,et al.  Synthesis of Large Area Graphene for High Performance in Flexible Optoelectronic Devices , 2015, Scientific Reports.

[172]  Máximo A. Roa,et al.  Planning in-hand object manipulation with multifingered hands considering task constraints , 2013, 2013 IEEE International Conference on Robotics and Automation.

[173]  Connor Schenck,et al.  Interactive object recognition using proprioceptive and auditory feedback , 2011, Int. J. Robotics Res..

[174]  Gordon Cheng,et al.  Directions Toward Effective Utilization of Tactile Skin: A Review , 2013, IEEE Sensors Journal.

[175]  Yi-Hung Liu,et al.  Low-Resolution Tactile Image Recognition for Automated Robotic Assembly Using Kernel PCA-Based Feature Fusion and Multiple Kernel Learning-Based Support Vector Machine , 2014 .

[176]  J Edwards,et al.  Extracting textural features from tactile sensors , 2008, Bioinspiration & biomimetics.

[177]  Gert Kootstra,et al.  Design of a flexible tactile sensor for classification of rigid and deformable objects , 2014, Robotics Auton. Syst..

[178]  Francesco Zanichelli,et al.  On the robustness of haptic object recognition based on polyhedral shape representations , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[179]  Douglas L. Jones,et al.  Institute of Physics Publishing Journal of Micromechanics and Microengineering Texture Classification Using a Polymer-based Mems Tactile Sensor , 2022 .

[180]  Ren C. Luo,et al.  Multisensor integration and fusion in intelligent systems , 1989, IEEE Trans. Syst. Man Cybern..

[181]  Oussama Khatib,et al.  Global Localization of Objects via Touch , 2011, IEEE Transactions on Robotics.

[182]  Tobias Höllerer,et al.  Evaluation of Interest Point Detectors and Feature Descriptors for Visual Tracking , 2011, International Journal of Computer Vision.

[183]  Gert Kootstra,et al.  Classification of rigid and deformable objects using a novel tactile sensor , 2011, 2011 15th International Conference on Advanced Robotics (ICAR).

[184]  Gordon Cheng,et al.  New materials and advances in making electronic skin for interactive robots , 2015, Adv. Robotics.

[185]  Heinz Wörn,et al.  Tactile sensing for an anthropomorphic robotic hand: Hardware and signal processing , 2009, 2009 IEEE International Conference on Robotics and Automation.

[186]  Yan-Bin Jia,et al.  Surface patch reconstruction via curve sampling , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[187]  Daniel P. Huttenlocher,et al.  Pictorial Structures for Object Recognition , 2004, International Journal of Computer Vision.

[188]  Véronique Perdereau,et al.  Tactile sensing in dexterous robot hands - Review , 2015, Robotics Auton. Syst..

[189]  Joseph M. Romano,et al.  Methods for robotic tool-mediated haptic surface recognition , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[190]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[191]  Herman Bruyninckx,et al.  Bayesian Hybrid Model-State Estimation Applied to Simultaneous Contact Formation Recognition and Geometrical Parameter Estimation , 2005, Int. J. Robotics Res..

[192]  Kaspar Althoefer,et al.  Fiber optics tactile array probe for tissue palpation during minimally invasive surgery , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[193]  Katsuko Kikuchi,et al.  The “Haptic Finger”– a new device for monitoring skin condition , 2003, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[194]  Ren C. Luo,et al.  Multisensor fusion and integration: approaches, applications, and future research directions , 2002 .

[195]  Yang Gao,et al.  Deep learning for tactile understanding from visual and haptic data , 2015, 2016 IEEE International Conference on Robotics and Automation (ICRA).