Feeling the Shape: Active Exploration Behaviors for Object Recognition With a Robotic Hand

Autonomous exploration in robotics is a crucial feature to achieve robust and safe systems capable to interact with and recognize their surrounding environment. In this paper, we present a method for object recognition using a three-fingered robotic hand actively exploring interesting object locations to reduce uncertainty. We present a novel probabilistic perception approach with a Bayesian formulation to iteratively accumulate evidence from robot touch. Exploration of better locations for perception is performed by familiarity and novelty exploration behaviors, which intelligently control the robot hand to move toward locations with low and high levels of interestingness, respectively. These are active behaviors that, similar to the exploratory procedures observed in humans, allow robots to autonomously explore locations they believe that contain interesting information for recognition. Active behaviors are validated with object recognition experiments in both offline and real-time modes. Furthermore, the effects of inhibiting the active behaviors are analyzed with a passive exploration strategy. The results from the experiments demonstrate the accuracy of our proposed methods, but also their benefits for active robot control to intelligently explore and interact with the environment.

[1]  Heinz Wörn,et al.  Haptic object recognition using statistical point cloud features , 2011, 2011 15th International Conference on Advanced Robotics (ICAR).

[2]  Luigi Portinale,et al.  Dynamic Bayesian Networks for Fault Detection, Identification, and Recovery in Autonomous Spacecraft , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[3]  Susan J. Lederman,et al.  Extracting object properties through haptic exploration. , 1993, Acta psychologica.

[4]  Uriel Martinez-Hernandez,et al.  Multisensory Wearable Interface for Immersion and Telepresence in Robotics , 2017, IEEE Sensors Journal.

[5]  Pierre-Yves Oudeyer,et al.  What is Intrinsic Motivation? A Typology of Computational Approaches , 2007, Frontiers Neurorobotics.

[6]  Allison M. Okamura,et al.  Haptic exploration of objects with rolling and sliding , 1997, Proceedings of International Conference on Robotics and Automation.

[7]  A. Wing,et al.  Active touch sensing , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[8]  Pierre-Yves Oudeyer,et al.  Intrinsic Motivation Systems for Autonomous Mental Development , 2007, IEEE Transactions on Evolutionary Computation.

[9]  Ali Borji,et al.  What/Where to Look Next? Modeling Top-Down Visual Attention in Complex Interactive Environments , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[10]  Pierre-Yves Oudeyer,et al.  Intrinsically Motivated Machines , 2006, 50 Years of Artificial Intelligence.

[11]  Pierre-Yves Oudeyer,et al.  Information-seeking, curiosity, and attention: computational and neural mechanisms , 2013, Trends in Cognitive Sciences.

[12]  Helge J. Ritter,et al.  A Probabilistic Approach to Tactile Shape Reconstruction , 2011, IEEE Transactions on Robotics.

[13]  Christian Balkenius,et al.  Neural network models of haptic shape perception , 2007, Robotics Auton. Syst..

[14]  Kaspar Althoefer,et al.  Tactile image based contact shape recognition using neural network , 2012, 2012 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[15]  John S. Bay,et al.  A fully autonomous active sensor-based exploration concept for shape-sensing robots , 1991, IEEE Trans. Syst. Man Cybern..

[16]  Adrian Rubio Solis,et al.  Bayesian perception of touch for control of robot emotion , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[17]  Giorgio Metta,et al.  Active contour following to explore object shape with robot touch , 2013, 2013 World Haptics Conference (WHC).

[18]  T. Martin McGinnity,et al.  Object recognition based on tactile form perception , 2011, 2011 IEEE Workshop on Robotic Intelligence In Informationally Structured Space.

[19]  Pierre-Yves Oudeyer,et al.  Active learning of inverse models with intrinsically motivated goal exploration in robots , 2013, Robotics Auton. Syst..

[20]  E. Deci,et al.  Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. , 2000, Contemporary educational psychology.

[21]  Marco Mirolli,et al.  Intrinsically Motivated Learning Systems: An Overview , 2013, Intrinsically Motivated Learning in Natural and Artificial Systems.

[22]  Javad Dargahi,et al.  Advances in tactile sensors design/manufacturing and its impact on robotics applications - a review , 2005, Ind. Robot.

[23]  Sharon A. Stansfield,et al.  Haptic Perception with an Articulated, Sensate Robot Hand , 1992, Robotica.

[24]  Tony J. Dodd,et al.  Active sensorimotor control for tactile exploration , 2017, Robotics Auton. Syst..

[25]  Jürgen Schmidhuber,et al.  Learning tactile skills through curious exploration , 2012, Front. Neurorobot..

[26]  Heinz Wörn,et al.  Haptic object recognition using passive joints and haptic key features , 2010, 2010 IEEE International Conference on Robotics and Automation.

[27]  Uriel Martinez-Hernandez,et al.  Probabilistic Locomotion Mode Recognition with Wearable Sensors , 2017 .

[28]  Dominiek Reynaerts,et al.  Featureless classification of tactile contacts in a gripper using neural networks , 1996 .

[29]  Sebastian Thrun,et al.  Probabilistic Algorithms in Robotics , 2000, AI Mag..

[30]  Xiao Huang,et al.  Novelty and Reinforcement Learning in the Value System of Developmental Robots , 2002 .

[31]  R. Klatzky,et al.  Haptic perception: A tutorial , 2009, Attention, perception & psychophysics.

[32]  Kenneth S. Roberts,et al.  Robot active touch exploration: constraints and strategies , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[33]  Uriel Martinez-Hernandez Tactile Sensors , 2015, Scholarpedia.

[34]  Uriel Martinez-Hernandez,et al.  Expressive touch: Control of robot emotional expression by touch , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[35]  Tony J. Dodd,et al.  Active Bayesian perception for angle and position discrimination with a biomimetic fingertip , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[36]  Jürgen Schmidhuber,et al.  Learning skills from play: Artificial curiosity on a Katana robot arm , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[37]  Michael Wade,et al.  Model-based object recognition using a large-field passive tactile sensor , 1989, IEEE Trans. Syst. Man Cybern..

[38]  Wolfram Burgard,et al.  Object identification with tactile sensors using bag-of-features , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[39]  Domingo Mery,et al.  Automated Detection of Threat Objects Using Adapted Implicit Shape Model , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[40]  Nuttapong Chentanez,et al.  Intrinsically Motivated Learning of Hierarchical Collections of Skills , 2004 .

[41]  Yiannis Demiris,et al.  Incrementally Learning Objects by Touch: Online Discriminative and Generative Models for Tactile-Based Recognition , 2014, IEEE Transactions on Haptics.

[42]  Neil D. Lawrence,et al.  An integrated probabilistic framework for robot perception, learning and memory , 2016, 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[43]  Sharon A. Stansfield,et al.  Primitives, features, and exploratory procedures: Building a robot tactile perception system , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[44]  Chunfang Liu,et al.  Object Classification and Grasp Planning Using Visual and Tactile Sensing , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[45]  Nathan F. Lepora,et al.  Active haptic shape recognition by intrinsic motivation with a robot hand , 2015, 2015 IEEE World Haptics Conference (WHC).

[46]  Anthony G. Pipe,et al.  Whisking with robots , 2009, IEEE Robotics & Automation Magazine.

[47]  Andrew G. Barto,et al.  Intrinsically Motivated Reinforcement Learning: A Promising Framework for Developmental Robot Learning , 2005 .