Unsupervised Learning of Spatio-Temporal Features for Tactile Data

Tactile feedback obtained during grasping of an object is crucial for a number of tasks in robotics. It allows to identify object properties and recognize its class, or to localize an object in a robot hand and assess quality and stability of the applied grasp [1]–[3]. The accomplishment of these tasks greatly depends on the choice of data representation, i.e. features that are used to capture signal properties, as it was was shown for visual data [4]–[7]. The representation of tactile data should not only provide robustness to real-world conditions, but also serve a wide variety of applications and be flexible to adapt to their specific requirements. In previous works tactile signal have been typically represented using a manually crafted set of features based on prior knowledge about the properties of the inputs. Early works aimed at identifying simple primitive shapes in object imprints in the tactile matrices (points and lines [8], [9]). Recent works use higher level geometric properties of pressure patterns, such as their position, area or higherorder moments [1], [3], [10], [11]. Other approaches build on features developed at Computer Vision, such as SIFT [12]. A very limited amount of work have aimed at unsupervised extraction of features by applying to tactile data the K-means algorithm or covariance analysis [13]–[15].

[1]  Shimon Edelman,et al.  Representation and recognition in vision , 1999 .

[2]  Allison M. Okamura,et al.  Haptic exploration of fine surface features , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[3]  Robin Andrew Russell,et al.  Object recognition by a 'smart' tactile sensor , 2000 .

[4]  Wolfram Burgard,et al.  Object identification with tactile sensors using bag-of-features , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Heinz Wörn,et al.  Haptic object recognition using passive joints and haptic key features , 2010, 2010 IEEE International Conference on Robotics and Automation.

[6]  Danica Kragic,et al.  Learning grasp stability based on tactile data and HMMs , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[7]  Gregory D. Hager,et al.  Object mapping, recognition, and localization from tactile geometry , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  Dieter Fox,et al.  Hierarchical Matching Pursuit for Image Classification: Architecture and Fast Algorithms , 2011, NIPS.

[9]  Jimmy A. Jørgensen,et al.  Assessing Grasp Stability Based on Learning and Haptic Data , 2011, IEEE Transactions on Robotics.

[10]  Gregory D. Hager,et al.  Tactile-Object Recognition From Appearance Information , 2011, IEEE Transactions on Robotics.

[11]  Kaspar Althoefer,et al.  A computationally fast algorithm for local contact shape and pose classification using a tactile array sensor , 2012, 2012 IEEE International Conference on Robotics and Automation.

[12]  Danica Kragic,et al.  Improving generalization for 3D object categorization with Global Structure Histograms , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Yiannis Demiris,et al.  Online spatio-temporal Gaussian process experts with application to tactile classification , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Helge J. Ritter,et al.  Identifying Relevant Tactile Features for Object Identification , 2012, Towards Service Robots for Everyday Environments.

[15]  Pascal Vincent,et al.  Unsupervised Feature Learning and Deep Learning: A Review and New Perspectives , 2012, ArXiv.

[16]  Dieter Fox,et al.  Multipath Sparse Coding Using Hierarchical Matching Pursuit , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Gert Kootstra,et al.  Design of a flexible tactile sensor for classification of rigid and deformable objects , 2014, Robotics Auton. Syst..

[18]  Danica Kragic,et al.  ST-HMP: Unsupervised Spatio-Temporal feature learning for tactile data , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).