Towards Universal Haptic Library: Library-Based Haptic Texture Assignment Using Image Texture and Perceptual Space.

In this paper, we focused on building a universal haptic texture models library and automatic assignment of haptic texture models to any given surface from the library based on image features. It is shown that a relationship exists between perceived haptic texture and its image features, and this relationship is effectively used for automatic haptic texture model assignment. An image feature space and a perceptual haptic texture space are defined, and the correlation between the two spaces is found. A haptic texture library was built, using 84 real life textured surfaces, by training a multi-class support vector machine with radial basis function kernel. The perceptual space was classified into perceptually similar clusters using K-means. Haptic texture models were assigned to new surfaces in a two step process; classification into a perceptually similar group using the trained multi-class support vector machine, and finding a unique match from within the group using binarized statistical image features. The system was evaluated using 21 new real life texture surfaces and an accuracy of 71.4 percent was achieved in assigning haptic models to these surfaces.

[1]  B. Thompson,et al.  Factor Analytic Evidence for the Construct Validity of Scores: A Historical Overview and Some Guidelines , 1996 .

[2]  Seokhee Jeon,et al.  Data-Driven Modeling of Anisotropic Haptic Textures: Data Segmentation and Interpolation , 2016, EuroHaptics.

[3]  R. Tibshirani,et al.  An introduction to the bootstrap , 1993 .

[4]  Allison M. Okamura,et al.  Tissue property estimation and graphical display for teleoperated robot-assisted surgery , 2009, 2009 IEEE International Conference on Robotics and Automation.

[5]  Eckehard G. Steinbach,et al.  A haptic texture database for tool-mediated texture recognition and classification , 2014, 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE) Proceedings.

[6]  S. Wall,et al.  Modelling of Surface Identifying Characteristics Using Fourier Series , 1999, Dynamic Systems and Control.

[7]  M. Heller.  Visual and tactual texture perception: Intersensory cooperation , 1982, Perception & psychophysics.

[8]  Mary M. Galloway,et al.  Texture analysis using gray level run lengths , 1974 .

[9]  Gábor Székely,et al.  Data-Driven Haptic Rendering—From Viscous Fluids to Visco-Elastic Solids , 2009, IEEE Transactions on Haptics.

[10]  Seokhee Jeon,et al.  Real Stiffness Augmentation for Haptic Augmented Reality , 2011, PRESENCE: Teleoperators and Virtual Environments.

[11]  Masaaki Yoshida,et al.  DIMENSIONS OF TACTUAL IMPRESSIONS (1) , 1968 .

[12]  Eckehard G. Steinbach,et al.  Multimodal Feature-Based Surface Material Classification , 2017, IEEE Transactions on Haptics.

[13]  Oussama Khatib,et al.  The haptic display of complex graphical environments , 1997, SIGGRAPH.

[14]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[15]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[16]  Heather Culbertson,et al.  Modeling and Rendering Realistic Textures from Unconstrained Tool-Surface Interactions , 2014, IEEE Transactions on Haptics.

[17]  David A Clausi.  An analysis of co-occurrence texture statistics as a function of grey level quantization , 2002 .

[18]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[20]  Bernard Fertil,et al.  Texture indexes and gray level size zone matrix. Application to cell nuclei classification , 2009 .

[21]  M. Manivannan,et al.  Recordable Haptic textures , 2006, 2006 IEEE International Workshop on Haptic Audio Visual Environments and their Applications (HAVE 2006).

[22]  D. Valentin,et al.  Perceptual dimensions of tactile textures. , 2003, Acta psychologica.

[23]  Rainer Goebel,et al.  Crossmodal interactions of haptic and visual texture information in early sensory cortex , 2013, NeuroImage.

[24]  Gaurav S. Sukhatme,et al.  Haptic editing of decoration and material properties , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[25]  Jason Weston,et al.  Multi-Class Support Vector Machines , 1998 .

[26]  Aiguo Song,et al.  A novel haptic texture display based on image processing , 2007, 2007 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[27]  Forrest W. Young,et al.  Individual differences in perceptual space for tactile textures: Evidence from multidimensional scaling , 2000, Perception & psychophysics.

[28]  James C. Hayton,et al.  Factor Retention Decisions in Exploratory Factor Analysis: a Tutorial on Parallel Analysis , 2004 .

[29]  S. Lederman,et al.  Texture perception: studies of intersensory organization using a discrepancy paradigm, and visual versus tactual psychophysics. , 1981, Journal of experimental psychology. Human perception and performance.

[30]  Russell M. Taylor,et al.  Factors contributing to the integration of textural qualities: Evidence from virtual surfaces , 2005, Somatosensory & motor research.

[31]  Vincent Hayward,et al.  High-fidelity haptic synthesis of contact with deformable bodies , 2004, IEEE Computer Graphics and Applications.

[32]  R H LaMotte,et al.  Softness discrimination with a tool. , 2000, Journal of neurophysiology.

[33]  James F. Greenleaf,et al.  Use of gray value distribution of run lengths for texture analysis , 1990, Pattern Recognit. Lett..

[34]  Seokhee Jeon,et al.  Data-Driven Rendering of Anisotropic Haptic Textures , 2016, AsiaHaptics.

[35]  Robert King,et al.  Textural features corresponding to textural properties , 1989, IEEE Trans. Syst. Man Cybern..

[36]  Takashi Maeno,et al.  Modeling of human texture perception for tactile displays and sensors , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[37]  A. Benassi,et al.  GENERALIZATION OF THE COOCCURRENCE MATRIX FOR COLOUR IMAGES: APPLICATION TO COLOUR TEXTURE CLASSIFICATION , 2011 .

[38]  Karon E. MacLean,et al.  Perceptual Analysis of Haptic Icons: an Investigation into the Validity of Cluster Sorted MDS , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[39]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[40]  J. Kruskal.  Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis , 1964 .

[41]  Yoji Yamada,et al.  Psychophysical Dimensions of Tactile Perception of Textures , 2013, IEEE Transactions on Haptics.

[42]  Paul W. Fieguth,et al.  Texture Classification from Random Features , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Allison M. Okamura,et al.  Reality-based models for vibration feedback in virtual environments , 2001 .

[44]  S. Andrews,et al.  Haptic Texturing based on Real-World Samples , 2007, 2007 IEEE International Workshop on Haptic, Audio and Visual Environments and Games.

[45]  Belur V. Dasarathy,et al.  Image characterizations based on joint gray level-run length distributions , 1991, Pattern Recognit. Lett..

[46]  Esa Rahtu,et al.  BSIF: Binarized statistical image features , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[47]  Mark Holliins,et al.  Perceptual dimensions of tactile surface texture: A multidimensional scaling analysis , 1993, Perception & psychophysics.