Object-Shape Recognition Based on Haptic Image

This paper introduces a concept of haptic image which contains sufficient haptic data acquired from haptic interaction. Deep mining and proper processing of haptic image may extend the applications to many fields. An approach of haptic shape recognition based on haptic image is presented. Firstly, a glove-like device mounted with pressure sensors and fiber sensors is utilized to acquire haptic image during the exploration of object shape. Secondly, pre-processing of haptic image is conducted including smoothing and standardization. Thirdly, haptic flow is extracted from haptic image as shape feature. Haptic flow proposed in this paper is the displacement of contact points between adjacent time intervals, which is inspired by optical flow. At last, a self-organizing map (SOM) is employed for the classification and recognition of the explored shapes. In the experiment, a recognition test of 4 different shapes, including cube, block, cylinder and sphere, is conducted and the mean recognition rate is approximately 90%.

[1]  Jong-Il Park,et al.  RGB-D camera-based hand shape recognition for human-robot interaction , 2013, IEEE ISR 2013.

[2]  Lingling Zhang,et al.  Alternative techniques for the efficient acquisition of haptic data , 2001, SIGMETRICS '01.

[3]  James M. Rehg,et al.  Haptic classification and recognition of objects using a tactile sensing forearm , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Heinz Wörn,et al.  Haptic object recognition using passive joints and haptic key features , 2010, 2010 IEEE International Conference on Robotics and Automation.

[5]  Ming C. Leu,et al.  Recognition of Finger Spelling of American Sign Language with Artificial Neural Network Using Position/Orientation Sensors and Data Glove , 2005, ISNN.

[6]  Ying Zhang,et al.  Automatic recognition vision system guided for apple harvesting robot , 2012, Comput. Electr. Eng..

[7]  Yang Gao,et al.  Deep learning for tactile understanding from visual and haptic data , 2015, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[8]  John J. Craig,et al.  Introduction to Robotics Mechanics and Control , 1986 .

[9]  Kouhei Ohnishi,et al.  A quantization method for haptic data lossy compression , 2015, 2015 IEEE International Conference on Mechatronics (ICM).

[10]  Paolo Dario,et al.  A Survey of Glove-Based Systems and Their Applications , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[11]  Saeid Nahavandi,et al.  Applying Inverse Just-Noticeable-Differences of Velocity to Position Data for Haptic Data Reduction , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[12]  C. Balkenius,et al.  Experiments with Proprioception in a Self-Organizing System for Haptic Perception , 2007 .

[13]  Shahram Payandeh,et al.  Haptic Data Compression , 2015 .

[14]  Yutaka Hirano,et al.  Image-based object recognition and dexterous hand/arm motion planning using RRTs for grasping in cluttered scene , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  J. Gibson.  The perception of the visual world , 1951 .

[16]  Marion G. Ceruti,et al.  Wireless communication glove apparatus for motion tracking, gesture recognition, data transmission, and reception in extreme environments , 2009, SAC '09.

[17]  Yang Gao,et al.  Proton: A visuo-haptic data acquisition system for robotic learning of surface properties , 2016, 2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[18]  Koji Yatani,et al.  SpaceSense: representing geographical information to visually impaired people using spatial tactile feedback , 2012, CHI.

[19]  R. Dillmann,et al.  Learning continuous grasp stability for a humanoid robot hand based on tactile sensing , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[20]  Elisabeth Lex,et al.  A sliding window approach to natural hand gesture recognition using a custom data glove , 2016, 2016 IEEE Symposium on 3D User Interfaces (3DUI).

[21]  Toshiaki Tsuji,et al.  Haptic data compression for rehabilitation databases , 2014, 2014 IEEE 13th International Workshop on Advanced Motion Control (AMC).

[22]  Ashutosh Saxena,et al.  Learning haptic representation for manipulating deformable food objects , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  H. Mizumoto,et al.  Binocular robot vision system with shape recognition , 2007, 2007 International Conference on Control, Automation and Systems.

[24]  Masayuki Inaba,et al.  Multi-cue 3D object recognition in knowledge-based vision-guided humanoid robot system , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.