Discrimination of Object Curvature Based on a Sparse Tactile Sensor Array

Object curvature plays an important role in grasping and manipulation. To be more exact, local curvature is a more useful information for grasping practically. Vision and touch are the two main methods to extract surface curvature of an object, but vision is often limited since the complete contact area is invisible during manipulation. In this paper, the authors propose an object curvature estimation method based on an artificial neural network algorithm through a lab-developed sparse tactile sensor array. The compliant layer covering on the sensor is indispensable for fitting the curved surface. Three types (plane, convex sphere, and convex cylinder) of sample and each type of sample including 30 different radiuses (1 mm to 30 mm) were used in the experiment. The overall classification accuracy was 93.1%. The average curvature radius estimating error based on an artificial neural network (ANN) algorithm was 1.87 mm. When the radius of curvature was bigger than 5 mm, the average relative error was smaller than 20%. As a comparison, the sensor array density we used in this paper was less than 9/cm2, which was smaller than the density of human SAII receptors, but the discrimination result was close to the SAII receptors. Comparison with the curvature discrimination ability of the human body showed that this method has a promising application prospect.

[1]  Gregory J. Gerling,et al.  Evaluating populations of tactile sensors for curvature discrimination , 2010, 2010 IEEE Haptics Symposium.

[2]  Goro Obinata,et al.  Vision-based fluid-type tactile sensor for measurements on biological tissues , 2017, Medical & Biological Engineering & Computing.

[3]  Shahram Payandeh,et al.  Shape description of general, curved surfaces using tactile sensing and surface normal information , 1997, Proceedings of International Conference on Robotics and Automation.

[4]  R. Johansson,et al.  Properties of cutaneous mechanoreceptors in the human hand related to touch sensation. , 1984, Human neurobiology.

[5]  Ja Choon Koo,et al.  Exploration of local surface geometry with minimum number of contact points and surface normal information , 2012 .

[6]  Danica Kragic,et al.  ST-HMP: Unsupervised Spatio-Temporal feature learning for tactile data , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Shahram Payandeh,et al.  Curvature based shape estimation using tactile sensing , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[8]  P Jenmalm,et al.  Visual and tactile information about object-curvature control fingertip forces and grasp kinematics in human dexterous manipulation. , 2000, Journal of neurophysiology.

[9]  Peter K. Allen,et al.  Mapping haptic exploratory procedures to multiple shape representations , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[10]  Mark Lee,et al.  Review Article Tactile sensing for mechatronics—a state of the art survey , 1999 .

[11]  Gregory J. Gerling,et al.  Optimizing populations of SAI tactile mechanoreceptors to enable activities of daily living , 2011, 2011 IEEE World Haptics Conference.

[12]  M. Hartmann,et al.  Ergodic Exploration Using Binary Sensing for Nonparametric Shape Estimation , 2017, IEEE Robotics and Automation Letters.

[13]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[14]  Yasuo Kuniyoshi,et al.  High-density conformable tactile sensing glove , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[15]  Makoto Shimojo,et al.  Mechanical filtering effect of elastic cover for tactile sensor , 1997, IEEE Trans. Robotics Autom..

[16]  Yan-Bin Jia,et al.  Surface Patch Reconstruction From “One-Dimensional” Tactile Data , 2010, IEEE Transactions on Automation Science and Engineering.

[17]  R G Dong,et al.  Analysis of the contact interactions between fingertips and objects with different surface curvatures , 2005, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[18]  Giorgio Cannata,et al.  An embedded tactile and force sensor for robotic manipulation and grasping , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[19]  Kazuo Tanie,et al.  Sensitivity analysis and experiments of curvature estimation based on rolling contact , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[20]  Yan-Bin Jia,et al.  Surface Patch Reconstruction from Minimal Tactile Data , 2022 .

[21]  Gerald E. Loeb,et al.  Haptic feature extraction from a biomimetic tactile sensor: Force, contact location and curvature , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[22]  Kenichiro Suzuki.  High-density tactile sensor arrays , 1992, Adv. Robotics.

[23]  Chia-Hsiang Menq,et al.  Smooth-surface approximation and reverse engineering , 1991, Comput. Aided Des..

[24]  Yan-Bin Jia,et al.  High precision contour tracking with a joystick sensor , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[25]  Rajnikant V. Patel,et al.  Curvature, Torsion, and Force Sensing in Continuum Robots Using Helically Wrapped FBG Sensors , 2016, IEEE Robotics and Automation Letters.

[26]  Ronald S. Fearing,et al.  Using a cylindrical tactile sensor for determining curvature , 1988, IEEE Trans. Robotics Autom..

[27]  Shuzhi Sam Ge,et al.  Artificial Skin Ridges Enhance Local Tactile Shape Discrimination , 2011, Sensors.

[28]  A. Goodwin,et al.  Encoding of object curvature by tactile afferents from human fingers. , 1997, Journal of neurophysiology.

[29]  Ping Yu,et al.  A Novel Inverse Solution of Contact Force Based on a Sparse Tactile Sensor Array , 2018, Sensors.

[30]  Ronald S. Fearing,et al.  Tactile sensing for shape interpretation , 1990 .

[31]  S. Lederman,et al.  The physiology and psychophysics of touch , 1988 .

[32]  Anil K. Jain,et al.  On reliable curvature estimation , 1989, CVPR.

[33]  A. Goodwin,et al.  Human tactile discrimination of curvature when contact area with the skin remains constant , 2005, Experimental Brain Research.

[34]  Weiting Liu,et al.  Smart structure with elastomeric contact surface for prosthetic fingertip sensitivity development , 2017 .

[35]  Gregory J. Gerling,et al.  Validating a Population Model of Tactile Mechanotransduction of Slowly Adapting Type I Afferents at Levels of Skin Mechanics, Single-Unit Response and Psychophysics , 2014, IEEE Transactions on Haptics.

[36]  A. Goodwin,et al.  Tactile discrimination of curvature by humans using only cutaneous information from the fingerpads , 2004, Experimental Brain Research.