A novel tactile sensor based on structured light

In this paper, we have developed a tactile sensor based on the working principle of structured light. It solves the problem that structured light systems are highly susceptible to ambient light and require frequent calibration. And the structural light principle is applied to the robot operation process, that the robot can acquire the three-dimensional structure information of the object during the operation process, without worrying that the robot will block the camera and affect the reconstruction effect during the robot operation. The main components of the tactile sensor are two cameras, a transparent elastomer, and an adhesion layer pattern. In the experiment, we used the sensor to reconstruct a roman column model in three dimensions, in which the adhesion layer pattern is a structured light pattern coded by the spatial coding method. The results show that the tactile sensor developed in this paper can be used for three-dimensional reconstruction of contact objects with good results. The 3D reconstruction accuracy of the sensor designed in this paper is 0.4mm.

[1]  Shaowei Fan,et al.  Development of a Flexible 3-D Tactile Sensor System for Anthropomorphic Artificial Hand , 2013, IEEE Sensors Journal.

[2]  Ming-Shyan Wang,et al.  Flexible tactile sensor for the grasping control of robot fingers , 2013, 2013 International Conference on Advanced Robotics and Intelligent Systems.

[3]  Ciro Natale,et al.  Force/Tactile Sensors Based on Optoelectronic Technology for Manipulation and Physical Human–Robot Interaction , 2017 .

[4]  Naoki Kawakami,et al.  Evaluation of a vision-based tactile sensor , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[5]  Fuchun Sun,et al.  A novel multi-modal tactile sensor design using thermochromic material , 2019, Science China Information Sciences.

[6]  Pierre Graebling,et al.  Robust Structured Light Coding for 3D Reconstruction , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[7]  Xu Zhang,et al.  One Dimensional Camera of Line Structured Light Probe Calibration , 2018 .

[8]  Lei Yang,et al.  A Novel 3-D Path Extraction Method for Arc Welding Robot Based on Stereo Structured Light Sensor , 2019, IEEE Sensors Journal.

[9]  Chao Yang,et al.  A Dual-Modal Vision-Based Tactile Sensor for Robotic Hand Grasping , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Joaquim Salvi,et al.  A state of the art in structured light patterns for surface profilometry , 2010, Pattern Recognit..

[11]  Soon-Yong Park,et al.  Dual pseudorandom array technique for error correction and hole filling of color structured-light three-dimensional scanning , 2015 .

[12]  Edward H. Adelson,et al.  Sensing and Recognizing Surface Textures Using a GelSight Sensor , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[14]  Edward H. Adelson,et al.  Measurement of shear and slip with a GelSight tactile sensor , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[16]  Giancarlo Canavese,et al.  Flexible Tactile Sensing Based on Piezoresistive Composites: A Review , 2014, Sensors.

[17]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[18]  Chao Yang,et al.  A Stable and Efficient Vision-Based Tactile Sensor with Tactile Detection Using Neural Network , 2016, ICCSIP.

[19]  Hyung-Kew Lee,et al.  Normal and Shear Force Measurement Using a Flexible Polymer Tactile Sensor With Embedded Multiple Capacitors , 2008, Journal of Microelectromechanical Systems.

[20]  Xiang Li,et al.  Development of an Autonomous Sanding Robot with Structured-Light Technology , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  Jan P. Allebach,et al.  Design and decoding of an M-array pattern for low-cost structured light 3D reconstruction systems , 2013, 2013 IEEE International Conference on Image Processing.

[22]  Ryo Furukawa,et al.  Dense 3D Reconstruction from High Frame-Rate Video Using a Static Grid Pattern , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Véronique Perdereau,et al.  Tactile sensing in dexterous robot hands - Review , 2015, Robotics Auton. Syst..

[24]  R. Johansson,et al.  Factors influencing the force control during precision grip , 2004, Experimental Brain Research.