Using Fiber Optic Bundles to Miniaturize Vision-Based Tactile Sensors

Vision-based tactile sensors have recently become popular due to their combination of low cost, very high spatial resolution, and ease of integration using widely available miniature cameras. The associated field of view and focal length, however, are difficult to package in a human-sized finger. In this paper we employ optical fiber bundles to achieve a form factor that, at 15 mm diameter, is smaller than an average human fingertip. The electronics and camera are also located remotely, further reducing package size. The sensor achieves a spatial resolution of 0.22 mm and a minimum force resolution 5 mN for normal and shear contact forces. With these attributes, the DIGIT Pinki sensor is suitable for applications such as robotic and teleoperated digital palpation. We demonstrate its utility for palpation of the prostate gland and show that it can achieve clinically relevant discrimination of prostate stiffness for phantom and ex vivo tissue.

[1]  E. Adelson,et al.  GelSight Svelte: A Human Finger-Shaped Single-Camera Tactile Robot Finger with Large Sensing Coverage and Proprioceptive Sensing , 2023, 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Y. Ma,et al.  General In-Hand Object Rotation with Vision and Touch , 2023, CoRL.

[3]  Junbo Tan,et al.  Visuotactile Sensor Enabled Pneumatic Device Towards Compliant Oropharyngeal Swab Sampling , 2023, 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  I. Thompson,et al.  Early Detection of Prostate Cancer: AUA/SUO Guideline Part I: Prostate Cancer Screening , 2023, The Journal of urology.

[5]  E. Adelson,et al.  GelSight360: An Omnidirectional Camera-Based Tactile Sensor for Dexterous Robotic Manipulation , 2023, 2023 IEEE International Conference on Soft Robotics (RoboSoft).

[6]  R. Merzouki,et al.  A Bio-Inspired Active Prostate Phantom for Adaptive Interventions , 2022, IEEE Transactions on Medical Robotics and Bionics.

[7]  Sandra Q. Liu,et al.  GelSight Fin Ray: Incorporating Tactile Sensing into a Soft Compliant Robotic Gripper , 2022, 2022 IEEE 5th International Conference on Soft Robotics (RoboSoft).

[8]  Limin Wang,et al.  VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training , 2022, NeurIPS.

[9]  Youqing Wang,et al.  Prostate Cancer Incidence and Mortality: Global Status and Temporal Trends in 89 Countries From 2000 to 2019 , 2022, Frontiers in Public Health.

[10]  P. C. López-Custodio,et al.  Deep Movement Primitives: toward Breast Cancer Examination Robot , 2022, AAAI.

[11]  Mohammad A. Qasaimeh,et al.  Tactile Sensing for Minimally Invasive Surgery: Conventional Methods and Potential Emerging Tactile Technologies , 2022, Frontiers in Robotics and AI.

[12]  Shan Luo,et al.  GelTip Tactile Sensor for Dexterous Manipulation in Clutter , 2021, ArXiv.

[13]  Georg Martius,et al.  A soft thumb-sized vision-based sensor with accurate all-round force perception , 2021, Nat. Mach. Intell..

[14]  Bruno Siciliano,et al.  Miniaturized optical fiber probe for prostate cancer screening. , 2021, Biomedical optics express.

[15]  Dongming Gan,et al.  On the Design and Development of Vision-based Tactile Sensors , 2021, Journal of Intelligent & Robotic Systems.

[16]  Yu She,et al.  GelSight Wedge: Measuring High-Resolution 3D Contact Geometry with a Compact Robot Finger , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Nathan F. Lepora,et al.  Soft Biomimetic Optical Tactile Sensing With the TacTip: A Review , 2021, IEEE Sensors Journal.

[18]  Siyuan Dong,et al.  GelSlim 3.0: High-Resolution Measurement of Shape, Force and Slip in a Compact Tactile-Sensing Finger , 2021, 2022 International Conference on Robotics and Automation (ICRA).

[19]  Chao Huang,et al.  Tactile Perception Technologies and Their Applications in Minimally Invasive Surgery: A Review , 2020, Frontiers in Physiology.

[20]  Zengguang Hou,et al.  Design of a Low-Cost Miniature Robot to Assist the COVID-19 Nasopharyngeal Swab Sampling , 2020, IEEE Transactions on Medical Robotics and Bionics.

[21]  Sergey Levine,et al.  OmniTact: A Multi-Directional High-Resolution Touch Sensor , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Mike Lambeta,et al.  DIGIT: A Novel Design for a Low-Cost Compact High-Resolution Tactile Sensor With Application to In-Hand Manipulation , 2020, IEEE Robotics and Automation Letters.

[23]  A. Orth,et al.  Optical fiber bundles: Ultra-slim light field imaging probes , 2019, Science Advances.

[24]  B. Dennis,et al.  Digital Rectal Examination for Prostate Cancer Screening in Primary Care: A Systematic Review and Meta-Analysis , 2018, The Annals of Family Medicine.

[25]  Edward H. Adelson,et al.  GelSight: High-Resolution Robot Tactile Sensors for Estimating Geometry and Force , 2017, Sensors.

[26]  Kerrianne Harrington,et al.  Quantitative characterization of endoscopic imaging fibers. , 2017, Optics express.

[27]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Allison M. Okamura,et al.  Methods to Segment Hard Inclusions in Soft Tissue During Autonomous Robotic Palpation , 2015, IEEE Transactions on Robotics.

[29]  Calvin Kwan,et al.  Sensor technology in assessments of clinical skill. , 2015, The New England journal of medicine.

[30]  Yeongjin Kim,et al.  Robotic system with sweeping palpation and needle biopsy for prostate cancer diagnosis , 2014, The international journal of medical robotics + computer assisted surgery : MRCAS.

[31]  X. Tao,et al.  Fiber‐Based Wearable Electronics: A Review of Materials, Fabrication, Devices, and Applications , 2014, Advanced materials.

[32]  Kaspar Althoefer,et al.  Implementation of Tactile Sensing for Palpation in Robot-Assisted Minimally Invasive Surgery: A Review , 2014, IEEE Sensors Journal.

[33]  Kaspar Althoefer,et al.  Magnetic Resonance-Compatible Tactile Force Sensor Using Fiber Optics and Vision Sensor , 2014, IEEE Sensors Journal.

[34]  Emiliano Schena,et al.  Optical Fiber-Based MR-Compatible Sensors for Medical Applications: An Overview , 2013, Sensors.

[35]  Edward H. Adelson,et al.  Lump detection with a gelsight sensor , 2013, 2013 World Haptics Conference (WHC).

[36]  Nigel H. Lovell,et al.  A review of tactile sensing technologies with applications in biomedical engineering , 2012 .

[37]  Hanafiah Yussof,et al.  Characteristics of a New Optical Tactile Sensor for Interactive Robot Fingers , 2011, International Journal of Social Robotics.

[38]  Thomas D. Wang,et al.  Future and advances in endoscopy , 2011, Journal of biophotonics.

[39]  Masahiro Ohka,et al.  Sensorization of Robotic Hand Using Optical Three-Axis Tactile Sensor: Evaluation with Grasping and Twisting Motions , 2010 .

[40]  Timothy D. Soper,et al.  Scanning fiber endoscopy with highly flexible, 1 mm catheterscopes for wide‐field, full‐color imaging , 2010, Journal of biophotonics.

[41]  Angelique Kano,et al.  Design and demonstration of a miniature catheter for a confocal microendoscope. , 2004, Applied optics.

[42]  George Zouridakis,et al.  Biomedical Technology and Devices Handbook , 2003 .

[43]  H. Maekawa,et al.  A finger-shaped tactile sensor using an optical waveguide , 1993, Proceedings of IEEE Systems Man and Cybernetics Conference - SMC.

[44]  Stefan Begej,et al.  Planar and finger-shaped optical tactile sensors for robotic applications , 1988, IEEE J. Robotics Autom..

[45]  J W Garrett,et al.  The Adult Human Hand: Some Anthropometric and Biomechanical Considerations , 1971, Human factors.

[46]  S. K. Morshnev OPTICAL FIBER SENSORS , 2011 .

[47]  M Tanaka,et al.  Development of an active palpation sensor for detecting prostatic cancer and hypertrophy , 2000 .

[48]  D W Rattner,et al.  Optical imaging technology in minimally invasive surgery. Current status and future directions. , 1999, Surgical endoscopy.

[49]  W. Catalona,et al.  Interexaminer variability of digital rectal examination in detecting prostate cancer. , 1995, Urology.