Scanning the surface of soft tissues with a micrometer precision thanks to endomicroscopy based visual servoing

Probe-based confocal laser endomicroscopy is a recent tissue imaging technology that requires placing a probe in contact with the tissue to be imaged and provides real time images with a microscopic resolution. Additionally, generating adequate probe movements to sweep the tissue surface can be used to reconstruct a wide mosaic of the scanned region while increasing the resolution which is appropriate for anatomico-pathological cancer diagnosis. However, properly controlling the motion along the scanning trajectory is a major problem. Indeed, the tissue exhibits deformations under friction forces exerted by the probe leading to deformed mosaics. In this paper we propose a visual servoing approach for controlling the probe movements relative to the tissue while rejecting the tissue deformation disturbance. The probe displacement with respect to the tissue is firstly estimated using the confocal images and an image registration real-time algorithm. Secondly, from this real-time image-based position measurement, the probe motion is controlled thanks to a simple proportional-integral compensator and a feedforward term. Ex vivo experiments using a Stäubli TX40 robot and a Mauna Kea Technologies Cellvizio imaging device demonstrate the effectiveness of the approach on liver and muscle tissue.

[1]  J. Fujimoto,et al.  Optical Coherence Tomography , 1991, LEOS '92 Conference Proceedings.

[2]  M. Feuerstein,et al.  Navigation in endoscopic soft tissue surgery: perspectives and limitations. , 2008, Journal of endourology.

[3]  A. Polglase,et al.  A fluorescence confocal endomicroscope for in vivo microscopy of the upper- and the lower-GI tract. , 2005, Gastrointestinal endoscopy.

[4]  Guang-Zhong Yang,et al.  A Hand-held Instrument to Maintain Steady Tissue Contact during Probe-Based Confocal Laser Endomicroscopy , 2011, IEEE Transactions on Biomedical Engineering.

[5]  Francois Lacombe,et al.  Real time autonomous video image registration for endomicroscopy: fighting the compromises , 2008, SPIE BiOS.

[6]  Guillaume Morel,et al.  Laparoscopic optical biopsies: In vivo robotized mosaicing with probe-based confocal endomicroscopy , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Vincent Hayward,et al.  Minimal adhesion surface area in tangentially loaded digital contacts. , 2011, Journal of biomechanics.

[8]  A Sarvazyan,et al.  Soft tissue elastometer. , 2008, Medical engineering & physics.

[9]  A. Rouse,et al.  Clinical confocal microlaparoscope for real-time in vivo optical biopsies. , 2009, Journal of biomedical optics.

[10]  J. Schuman,et al.  Optical coherence tomography. , 2000, Science.

[11]  Jung Kim,et al.  In Vivo Mechanical Behavior of Intra-abdominal Organs , 2006, IEEE Transactions on Biomedical Engineering.

[12]  J. P. Lewis,et al.  Fast Template Matching , 2009 .

[13]  John Kenneth Salisbury,et al.  In Vivo Micro-Image Mosaicing , 2011, IEEE Transactions on Biomedical Engineering.

[14]  Nicholas Ayache,et al.  Robust mosaicing with correction of motion distortions and tissue deformations for in vivo fibered microscopy , 2006, Medical Image Anal..

[15]  Peter Xiaoping Liu,et al.  A New Hybrid Soft Tissue Model for Visio-Haptic Simulation , 2011, IEEE Transactions on Instrumentation and Measurement.

[16]  Aidan O'Dwyer,et al.  Handbook of PI and PID controller tuning rules , 2003 .

[17]  Paul Fockens,et al.  Probe-based confocal laser endomicroscopy. , 2009, Gastroenterology.

[18]  R. Kiesslich,et al.  In vivo histology of Barrett's esophagus and associated neoplasia by confocal laser endomicroscopy. , 2005, Clinical gastroenterology and hepatology : the official clinical practice journal of the American Gastroenterological Association.

[19]  W. Piyawattanametha,et al.  3-D Near-Infrared Fluorescence Imaging Using an MEMS-Based Miniature Dual-Axis Confocal Microscope , 2009, IEEE Journal of Selected Topics in Quantum Electronics.

[20]  Y. Sabharwal,et al.  Slit-scanning confocal microendoscope for high-resolution in vivo imaging. , 1999, Applied optics.