Incorporation of 3D Model and Panoramic View for Gastroscopic Lesion Surveillance

Natural Orifice Transluminal Endoscopic Surgery (NOTES) is widely used for clinical diagnoses. However, NOTES has two main problems: difficulties brought by endoscope’s flexibility and narrow view of endoscope. Image-guided system is helpful to deal with these problems. In our previous work, a computer aided endoscopic navigation system (CAEN) was developed for gastroscopic lesion surveillance. In this paper, 3D model and panoramic view are incorporated into CAEN with three improvements: selection of reference and tracking features; perspective projection for constructing local and global panoramic view; 3D surface modeling using structure from motion. The system is evaluated from three clinic applications: broadening the view, non-invasive retargeting, and overall lesion locations. The evaluation results show that the mean accuracy of broadening the view is 0.43 mm, the mean accuracy of non-invasive retargeting is 7.5 mm, and the mean accuracy for overall lesion diagnosis is 3.71 ± 0.35 mm.

[1]  Bin Zheng,et al.  Bimanual coordination in natural orifice transluminal endoscopic surgery: comparing the conventional dual-channel endoscope, the R-Scope, and a novel direct-drive system. , 2009, Gastrointestinal endoscopy.

[2]  M. Hashizume,et al.  Early experiences of endoscopic procedures in general surgery assisted by a computer-enhanced surgical system , 2002, Surgical Endoscopy And Other Interventional Techniques.

[3]  G. Cadière,et al.  Impact of 2D and 3D Vision on Performance of Novice Subjects Using da Vinci Robotic System , 2006, Acta chirurgica Belgica.

[4]  K. Cleary,et al.  Image-guided interventions: technology review and clinical applications. , 2010, Annual review of biomedical engineering.

[5]  Huilong Duan,et al.  Dynamic 3D Reconstruction of Gastric Internal Surface Under Gastroscopy , 2014 .

[6]  Sébastien Ourselin,et al.  Biopsy Site Re-localisation Based on the Computation of Epipolar Lines from Two Previous Endoscopic Images , 2009, MICCAI.

[7]  Guang-Zhong Yang,et al.  Pathological Site Retargeting under Tissue Deformation Using Geometrical Association and Tracking , 2013, MICCAI.

[8]  T. Aach,et al.  Local and global panoramic imaging for fluorescence bladder endoscopy , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  Guang-Zhong Yang,et al.  Tissue Deformation Recovery with Gaussian Mixture Model Based Structure from Motion , 2011, AE-CAI.

[10]  Paul Swain,et al.  Development and Validation of a New Generation of Flexible Endoscope for NOTES , 2009, Surgical innovation.

[11]  Raúl San José Estépar,et al.  Natural Orifice Transluminal Endoscopic Surgery (NOTES): An Opportunity for Augmented Reality Guidance , 2007, MMVR.

[12]  Huilong Duan,et al.  A non-invasive navigation system for retargeting gastroscopic lesions. , 2014, Bio-medical materials and engineering.

[13]  K. Palmer,et al.  Role of image-guidance systems during NOTES. , 2009, Journal of endourology.

[14]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[15]  S. Bardaro,et al.  Development of advanced endoscopes for Natural Orifice Transluminal Endoscopic Surgery (NOTES) , 2006, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[16]  Li Zhang,et al.  Model evolution: An incremental approach to non-rigid structure from motion , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.