Overlay visualization in endoscopic ENT surgery

PurposeIn endoscopic ENT surgery, the identification and localization of target structures is challenging—depth information is missing, relevant tissues could be hidden behind opaque material and image distortion affects the instrument handling. In this paper, a novel overlay visualization is presented that supports the surgeon by superimposing planning and navigation information on the endoscopic image.MethodTarget regions, which have been identified in preoperative CT data, are superimposed on the endoscopic image, allowing the use of guiding lines for distance visualization. To match the overlay information with the geometrically distorted endoscopic images, a new intraoperative calibration procedure has been developed.ResultsThe accuracy of this new method has been verified by cadaver studies. Clinical evaluation in three paranasal sinus interventions was performed to show the intraoperative assistance and practicability with promising results.ConclusionThe new techniques safely support the surgeon in locating target structures in the paranasal sinuses with little change in the actual workflow.

[1]  Nassir Navab,et al.  Intraoperative Laparoscope Augmentation for Port Placement and Resection Planning in Minimally Invasive Liver Resection , 2008, IEEE Transactions on Medical Imaging.

[2]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[3]  Jay B. West,et al.  Implementation, calibration and accuracy testing of an image-enhanced endoscopy system , 2002, IEEE Transactions on Medical Imaging.

[4]  A Linney,et al.  Image‐enhanced surgical navigation for endoscopic sinus surgery: evaluating calibration, registration and tracking , 2008, The international journal of medical robotics + computer assisted surgery : MRCAS.

[5]  W. Thumfart,et al.  Image-guided endoscopic ENT surgery , 2007, European Archives of Oto-Rhino-Laryngology.

[6]  Hideki Yoshikawa,et al.  Camera Model and Calibration Procedure for Oblique-Viewing Endoscope , 2003, MICCAI.

[7]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Juho Kannala,et al.  A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  H. Iseki,et al.  Endoscopic Augmented Reality Navigation System for Endonasal Transsphenoidal Surgery to Treat Pituitary Tumors: Technical Note , 2002, Neurosurgery.

[10]  Paul F. Whelan,et al.  Which pattern? Biasing aspects of planar calibration patterns and detection methods , 2007, Pattern Recognit. Lett..

[11]  Michael T. Goodrich,et al.  Contour interpolation by straight skeletons , 2004, Graph. Model..