Scale-invariant registration of monocular endoscopic images to CT-scans for sinus surgery

We present a scale-invariant registration method for 3D structures reconstructed from a monocular endoscopic camera to pre-operative CT-scans. The presented approach is based on a previously presented method [2] for reconstruction of a scaled 3D model of the environment from unknown camera motion. We use this scaleless reconstruction as input to a PCA-based algorithm that recovers the scale and pose parameters of the camera in the coordinate frame of the CT scan. The result is used in an ICP registration method to refine the registration estimates.

[1]  M J Citardi,et al.  Image-Guided Functional Endoscopic Sinus Surgery , 2000, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[2]  Lerner Ej.  Computer-integrated surgery. , 1997, New Jersey medicine : the journal of the Medical Society of New Jersey.

[3]  K. Smith,et al.  The NeuroStation--a highly accurate, minimally invasive solution to frameless stereotactic neurosurgery. , 1994, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[4]  Jérôme Tonetti,et al.  Computer-assisted versus manual spine surgery: clinical report , 1997, CVRMed.

[5]  R. Metson,et al.  A comparison of image guidance systems for sinus surgery , 1998, The Laryngoscope.

[6]  Y. Kosugi,et al.  An articulated neurosurgical navigation system using MRI and CT images , 1988, IEEE Transactions on Biomedical Engineering.

[7]  Terry M. Peters,et al.  Automatic fusion of freehand endoscopic brain images to three-dimensional surfaces: creating stereoscopic panoramas , 2002, IEEE Transactions on Medical Imaging.

[8]  S. James Zinreich,et al.  Diseases of the sinuses diagnosis and management , 2001 .

[9]  R. Maciunas,et al.  Interactive image-guided neurosurgery , 1992, IEEE Transactions on Biomedical Engineering.

[10]  Darius Burschka,et al.  Real-time 3D Surface Tracking and Its Applications , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[11]  Darius Burschka,et al.  V-GPS - image-based control for 3D guidance systems , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[12]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Peter I. Corke,et al.  Quantitative Evaluation of Matching Methods and Validity Measures for Stereo Vision , 2001, Int. J. Robotics Res..

[14]  Robert J. Maciunas,et al.  New device for interactive image-guided surgery , 1991, Medical Imaging.

[15]  P. Cinquin,et al.  Computer-assisted spine surgery: a technique for accurate transpedicular screw fixation using CT data and a 3-D optical localizer. , 1995, Journal of image guided surgery.

[16]  Takeo Kanade,et al.  Development and validation of a navigational guidance system for acetabular implant placement , 1997, CVRMed.

[17]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Russell H. Taylor,et al.  Augmentation of human precision in computer-integrated surgery , 1992 .

[19]  Gregory D. Hager,et al.  X Vision: A Portable Substrate for Real-Time Vision Applications , 1998, Comput. Vis. Image Underst..

[20]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[21]  Gregory D. Hager,et al.  Real-time tracking of image regions with changes in geometry and illumination , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  M P Heilbrun,et al.  Stereotactic localization and guidance using a machine vision technique. , 1992, Stereotactic and functional neurosurgery.

[23]  D. Long,et al.  Frameless stereotaxic integration of CT imaging data: accuracy and initial applications. , 1993, Radiology.

[24]  K. Takakura,et al.  Three-dimensional digitizer (neuronavigator): new equipment for computed tomography-guided stereotaxic surgery. , 1987, Surgical neurology.

[25]  Dietrich Meyer-Ebrecht,et al.  Orientation aid for head and neck surgeons , 1992 .

[26]  Werner Krybus,et al.  CAS — a Navigation Support for Surgery , 1990 .

[27]  M. Fried,et al.  Image‐Guided Endoscopic Surgery: Results of Accuracy and Performance in a Multicenter Clinical Study Using an Electromagnetic Tracking System , 1997, The Laryngoscope.

[28]  S. L. Hartmann,et al.  Feasibility Studies of Frameless Stereotactic Liver Surgery , 1999 .

[29]  Ulrich Rembold,et al.  Robot assisted craniofacial surgery: first clinical evaluation , 1999 .

[30]  M Scholz,et al.  Development of an endoscopic navigation system based on digital image processing. , 1998, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[31]  Anand Rangarajan,et al.  A new algorithm for non-rigid point matching , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[32]  B. Dawant,et al.  Registration of physical space to laparoscopic image space for use in minimally invasive hepatic surgery , 2000, 5th IEEE EMBS International Summer School on Biomedical Imaging, 2002..

[33]  Dirk Bartz,et al.  Integration of Navigation, Optical and Virtual Endoscopy in Neurosurgery and Oral and Maxillofacial Surgery , 2001 .

[34]  Branislav Jaramaz,et al.  Computer-Assisted Orthopaedic Surgery , 1998, Proceedings of the IEEE.

[35]  Russell H. Taylor,et al.  A Direction Space Interpolation Technique for Calibration of Electromagnetic Surgical Navigation Systems , 2003, MICCAI.

[36]  H Reinhardt,et al.  A computer-assisted device for the intraoperative CT-correlated localization of brain tumors. , 1988, European surgical research. Europaische chirurgische Forschung. Recherches chirurgicales europeennes.

[37]  Russell H. Taylor,et al.  Applications of Simulation, Morphometrics and Robotics in Craniofacial Surgery , 2006 .

[38]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[39]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[40]  Gregory D. Hager,et al.  Efficient Region Tracking With Parametric Models of Geometry and Illumination , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Darius Burschka,et al.  V-GPS(SLAM): vision-based inertial system for mobile robots , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[42]  G. Herman,et al.  3D Imaging In Medicine , 1991 .