3D-2D Projective Registration of Free-Form Curves and Surfaces

Abstract Some medical interventions require knowing the correspondence between an MRI/CT image and the actual position of the patient. Examples occur in neurosurgery and radiotherapy, but also in video surgery (laparoscopy). We present in this paper three new techniques for performing this task without artificial markers. To do this, we find the 3D–2D projective transformation (composition of a rigid displacement and a perspective projection) which maps a 3D object onto a 2D image of this object. Depending on the object model (curve or surface), and on the 2D image acquisition system (X-Ray, video), the techniques are different but the framework is common: Results are presented on a variety of real medical data to demonstrate the validity of our approach.

[1]  Larry S. Davis,et al.  Pose Determination of a Three-Dimensional Object Using Triangle Pairs , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Lerner Ej.  Computer-integrated surgery. , 1997, New Jersey medicine : the journal of the Medical Society of New Jersey.

[3]  David J. Kriegman,et al.  HOT curves for modelling and recognition of smooth curved 3D objects , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Andrew Zisserman,et al.  Geometric invariance in computer vision , 1992 .

[5]  Paul A. Viola.  Alignment by maximisation of mutual information , 1993 .

[6]  Gérard G. Medioni,et al.  Object modelling by registration of multiple range images , 1992, Image Vis. Comput..

[7]  T Kanade,et al.  Techniques for fast and accurate intrasurgical registration. , 1995, Journal of image guided surgery.

[8]  Nicholas Ayache,et al.  Artificial vision for mobile robots - stereo vision and multisensory perception , 1991 .

[9]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[10]  Derek L. G. Hill,et al.  Craniotomy simulation and guidance using a stereo video based tracking system (VISLAN) , 1994, Other Conferences.

[11]  M. Hebert,et al.  The Representation, Recognition, and Locating of 3-D Objects , 1986 .

[12]  Ronen Basri,et al.  The Alignment Of Objects With Smooth Surfaces , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[13]  Xavier Pennec,et al.  A Framework for Uncertainty and Validation of 3-D Registration Methods Based on Points and Frames , 1995, Proceedings of IEEE International Conference on Computer Vision.

[14]  S. Ullman,et al.  The alignment of objects with smooth surfaces , 1993 .

[15]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  J. Thirion,et al.  The 3D marching lines algorithm and its application to crest lines extraction , 1992 .

[17]  R. Szeliski.  Matching 3-D Anatomical Surfaces with Non-Rigid Volumetric Deformations , 1994 .

[18]  P. Danielsson.  Euclidean distance mapping , 1980 .

[19]  Olivier D. Faugeras,et al.  Computing differential properties of 3-D shapes from stereoscopic images without 3-D models , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[20]  G. Malandain.  Filtrage, topologie et mise en correspondance d'images médicales multidimensionnelles , 1992 .

[21]  William Grimson,et al.  Object recognition by computer - the role of geometric constraints , 1991 .

[22]  W. Eric L. Grimson,et al.  An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Pascal Fua,et al.  Registration without correspondences , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[24]  L. Gool,et al.  Semi-differential invariants , 1992 .

[25]  G. Champleboux,et al.  From accurate range imaging sensor calibration to accurate model-based 3D object localization , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[26]  Jean-Claude Latombe,et al.  Planning for Image-Guided Radiosurgery , 1994 .

[27]  Hong-Tzong Yau,et al.  Automated precision measurement of surface profile in CAD-directed inspection , 1992, IEEE Trans. Robotics Autom..

[28]  Lionel Brunie,et al.  IGOR : image guided operating robot. Methodology, medical applications, results , 1992 .

[29]  Robert M. Haralick,et al.  Solving camera parameters from the perspective projection of a parameterized curve , 1984, Pattern Recognit..

[30]  E. Lerner.  Computer-integrated surgery. , 1997, New Jersey medicine : the journal of the Medical Society of New Jersey.

[31]  D. R. Fish,et al.  A patient-to-computed-tomography image registration method based on digitally reconstructed radiographs. , 1994, Medical physics.

[32]  M. Viergever,et al.  Medical image matching-a review with classification , 1993, IEEE Engineering in Medicine and Biology Magazine.