Fast and accurate shape-based registration

In many areas of science, engineering, medicine, and especially in the field of robotics, there is a need to establish a spatial mapping between two or more 3-dimensional (3-D) shape representations of an object. The registration problem is concerned with finding a spatial transformation which best aligns two object representations. Once this mapping is established, a variety of tasks can be performed using the aligned object representations including model-based localization, 3-D object recognition, real-time pose tracking and multi-modality sensor fusion. The research goals of this dissertation are the design, implementation and validation of fast and accurate methods for performing 3-D shape-based registration. Fast registration is achieved via speed enhancements to an existing registration method (the iterative closest point algorithm). The implemented enhancements increase registration speeds by a factor of nearly two orders of magnitude, and the resulting speeds are much higher than those previously reported in the literature. The ability to perform high-speed registration enables completely new registration applications. For example, this dissertation describes a system for tracking the position and orientation of arbitrarily-shaped objects at speeds of roughly 10 Hz using a high-speed range finder. The majority of this dissertation focuses on the problem of achieving and ensuring high accuracy shape-based registration. This goal is addressed via two processes: intelligent data selection and online accuracy estimation. Intelligent data selection is based on the observation that all data are not equally beneficial for performing accurate registration. Judicious selection and careful collection of a limited amount of data can result in better registration accuracy than random use of larger amounts of data. In this dissertation, two techniques are proposed for performing intelligent data selection: an optimization process (Constraint Synthesis), and a numerical analysis method which provides a criterion measure for the optimization process (Constraint Analysis). Registration experiments demonstrate that data configurations which are automatically synthesized using these methods can significantly increase registration accuracy. A fundamental problem in registration is knowing whether an estimated transformation satisfies accuracy requirements at the time of registration. A conventional root-mean-squared error, coupled with the criterion measure from constraint analysis provides the ability to estimate true registration accuracy online. This estimate can be used to guide the online collection of registration data by determining when additional data are required to satisfy accuracy requirements. While there are many areas to which registration can be applied, the chosen domain for this dissertation is medicine, and most of the results are presented in the context of computer-assisted surgery. Despite the specific nature of the chosen application area, the underlying ideas and methods have application to a broad range of registration problems.

[1]  D. L. Taylor,et al.  Optimal alignment of geometric models for comparison , 1990, [1990] Proceedings of the First Conference on Visualization in Biomedical Computing.

[2]  John J. Craig,et al.  Introduction to Robotics Mechanics and Control , 1986 .

[3]  K. Sato,et al.  Range imaging system utilizing nematic liquid crystal mask , 1987 .

[4]  Tsuneo Yoshikawa,et al.  Manipulability of Robotic Mechanisms , 1985 .

[5]  M. Viergever,et al.  Medical image matching-a review with classification , 1993, IEEE Engineering in Medicine and Biology Magazine.

[6]  S. Baluja An Empirical Comparison of Seven Iterative and Evolutionary Function Optimization Heuristics , 1995 .

[7]  Koichi Sugimoto On the manipulability and singularity of manipulators , 1991 .

[8]  Peter Kazanzides,et al.  An image-directed robotic system for precise orthopaedic surgery , 1994, IEEE Trans. Robotics Autom..

[9]  Marc Rioux,et al.  Direct Estimation of Range Flow on Deformable Shape From a Video Rate Range Camera , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  David G. Lowe,et al.  Fitting Parameterized Three-Dimensional Models to Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Robert C. Bolles,et al.  Parametric Correspondence and Chamfer Matching: Two New Techniques for Image Matching , 1977, IJCAI.

[12]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[13]  T. Kanade,et al.  Accuracy Validation in Image-Guided Orthopaedic Surgery , 1995 .

[14]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[15]  Xinhua Zhuang,et al.  Pose estimation from corresponding point data , 1989, IEEE Trans. Syst. Man Cybern..

[16]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[17]  Chia-Hsiang Menq,et al.  Determination of Optimal Measurement Configurations for Robot Calibration Based on Observability Measure , 1991, Int. J. Robotics Res..

[18]  R. Maciunas,et al.  Interactive image-guided neurosurgery , 1992, IEEE Transactions on Biomedical Engineering.

[19]  G. Champleboux,et al.  From accurate range imaging sensor calibration to accurate model-based 3D object localization , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  P. Cinquin,et al.  Patient setup optimization for external conformal radiotherapy. , 1995, Journal of image guided surgery.

[21]  P. Reed Stereotactic neurosurgery , 2017, Neurosurgery clinics of North America.

[22]  Jean-Claude Latombe,et al.  Planning for Image-Guided Radiosurgery , 1994 .

[23]  Hong-Tzong Yau,et al.  Automated precision measurement of surface profile in CAD-directed inspection , 1992, IEEE Trans. Robotics Autom..

[24]  Richard Szeliski,et al.  Recovering the Position and Orientation of Free-Form Objects from Image Contours Using 3D Distance Maps , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  B. Geiger Three-dimensional modeling of human organs and its application to diagnosis and surgical planning , 1993 .

[26]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  R. O’Toole,et al.  HipNav : Pre-operative Planning and Intraoperative Navigational Guidance for Acetabular Implant Placement in Total Hip Replacement Surgery , 1995 .

[28]  Robert M. Haralick,et al.  2D-3D pose estimation , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[29]  John M. Hollerbach,et al.  The noise amplification index for optimal pose selection in robot calibration , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[30]  E. Lerner Computer-integrated surgery. , 1997, New Jersey medicine : the journal of the Medical Society of New Jersey.

[31]  PAUL D. SAMPSON,et al.  Fitting conic sections to "very scattered" data: An iterative refinement of the bookstein algorithm , 1982, Comput. Graph. Image Process..

[32]  Ron Kikinis,et al.  Automated Registration for Enhanced Reality Visualization in Surgery , 1994 .

[33]  Audra E. Kosh,et al.  Linear Algebra and its Applications , 1992 .

[34]  Lerner Ej Computer-integrated surgery. , 1997, New Jersey medicine : the journal of the Medical Society of New Jersey.

[35]  Takeo Kanade,et al.  Vision-Based Object Registration for Real-Time Image Overlay , 1995, CVRMed.

[36]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[37]  C. Spoor,et al.  Rigid body motion calculated from spatial co-ordinates of markers. , 1980, Journal of biomechanics.

[38]  Pradeep K. Khosla,et al.  Dexterity measures for design and control of manipulators , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[39]  Hanqi Zhuang,et al.  Optimal selection of measurement configurations for robot calibration using simulated annealing , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[40]  Andrew E. Johnson,et al.  Recognizing objects by matching oriented points , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[41]  Katsushi Ikeuchi,et al.  Shape representation and image segmentation using deformable surfaces , 1992, Image Vis. Comput..

[42]  P. Cinquin,et al.  Computer-assisted spine surgery: a technique for accurate transpedicular screw fixation using CT data and a 3-D optical localizer. , 1995, Journal of image guided surgery.

[43]  Naokazu Yokoya,et al.  A Robust Method for Registration and Segmentation of Multiple Range Images , 1995, Comput. Vis. Image Underst..

[44]  M. Peshkin,et al.  Diagramming Registration Connectivity and Structure , 1995 .

[45]  M. Fitzpatrick A Review of Medical Image Registration , 1993 .

[46]  吉川 恒夫,et al.  Foundations of robotics : analysis and control , 1990 .

[47]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[48]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[49]  W. Eric L. Grimson,et al.  Evaluating and Validating an Automated Registration System for Enhanced Reality Visualization in Surgery , 1995, CVRMed.

[50]  Bernard Roth,et al.  An Extension of Screw Theory , 1981 .

[51]  .. McGlone,et al.  Vision-Based Object Registration for Real-Time Image Overlay , 1995 .

[52]  M. Hebert,et al.  The Representation, Recognition, and Locating of 3-D Objects , 1986 .

[53]  Mark D. Wheeler,et al.  Automatic Modeling and Localization for Object Recognition , 1996 .

[54]  J. Michael McCarthy,et al.  Introduction to theoretical kinematics , 1990 .

[55]  Richard Szeliski,et al.  Matching 3-D smooth surfaces with their 2-D projections using 3-D distance maps , 1991, Optics & Photonics.

[56]  C. Melchiorri,et al.  Robot manipulability , 1995, IEEE Trans. Robotics Autom..

[57]  Rich Caruana,et al.  Removing the Genetics from the Standard Genetic Algorithm , 1995, ICML.

[58]  Pascal Fua,et al.  Registration without correspondences , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[59]  J. Mazziotta,et al.  MRI‐PET Registration with Automated Algorithm , 1993, Journal of computer assisted tomography.

[60]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[61]  David J. Hawkes,et al.  Registration of 3D Surface Data for Intra-Operative Guidance and Visualization in Frameless Stereotactic Neurosurgery , 1995, CVRMed.

[62]  B. Mishra,et al.  Some discussion of static gripping and its stability , 1989, IEEE Trans. Syst. Man Cybern..

[63]  Nicholas Ayache,et al.  3D-2D Projective Registration of Free-Form Curves and Surfaces , 1997, Comput. Vis. Image Underst..

[64]  Tomas Lozano-Perez,et al.  Automatic : Registration for Multiple Sclerosis Change Detection , 2004 .

[65]  Jon Louis Bentley,et al.  An Algorithm for Finding Best Matches in Logarithmic Expected Time , 1977, TOMS.

[66]  Nicholas Ayache,et al.  A New Framework for Fusing Stereo Images with Volumetric Medical Images , 1995, CVRMed.

[67]  S. Hayati,et al.  A robot with improved absolute positioning accuracy for CT guided stereotactic brain surgery , 1988, IEEE Transactions on Biomedical Engineering.

[68]  Richard A. Robb,et al.  New approach to 3-D registration of multimodality medical images by surface matching , 1992, Other Conferences.

[69]  Xinhua Zhuang,et al.  Robust 3-D-3-D Pose Estimation , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[70]  Gabriel Taubin,et al.  Estimation of Planar Curves, Surfaces, and Nonplanar Space Curves Defined by Implicit Equations with Applications to Edge and Range Image Segmentation , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[71]  Takeo Kanade,et al.  A VISI Smart Sensor For Fast Range Imaging , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[72]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[73]  Jon T. Lea,et al.  Diagramming registration connectivity and structure [computer-assisted surgery] , 1995 .

[74]  James M. Rehg,et al.  Visual tracking with deformation models , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[75]  Ingemar J. Cox,et al.  Predicting and Estimating the Accuracy of a Subpixel Registration Algorithm , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[76]  H. Harry Asada,et al.  Kinematic analysis of workpart fixturing for flexible assembly with automatically reconfigurable fixtures , 1985, IEEE J. Robotics Autom..

[77]  D. Dormont,et al.  Registration in neurosurgery and neuroradiotherapy applications. , 1995, Journal of image guided surgery.

[78]  M. Peshkin,et al.  Registration and immobilization in robot-assisted surgery. , 1995, Journal of image guided surgery.

[79]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[80]  H. Harry Asada,et al.  Kinematic analysis and planning for form closure grasps by robotic hands , 1989 .

[81]  Chia-Hsiang Menq,et al.  Localization of 3-D Objects Having Complex Sculptured Surfaces Using Tactile Sensing and Surface Description , 1991 .