Partial surface and volume matching in three dimensions

In this paper we present a new technique for partial surface and volume matching of images in three dimensions. In this problem we are given two objects in 3-space, each represented as a set of points, and the goal is to find a rigid motion of one object which makes a sufficiently large portion of its boundary lying sufficiently close to a corresponding portion of the boundary of the second object. This is an important problem in pattern recognition and in computer vision, with many industrial, medical, and chemical applications. Our method treats separately the rotation and the translation components of the Euclidean motion that we seek. The algorithm steps through a sequence of rotations, in a steepest-descent style, and uses a novel technique for scoring the match for any fixed rotation. Experimental results on various examples, involving data from industrial applications, medical imaging, and molecular biology, are presented, and show the accurate and robust performance of our algorithm.

[1]  F. Beer.  Vector Mechanics for Engineers: Dynamics , 1950 .

[2]  T. W. Anderson,et al.  An Introduction to Multivariate Statistical Analysis , 1959 .

[3]  T. W. Anderson.  An Introduction to Multivariate Statistical Analysis , 1959 .

[4]  H. Spang.  A Review of Minimization Techniques for Nonlinear Functions , 1962 .

[5]  Robert C. Bolles,et al.  Parametric Correspondence and Chamfer Matching: Two New Techniques for Image Matching , 1977, IJCAI.

[6]  Werner Frei,et al.  A Digital Technique for Accurate Change Detection in Nuclear Medical Images - With Application to Myocardial Perfusion Studies Using Thallium-201 , 1979, IEEE Transactions on Nuclear Science.

[7]  J. W. Humberston.  Classical mechanics , 1980, Nature.

[8]  J M Blaney,et al.  A geometric approach to macromolecule-ligand interactions. , 1982, Journal of molecular biology.

[9]  Robert B. Fisher.  Using Surfaces and Object Models to Recognize Partially Obscured Objects , 1983, IJCAI.

[10]  Michael Potmesil,et al.  Generating Models of Solid Objects by Matching 3D Surface Segments , 1983, IJCAI.

[11]  Gene H. Golub,et al.  Matrix computations , 1983 .

[12]  G. Garibotto,et al.  3-D Image Processing In Functional Stereotactic Neurosurgery , 1983, Other Conferences.

[13]  Olivier D. Faugeras,et al.  A 3-D Recognition and Positioning Algorithm Using Geometrical Matching Between Primitive Surfaces , 1983, IJCAI.

[14]  Robert C. Bolles,et al.  3DPO: A Three- Dimensional Part Orientation System , 1986, IJCAI.

[15]  Berthold K. P. Horn.  Extended Gaussian images , 1984, Proceedings of the IEEE.

[16]  Philip E. Brou.  Using the Gaussian Image to Find the Orientation of Objects , 1984 .

[17]  D. K. Friesen,et al.  A combinatorial algorithm for calculating ligand binding , 1984 .

[18]  Ramesh C. Jain,et al.  Three-dimensional object recognition , 1985, CSUR.

[19]  M. L. Connolly.  Shape complementarity at the hemoglobin α1β1 subunit interface , 1986 .

[20]  I J Kalet,et al.  Radiotherapy planning: direct tumor location on simulation and port films using CT. Part I. Principles. , 1986, Radiology.

[21]  Charles R. Dyer,et al.  Model-based recognition in robot vision , 1986, CSUR.

[22]  Linda L. Fellingham,et al.  Correlation Of 3D Surfaces From Multiple Modalities In Medical Imaging , 1986, Other Conferences.

[23]  Edith Schonberg,et al.  Two-Dimensional, Model-Based, Boundary Matching Using Footprints , 1986 .

[24]  Fred L. Bookstein,et al.  From Medical Images to the Biometrics of Form , 1986 .

[25]  George C. Stockman,et al.  Object recognition and localization via pose clustering , 1987, Comput. Vis. Graph. Image Process..

[26]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[27]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Alessandro Martelli,et al.  Compensation of Random Eye Motion in Television Ophthalmoscopy: Preliminary Results , 1987, IEEE Transactions on Medical Imaging.

[29]  Micha Sharir,et al.  Identification of Partially Obscured Objects in Two and Three Dimensions by Matching Noisy Characteristic Curves , 1987 .

[30]  Bernard Chazelle,et al.  A Functional Approach to Data Structures and Its Use in Multidimensional Searching , 1988, SIAM J. Comput..

[31]  Gunilla Borgefors,et al.  Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  R. Abagyan,et al.  A simple qualitative representation of polypeptide chain folds: comparison of protein tertiary structures. , 1988, Journal of biomolecular structure & dynamics.

[33]  Haim J. Wolfson,et al.  An improved model-based matching method using footprints , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[34]  P. Besl.  Geometric modeling and computer vision , 1988, Proc. IEEE.

[35]  Richard Szeliski.  Estimating Motion From Sparse Range Data Without Correspondence , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[36]  Yehezkel Lamdan,et al.  Geometric Hashing: A General And Efficient Model-based Recognition Scheme , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[37]  C. Pelizzari,et al.  Image Analysis of PET Data with the aid of CT and MR Images , 1988 .

[38]  F. Richards,et al.  Identification of structural motifs from protein coordinate data: Secondary structure and first‐level supersecondary structure * , 1988, Proteins.

[39]  Ruzena Bajcsy,et al.  Multiresolution elastic matching , 1989, Comput. Vis. Graph. Image Process..

[40]  Tom Maniatis,et al.  Action of leucine zippers , 1989, Nature.

[41]  Azriel Rosenfeld,et al.  Registration of multiple overlapping range images: scenes without distinctive features , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[42]  Ruzena Bajcsy,et al.  Three-dimensional registration of PET and CT images , 1989, Images of the Twenty-First Century. Proceedings of the Annual International Engineering in Medicine and Biology Society,.

[43]  C. Pelizzari,et al.  Accurate Three‐Dimensional Registration of CT, PET, and/or MR Images of the Brain , 1989, Journal of computer assisted tomography.

[44]  J. Fitzpatrick,et al.  Adaptive search space scaling in digital image registration. , 1989, IEEE transactions on medical imaging.

[45]  Alan C. Evans,et al.  Anatomical-Functional Correlative Analysis Of The Human Brain Using Three Dimensional Imaging Systems , 1989, Medical Imaging.

[46]  Yehezkel Lamdan,et al.  Affine invariant model-based object recognition , 1990, IEEE Trans. Robotics Autom..

[47]  Eldon D. Lehmann,et al.  Preliminary Work on the Interpretation of SPECT Images with the Aid of Registered MR Images and an MR Derived 3D Neuro-anatomical Atlas , 1990 .

[48]  D J Dowsett,et al.  A technique for digital image registration used prior to subtraction of lung images in nuclear medicine. , 1990, Physics in medicine and biology.

[49]  Paul J. Besl,et al.  The Free-Form Surface Matching Problem , 1990 .

[50]  Haim J. Wolfson,et al.  Model-Based Object Recognition by Geometric Hashing , 1990, ECCV.

[51]  Haim J. Wolfson.  On curve matching , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  P Willett,et al.  Use of techniques derived from graph theory to compare secondary structure motifs in proteins. , 1990, Journal of molecular biology.

[53]  Jayaram K. Udupa,et al.  Registration of 3D objects and surfaces , 1990, IEEE Computer Graphics and Applications.

[54]  J. F. Bradshaw,et al.  The principal axes transformation--a method for image registration. , 1990, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[55]  L Junck,et al.  Correlation methods for the centering, rotation, and alignment of functional brain images. , 1990, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[56]  Mehran Moshfeghi,et al.  Elastic matching of multimodality medical images , 1991, CVGIP Graph. Model. Image Process..

[57]  Fred L. Bookstein,et al.  Thin-Plate Splines and the Atlas Problem for Biomedical Images , 1991, IPMI.

[58]  D. Hill,et al.  Registration of MR and CT images for skull base surgery using point-like anatomical features. , 1991, The British journal of radiology.

[59]  S. Kim,et al.  "Soft docking": matching of molecular surface cubes. , 1991, Journal of molecular biology.

[60]  Derek L. G. Hill,et al.  Use of anatomical knowledge to register 3-D blood vessel data derived from DSA with MR images , 1991, Medical Imaging.

[61]  Trevor J. Hastie,et al.  3-D curve matching using splines , 1991, J. Field Robotics.

[62]  H. Wolfson,et al.  Efficient detection of three-dimensional structural motifs in biological macromolecules by computer vision techniques. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[63]  H. Wolfson,et al.  An efficient automated computer vision based technique for detection of three dimensional structural motifs in proteins. , 1992, Journal of biomolecular structure & dynamics.

[64]  Richard A. Robb,et al.  Image registration of multimodality 3-D medical images by chamfer matching , 1992, Electronic Imaging.

[65]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[66]  E. Katchalski‐Katzir,et al.  Molecular surface recognition: determination of geometric fit between proteins and their ligands by correlation techniques. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[67]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[68]  D. Louis Collins,et al.  Model-based segmentation of individual brain structures from MRI data , 1992, Other Conferences.

[69]  Ruth Nussinov,et al.  3-D Docking of Protein Molecules , 1993, CPM.

[70]  Daniel P. Huttenlocher,et al.  Tracking non-rigid objects in complex scenes , 1993, 1993 (4th) International Conference on Computer Vision.

[71]  M. Viergever,et al.  Medical image matching-a review with classification , 1993, IEEE Engineering in Medicine and Biology Magazine.

[72]  Richard Szeliski,et al.  Recovering the Position and Orientation of Free-Form Objects from Image Contours Using 3D Distance Maps , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[73]  Leszek Wojnar,et al.  Image Analysis , 1998 .