Three-dimensional object registration using wavelet features

Recent developments in shape-based modeling and data acquisition have brought three-dimensional models to the forefront of computer graphics and visualization research. New data acquisition methods are producing large numbers of models in a variety of fields. Three-dimensional registration (alignment) is key to the useful application of such models in areas from automated surface inspection to cancer detection and surgery. The algorithms developed in this research accomplish automatic registration of three-dimensional voxelized models. We employ features in a wavelet transform domain to accomplish registration. The features are extracted in a multi-resolutional format, thus delineating features at various scales for robust and rapid matching. Registration is achieved by using a voting scheme to select peaks in sets of rotation quaternions, then separately identifying translation. The method is robust to occlusion, clutter, and noise. The efficacy of the algorithm is demonstrated through examples from solid modeling and medical imaging applications.

[1]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[2]  David Salesin,et al.  Fast multiresolution image querying , 1995, SIGGRAPH.

[3]  Nick G. Kingsbury,et al.  Design of Q-shift complex wavelets for image processing using frequency domain energy minimization , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[4]  X. Pennec,et al.  3D non-rigid registration by gradient descent on a Gaussian-windowed similarity measure using convolutions , 2000, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis. MMBIA-2000 (Cat. No.PR00737).

[5]  Ruth Nussinov,et al.  Principles of docking: An overview of search algorithms and a guide to scoring functions , 2002, Proteins.

[6]  Dinggang Shen,et al.  Multimodality image registration by maximization of quantitative-qualitative measure of mutual information , 2008, Pattern Recognit..

[7]  Chi-Man Pun,et al.  Extraction of shift invariant wavelet features for classification of images with different sizes , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Vijayan K. Asari,et al.  Face detection technique based on rotation invariant wavelet features , 2004, International Conference on Information Technology: Coding and Computing, 2004. Proceedings. ITCC 2004..

[9]  H. Röder,et al.  Separable and nonseparable multiwavelets in multiple dimensions , 2002 .

[10]  A Collignon,et al.  Automated multimodality image registration using information theory , 1995 .

[11]  Joonki Paik,et al.  Point fingerprint: A new 3-D object representation scheme , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[12]  Stephen A. Dyer,et al.  Digital signal processing , 2018, 8th International Multitopic Conference, 2004. Proceedings of INMIC 2004..

[13]  Nicholas M. Patrikalakis,et al.  Three-dimensional object registration using the wavelet transform , 2008, SCCG.

[14]  Ray Jarvis,et al.  3D free-form surface registration and object recognition , 2004, International Journal of Computer Vision.

[15]  Jacqueline Le Moigne,et al.  Multiresolution registration of remote sensing imagery by optimization of mutual information using a stochastic gradient , 2003, IEEE Trans. Image Process..

[16]  Tamal K. Dey,et al.  Shape Segmentation and Matching with Flow Discretization , 2003, WADS.

[17]  Luc Van Gool,et al.  Matching of 3-D curves using semi-differential invariants , 1995, Proceedings of IEEE International Conference on Computer Vision.

[18]  Thomas Ertl,et al.  Integrated registration and visualization of medical image data , 1998, Proceedings. Computer Graphics International (Cat. No.98EX149).

[19]  Eero P. Simoncelli,et al.  A filter design technique for steerable pyramid image transforms , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[20]  Horst Bischof,et al.  SIFT and Shape Context for Feature-Based Nonlinear Registration of Thoracic CT Images , 2006, CVAMIA.

[21]  Kyuseok Shim,et al.  WALRUS: a similarity retrieval algorithm for image databases , 1999, IEEE Transactions on Knowledge and Data Engineering.

[22]  J. Kingsbury.  The Illustrated Wavelet Transform Handbook: Introductory Theory and Applications in Science, Engineering, Medicine and Finance , 2004 .

[23]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[24]  Chitra Dorai,et al.  COSMOS - A Representation Scheme for 3D Free-Form Objects , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[26]  Sandor Vajda,et al.  Protein-protein association kinetics and protein docking. , 2002, Current Opinion in Structural Biology.

[27]  Nathan S. Netanyahu,et al.  Georegistration of Landsat data via robust matching of multiresolution features , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Thierry Blu,et al.  Isotropic polyharmonic B-splines: scaling functions and wavelets , 2005, IEEE Transactions on Image Processing.

[29]  E. J. Stollnitz,et al.  Wavelets for Computer Graphics : A Primer , 1994 .

[30]  Paul Suetens,et al.  Medical image registration using mutual information , 2003, Proc. IEEE.

[31]  Balraj Naren,et al.  Medical Image Registration , 2022 .

[32]  Alessandro Neri,et al.  Robust rotation-invariant texture classification using a model based approach , 2004, IEEE Transactions on Image Processing.

[33]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[34]  de Paul Zeeuw,et al.  Pna Probability, Networks and Algorithms Probability, Networks and Algorithms a Toolbox for the Lifting Scheme on Quincunx Grids (lisq) a Toolbox for the Lifting Scheme on Quincunx Grids (lisq) , 2022 .

[35]  N. Kingsbury.  Image processing with complex wavelets , 1999, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[36]  Nicholas M. Patrikalakis,et al.  An algorithm for optimal free-form object matching , 2003, Comput. Aided Des..

[37]  Nicholas M. Patrikalakis,et al.  Shape Intrinsic Properties for Free-Form Object Matching , 2003, Journal of Computing and Information Science in Engineering.

[38]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[39]  Yunmei Chen,et al.  A New & Robust Information Theoretic Measure and Its Application to Image Alignment , 2003, IPMI.

[40]  William T. Freeman,et al.  Presented at: 2nd Annual IEEE International Conference on Image , 1995 .

[41]  Masayuki Nakajima,et al.  Spherical Wavelet Descriptors for Content-based 3D Model Retrieval , 2006, IEEE International Conference on Shape Modeling and Applications 2006 (SMI'06).

[42]  Nasser Khalili,et al.  Multi-scale free-form 3D object recognition using 3D models , 2001, Image Vis. Comput..

[43]  Dimitris N. Metaxas,et al.  A Finite Element Model for Functional Analysis of 4D Cardiac-Tagged MR Images , 2003, MICCAI.

[44]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[45]  Takeo Kanade,et al.  Object Detection Using the Statistics of Parts , 2004, International Journal of Computer Vision.

[46]  Greg Turk,et al.  Simplification and Repair of Polygonal Models Using Volumetric Techniques , 2003, IEEE Trans. Vis. Comput. Graph..

[47]  Po-Whei Huang,et al.  Design of a two-stage content-based image retrieval system using texture similarity , 2004, Inf. Process. Manag..

[48]  Valerio Pascucci,et al.  Line-based object recognition using Hausdorff distance: from range images to molecular secondary structures , 2005, Image Vis. Comput..

[49]  Mohammed Bennamoun,et al.  Rigid Medical Image Registration And Its Association With Mutual Information , 2003, Int. J. Pattern Recognit. Artif. Intell..

[50]  David Salesin,et al.  Wavelets for computer graphics: a primer. 2 , 1995, IEEE Computer Graphics and Applications.

[51]  Scott Reed,et al.  An automatic approach to the detection and extraction of mine features in sidescan sonar , 2003 .

[52]  Andrew E. Johnson,et al.  Recognizing objects by matching oriented points , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[53]  C Thieke,et al.  An enhanced block matching algorithm for fast elastic registration in adaptive radiotherapy , 2006, Physics in medicine and biology.

[54]  N. Kingsbury.  Complex Wavelets for Shift Invariant Analysis and Filtering of Signals , 2001 .

[55]  Rui Xu,et al.  Wavelet-based Multiresolution Medical Image Registration Strategy Combining Mutual Information with Spatial Information , 2006 .

[56]  Moon-Chuen Lee,et al.  Rotation and Scale Invariant Wavelet Feature for Content-based Texture Image Retrieval , 2003, J. Assoc. Inf. Sci. Technol..

[57]  D. W. Scott.  Averaged Shifted Histograms: Effective Nonparametric Density Estimators in Several Dimensions , 1985 .

[58]  George C. Stockman,et al.  Object recognition and localization via pose clustering , 1987, Comput. Vis. Graph. Image Process..

[59]  Micha Sharir,et al.  Hausdorff distance under translation for points and balls , 2003, TALG.

[60]  Isabelle Herlin,et al.  Matching Structures by Computing Minimal Paths on a Manifold , 2002, J. Vis. Commun. Image Represent..

[61]  Cedric Nishan Canagarajah,et al.  Rotationally invariant texture features using the dual-tree complex wavelet transform , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[62]  Bahram Javidi,et al.  Three-dimensional imaging and recognition of microorganism using single-exposure on-line (SEOL) digital holography. , 2005, Optics express.

[63]  Unnikrishnan Gopinathan,et al.  Three-dimensional object recognition from digital Fresnel hologram by wavelet matched filtering , 2006 .

[64]  Tao Xu,et al.  Using Multi-matching System Based on a Simplified Deformable Model of the Human Iris for Iris Recognition , 2004, ICBA.

[65]  Karl Rohr,et al.  An adaptive irregular grid approach for 3D deformable image registration , 2006, Physics in medicine and biology.

[66]  Nicholas M. Patrikalakis,et al.  Shape Interrogation for Computer Aided Design and Manufacturing , 2002, Springer Berlin Heidelberg.

[67]  Micha Sharir,et al.  Partial surface and volume matching in three dimensions , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[68]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[69]  Joachim Weickert,et al.  Rotationally Invariant Wavelet Shrinkage , 2003, DAGM-Symposium.

[70]  Jitendra Malik,et al.  Efficient shape matching using shape contexts , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[71]  Shigeru Shinomoto,et al.  A Method for Selecting the Bin Size of a Time Histogram , 2007, Neural Computation.

[72]  Paul S. Addison,et al.  The Illustrated Wavelet Transform Handbook , 2002 .

[73]  Pavel Krsek,et al.  Differential Invariants as the Base of Triangulated Surface Registration , 2002, Comput. Vis. Image Underst..

[74]  D. Munson.  A note on Lena , 1996 .

[75]  Dexin Zhang,et al.  Efficient iris recognition by characterizing key local variations , 2004, IEEE Transactions on Image Processing.

[76]  Truong Q. Nguyen,et al.  Wavelets and filter banks , 1996 .

[77]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[78]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[79]  Josef Hoschek,et al.  Fundamentals of computer aided geometric design , 1996 .

[80]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[81]  Paul J. Besl,et al.  The Free-Form Surface Matching Problem , 1990 .