Chapter 3 – Multiscale/Multiresolution Representations

This chapter presents a comprehensive overview of the current state in multiscale–multiresolution image representation with a special emphasis on the medical image application. It discusses the notion of scale in the framework of image registration, and reviews some selected multiscale methods on brain image registration, most notably on brain warping. Today, multiscale–multiresolution approaches form an important part of many medical image segmentation and registration techniques. Processing data is more efficient if it can be done in some hierarchical fashion rather than done randomly. This is especially true when the amount of data is large as it is in medical imaging. Fundamentally, discrete hierarchical structures—namely tree structures—are mathematical constructs representing concepts from gross with respect to shape and size, global with respect to spatial context, complex with respect to number of components, general with respect to categories to more detailed, local, simple, or special features of the concept. On the other hand, there is a scale at the continuous signal and measurement level that signifies the sampling resolution in space, time, and spectrum, which in turn reveals not only the matter being measured but also the apparatus that measures it. The result is the resolution of observables.

[1]  C. Broit Optimal registration of deformed images , 1981 .

[2]  Hanan Samet,et al.  A Tutorial on Quadtree Research , 1984 .

[3]  D. Louis Collins,et al.  Animal: Validation and Applications of Nonlinear Registration-Based Segmentation , 1997, Int. J. Pattern Recognit. Artif. Intell..

[4]  P. J. Burt,et al.  Fast Filter Transforms for Image Processing , 1981 .

[5]  D L Hill,et al.  Automated three-dimensional registration of magnetic resonance and positron emission tomography brain images by multiresolution optimization of voxel similarity measures. , 1997, Medical physics.

[6]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[7]  Ruzena Bajcsy,et al.  Evaluation of multiresolution elastic matching using MRI data , 1991, Medical Imaging.

[8]  Nicholas Ayache,et al.  Extension of the ICP Algorithm to Nonrigid Intensity-Based Registration of 3D Volumes , 1997, Comput. Vis. Image Underst..

[9]  Leonard Uhr,et al.  Layered "Recognition Cone" Networks That Preprocess, Classify, and Describe , 1972, IEEE Transactions on Computers.

[10]  R. Bajcsy,et al.  A computerized system for the elastic matching of deformed radiographic images to idealized atlas images. , 1983, Journal of computer assisted tomography.

[11]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[12]  Michael I. Miller,et al.  Deformable templates using large deformation kinematics , 1996, IEEE Trans. Image Process..

[13]  Paul M. Thompson,et al.  A surface-based technique for warping three-dimensional images of the brain , 1996, IEEE Trans. Medical Imaging.

[14]  Atsushi Imiya,et al.  On the History of Gaussian Scale-Space Axiomatics , 1997, Gaussian Scale-Space Theory.

[15]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[16]  Max A. Viergever,et al.  Heuristic Linking Models in Multiscale Image Segmentation , 1997, Comput. Vis. Image Underst..

[17]  A. Rosenfeld,et al.  Edge and Curve Detection for Visual Scene Analysis , 1971, IEEE Transactions on Computers.

[18]  Arthur C. Sanderson,et al.  Multiple Resolution Representation and Probabilistic Matching of 2-D Gray-Scale Shape , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  R. Bajcsy,et al.  Elastically Deforming 3D Atlas to Match Anatomical Brain Images , 1993, Journal of computer assisted tomography.

[20]  M. Viergever,et al.  Medical image matching-a review with classification , 1993, IEEE Engineering in Medicine and Biology Magazine.

[21]  Demetri Terzopoulos,et al.  Multilevel computational processes for visual surface reconstruction , 1983, Comput. Vis. Graph. Image Process..

[22]  J. Gee Probabilistic matching of deformed images , 1996 .

[23]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[24]  A. Rosenfeld Some Useful Properties of Pyramids , 1984 .

[25]  J. Crowley A representation for visual information , 1981 .

[26]  Azriel Rosenfeld,et al.  A critical view of pyramid segmentation algorithms , 1990, Pattern Recognit. Lett..

[27]  Azriel Rosenfeld,et al.  Segmentation and Estimation of Image Region Properties through Cooperative Hierarchial Computation , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[28]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[29]  P. J. Burt,et al.  The Pyramid as a Structure for Efficient Computation , 1984 .

[30]  Alan L. Yuille,et al.  Scaling Theorems for Zero Crossings , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Michael I. Miller,et al.  Individualizing Neuroanatomic Atlases Using a Massively Parallel Computer , 1996, Computer.

[32]  James L. Crowley,et al.  A Representation for Shape Based on Peaks and Ridges in the Difference of Low-Pass Transform , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Ruzena Bajcsy,et al.  Multiresolution elastic matching , 1989, Comput. Vis. Graph. Image Process..

[34]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Christos Davatzikos,et al.  Spatial Transformation and Registration of Brain Images Using Elastically Deformable Models , 1997, Comput. Vis. Image Underst..

[36]  D. Brandt,et al.  Multi-level adaptive solutions to boundary-value problems math comptr , 1977 .

[37]  Andrew P. Witkin,et al.  Uniqueness of the Gaussian Kernel for Scale-Space Filtering , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  J. Maintz Retrospective registration of tomographic brain images , 1996 .

[39]  Joachim Weickert,et al.  A Review of Nonlinear Diffusion Filtering , 1997, Scale-Space.

[40]  Walter G. Kropatsch Properties of Pyramidal Representations , 1994, Theoretical Foundations of Computer Vision.

[41]  Demetri Terzopoulos,et al.  Image Analysis Using Multigrid Relaxation Methods , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Max A. Viergever,et al.  Scale and the differential structure of images , 1992, Image Vis. Comput..

[43]  Koen L. Vincken,et al.  Probabilistic multiscale image segmentation by the hyperstack , 1995 .

[44]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Ruzena Bajcsy,et al.  Three-Dimensional Computerized Brain Atlas For Elastic Matching: Creation And Initial Evaluation , 1988, Medical Imaging.

[46]  Max A. Viergever,et al.  Probabilistic Multiscale Image Segmentation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Bart M. ter Haar Romeny,et al.  Linear Scale-Space I: Basic Theory , 1994, Geometry-Driven Diffusion in Computer Vision.

[48]  Tony Lindeberg,et al.  Scale-Space for Discrete Signals , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[49]  Peter J. Burt,et al.  Smart sensing within a pyramid vision machine , 1988, Proc. IEEE.

[50]  James C. Gee,et al.  Probabilistic Matching of Brain Images , 1995 .

[51]  P. Burt Fast filter transform for image processing , 1981 .

[52]  J. L. Crowley A Multiresolution Representation for Shape , 1984 .

[53]  D. Louis Collins,et al.  Automatic 3‐D model‐based neuroanatomical segmentation , 1995 .

[54]  Demetri Terzopoulos,et al.  Deformable models in medical image analysis: a survey , 1996, Medical Image Anal..

[55]  Theodosios Pavlidis,et al.  A hierarchical data structure for picture processing , 1975 .

[56]  R. Bajcsy,et al.  Evaluation of Elastic Matching System for Anatomic (CT, MR) and Functional (PET) Cerebral Images , 1989, Journal of computer assisted tomography.

[57]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.