Interactive Three-Dimensional Image Analysis and Visualization Using Graphics Hardware

Image analysis is a process of extracting useful information from input images using various image processing techniques, such as denoising, enhancement, feature detection, and segmentation. State-of-the-art techniques employ sophisticated and time-consuming nonlinear processes to capture subtle and detailed information from images that may be overlooked by classical linear methods. In addition, with the advent of the recent advance in imaging technology, high resolution images of several hundreds gigabytes become common these days. Such recent trends in image processing require computationally expensive processes and make the interactive image analysis challenging. In this dissertation I propose novel three-dimensional nonlinear image processing algorithms and their efficient implementations on modern graphics processors for interactive image analysis, specifically targeting the geoscience and medical applications. Over the past decade, the graphics processing unit (CPU) has evolved into a powerful computing platform for high performance computation. Among many applications, image processing can be a good candidate to achieve a significant speed-up using the GPU because it is inherently a data parallel process. The main motivation of the proposed dissertation research is to accelerate time-consuming image analysis applications using inexpensive commodity CPUs. This dissertation consists of three parts. First, an interactive 3D seismic fault detection system is proposed. I have developed a structure-oriented directional anisotropic diffusion filter and a variance-based fault detection algorithm, and introduced their efficient implementations on the GPU. Second, I propose a fast parallel algorithm for weighted distance computation using a Hamilton-Jacobi framework. The proposed algorithm is based on a label-correcting scheme for scalability on single instruction multiple data (SIMD) parallel architectures. Finally, I propose a probabilistic framework for user-assisted 3D elongated structure segmentation, and show the acceleration techniques using the CPU implementation of nonrigid image registration and probability computation. A number of synthetic and real-world 3D datasets, such as seismic, CT, and DT-MRI volumes, are used to assess the validity and effectiveness of the proposed methods.

[1]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[2]  Michael Spann,et al.  Automatic Fault Detection for 3D Seismic Data , 2003, DICTA.

[3]  John D. Owens,et al.  Fast Deformable Registration on the GPU: A CUDA Implementation of Demons , 2008, 2008 International Conference on Computational Sciences and Its Applications.

[4]  Carl-Fredrik Westin,et al.  A Hamilton-Jacobi-Bellman Approach to High Angular Resolution Diffusion Tractography , 2005, MICCAI.

[5]  R. Kimmel,et al.  An efficient solution to the eikonal equation on parametric manifolds , 2004 .

[6]  S. Eiho,et al.  Processing of RI-Angiocardiographic Images , 1976 .

[7]  U. Clarenz,et al.  Towards fast non-rigid registration , 2003 .

[8]  Alexander M. Bronstein,et al.  Weighted distance maps computation on parametric three-dimensional manifolds , 2007, J. Comput. Phys..

[9]  Martin Rumpf,et al.  Level set segmentation in graphics hardware , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[10]  Joachim Weickert,et al.  Coherence-Enhancing Shock Filters , 2003, DAGM-Symposium.

[11]  Randima Fernando,et al.  The CG Tutorial: The Definitive Guide to Programmable Real-Time Graphics , 2003 .

[12]  Ruzena Bajcsy,et al.  Multiresolution elastic matching , 1989, Comput. Vis. Graph. Image Process..

[13]  Paul Suetens,et al.  Non-rigid Multimodal Image Registration Using Mutual Information , 1998, MICCAI.

[14]  Jens H. Krüger,et al.  A Survey of General‐Purpose Computation on Graphics Hardware , 2007, Eurographics.

[15]  Anthony J. Sherbondy,et al.  Fast volume segmentation with simultaneous visualization using programmable graphics hardware , 2003, IEEE Visualization, 2003. VIS 2003..

[16]  Kendall Preston,et al.  Digital processing of biomedical images , 1976 .

[17]  John N. Tsitsiklis,et al.  Implementation of efficient algorithms for globally optimal trajectories , 1998, IEEE Trans. Autom. Control..

[18]  Randi J. Rost OpenGL(R) Shading Language (2nd Edition) , 2005 .

[19]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[20]  Gordon Kindlmann,et al.  Superquadric tensor glyphs , 2004, VISSYM'04.

[21]  Suyash P. Awate,et al.  Unsupervised Texture Segmentation with Nonparametric Neighborhood Statistics , 2006, ECCV.

[22]  A L Alexander,et al.  Analytical computation of the eigenvalues and eigenvectors in DT-MRI. , 2001, Journal of magnetic resonance.

[23]  J. A. Sethian,et al.  Fast Marching Methods , 1999, SIAM Rev..

[24]  P. Lions,et al.  Some Properties of Viscosity Solutions of Hamilton-Jacobi Equations. , 1984 .

[25]  Guy Marchal,et al.  Automated multi-modality image registration based on information theory , 1995 .

[26]  Martin Rumpf,et al.  Computational Methods for Nonlinear Image Registration , 2006 .

[27]  Pat Hanrahan,et al.  Brook for GPUs: stream computing on graphics hardware , 2004, SIGGRAPH 2004.

[28]  Tiow Seng Tan,et al.  Jump flooding in GPU with applications to Voronoi diagram and distance transform , 2006, I3D '06.

[29]  Piero Lanucara,et al.  Parallel algorithms for Hamilton-Jacobi equations , 1996 .

[30]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[31]  Thomas Ertl,et al.  Accelerating 3D convolution using graphics hardware (case study) , 1999 .

[32]  Kenneth Moreland,et al.  The FFT on a GPU , 2003, HWWS '03.

[33]  J A Sethian,et al.  A fast marching level set method for monotonically advancing fronts. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[34]  G. Fehmers,et al.  Fast structural interpretation with structure-oriented filteringStructure-Oriented Filtering , 2003 .

[35]  Ross T. Whitaker,et al.  A Fast Iterative Method for Eikonal Equations , 2008, SIAM J. Sci. Comput..

[36]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[37]  Gareth J. Barker,et al.  Estimating distributed anatomical connectivity using fast marching methods and diffusion tensor imaging , 2002, IEEE Transactions on Medical Imaging.

[38]  Tony DeRose,et al.  Piecewise smooth surface reconstruction , 1994, SIGGRAPH.

[39]  Stefan Henn,et al.  Iterative Multigrid Regularization Techniques for Image Matching , 2001, SIAM J. Sci. Comput..

[40]  Maurizio Falcone The minimum time problem and its applications to front propagation , 1994 .

[41]  P. Danielsson Euclidean distance mapping , 1980 .

[42]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods , 1999 .

[43]  Seongjai Kim,et al.  An O(N) Level Set Method for Eikonal Equations , 2000, SIAM J. Sci. Comput..

[44]  Kaleem Siddiqi,et al.  The Hamilton-Jacobi skeleton , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[45]  Jan Modersitzki,et al.  Numerical Methods for Image Registration , 2004 .

[46]  M. Sambridge,et al.  The Fast Marching Method: An Effective Tool for Tomographic Imaging and Tracking Multiple Phases in Complex Layered Media , 2005 .

[47]  Christopher M. Kuster,et al.  Computational Study of Fast Methods for the Eikonal Equation , 2005, SIAM J. Sci. Comput..

[48]  Ross T. Whitaker,et al.  Interactive Visualization of Volumetric White Matter Connectivity in DT-MRI Using a Parallel-Hardware Hamilton-Jacobi Solver , 2007, IEEE Transactions on Visualization and Computer Graphics.

[49]  David Levin,et al.  Acceleration of 3D, nonlinear warping using standard video graphics hardware: implementation and initial validation. , 2004, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[50]  Craig Gotsman,et al.  Fast Approximation of High-Order Voronoi Diagrams and Distance Transforms on the GPU , 2006, J. Graph. Tools.

[51]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  Martin Rumpf,et al.  Nonlinear Diffusion in Graphics Hardware , 2001, VisSym.

[53]  Eitan Tadmor,et al.  A Multiscale Image Representation Using Hierarchical (BV, L2 ) Decompositions , 2004, Multiscale Model. Simul..

[54]  Anna R. Bruss The Eikonal equation: some results applicable to computer vision , 1982 .

[55]  B. J Hne,et al.  Spatio - temporal Image Processing: Theory and Scientific Applications , 1991 .

[56]  D. Bertsekas,et al.  Parallel asynchronous label-correcting methods for shortest paths , 1996 .

[57]  J. Koenderink The structure of images , 2004, Biological Cybernetics.

[58]  Rüdiger Westermann,et al.  Non-rigid multi-modal registration on the GPU , 2007, SPIE Medical Imaging.

[59]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[60]  Hanno Scharr,et al.  A Scheme for Coherence-Enhancing Diffusion Filtering with Optimized Rotation Invariance , 2002, J. Vis. Commun. Image Represent..

[61]  J. Tsitsiklis,et al.  Efficient algorithms for globally optimal trajectories , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[62]  William H. Press,et al.  Numerical Recipes in C, 2nd Edition , 1992 .

[63]  Kurt J. Marfurt,et al.  Eigenstructure-based coherence computations as an aid to 3-D structural and stratigraphic mapping , 1999 .

[64]  R. Lynn Kirlin,et al.  3-D seismic attributes using a semblance‐based coherency algorithm , 1998 .

[65]  Zhen-Jun Shi,et al.  Step-size estimation for unconstrained optimization methods , 2005 .

[66]  C. Broit Optimal registration of deformed images , 1981 .

[67]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[68]  Richard M. Leahy,et al.  An Optimal Graph Theoretic Approach to Data Clustering: Theory and Its Application to Image Segmentation , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[69]  Gerard T. Schuster,et al.  Finite‐difference solution of the eikonal equation along expanding wavefronts , 1992 .

[70]  Carl-Fredrik Westin,et al.  New Approaches to Estimation of White Matter Connectivity in Diffusion Tensor MRI: Elliptic PDEs and Geodesics in a Tensor-Warped Space , 2002, MICCAI.

[71]  Bernd Jähne,et al.  Spatio-Temporal Image Processing , 1993, Lecture Notes in Computer Science.

[72]  Wotao Yin,et al.  An Iterative Regularization Method for Total Variation-Based Image Restoration , 2005, Multiscale Model. Simul..

[73]  James A. Sethian,et al.  A unified approach to noise removal, image enhancement, and shape recovery , 1996, IEEE Trans. Image Process..

[74]  John D. Owens,et al.  Glift: generic data structures for graphics hardware , 2006 .

[75]  Francis K. H. Quek,et al.  A review of vessel extraction techniques and algorithms , 2004, CSUR.

[76]  Stanley Osher,et al.  Fast Sweeping Methods for Static Hamilton-Jacobi Equations , 2004, SIAM J. Numer. Anal..

[77]  Ross T. Whitaker,et al.  Interactive 3D seismic fault detection on the Graphics Hardware , 2006, VG@SIGGRAPH.

[78]  Nikos Paragios,et al.  Shape Priors for Level Set Representations , 2002, ECCV.

[79]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[80]  Naga K. Govindaraju,et al.  GPGPU: general-purpose computation on graphics hardware , 2006, SC.

[81]  Hongkai Zhao,et al.  A fast sweeping method for Eikonal equations , 2004, Math. Comput..

[82]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[83]  Zhao,et al.  PARALLEL IMPLEMENTATIONS OF THE FAST SWEEPING METHOD , 2007 .

[84]  Michael S. Bahorich,et al.  3-D Seismic Discontinuity For Faults And Stratigraphic Features: The Coherence Cube , 1995 .

[85]  Guy Marchal,et al.  Automated multi-moda lity image registration based on information theory , 1995 .

[86]  W. Denk,et al.  Serial Block-Face Scanning Electron Microscopy to Reconstruct Three-Dimensional Tissue Nanostructure , 2004, PLoS biology.

[87]  P. Anandan,et al.  A computational framework and an algorithm for the measurement of visual motion , 1987, International Journal of Computer Vision.

[88]  J A Sethian,et al.  Computing geodesic paths on manifolds. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[89]  Michael D. McCool,et al.  Metaprogramming GPUs with Sh , 2004 .

[90]  Ross T. Whitaker,et al.  Interactive deformation and visualization of level set surfaces using graphics hardware , 2003, IEEE Visualization, 2003. VIS 2003..

[91]  Scott T. Acton,et al.  Multigrid anisotropic diffusion , 1998, IEEE Trans. Image Process..

[92]  Bernd Jähne,et al.  Handbook of Computer Vision and Applications: Volume 2: From Images to Features , 1999 .

[93]  Erwin Keeve,et al.  Fourier Volume Rendering on the GPU Using a Split-Stream-FFT , 2004, VMV.

[94]  Lawrence H. Staib,et al.  Estimation of Anatomical Connectivity by Anisotropic Front Propagation and Diffusion Tensor Imaging , 2004, MICCAI.

[95]  Ross T. Whitaker,et al.  A Volumetric Approach to Quantifying Region-to-Region White Matter Connectivity in Diffusion Tensor MRI , 2007, IPMI.

[96]  Paul Suetens,et al.  Medical image registration using mutual information , 2003, Proc. IEEE.

[97]  M. Falcone A numerical approach to the infinite horizon problem of deterministic control theory , 1987 .

[98]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[99]  S. Osher,et al.  Lax-Friedrichs sweeping scheme for static Hamilton-Jacobi equations , 2004 .

[100]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..

[101]  Alexander Vladimirsky,et al.  Ordered Upwind Methods for Static Hamilton-Jacobi Equations: Theory and Algorithms , 2003, SIAM J. Numer. Anal..

[102]  John D. Owens,et al.  Glift: Generic, efficient, random-access GPU data structures , 2006, TOGS.

[103]  Djemel Ziou,et al.  Edge Detection Techniques-An Overview , 1998 .

[104]  Guillermo Sapiro,et al.  Robust anisotropic diffusion , 1998, IEEE Trans. Image Process..

[105]  E. Rouy,et al.  A viscosity solutions approach to shape-from-shading , 1992 .

[106]  Charles T. Loop,et al.  Smooth Subdivision Surfaces Based on Triangles , 1987 .

[107]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[108]  Martin Rumpf,et al.  Image Registration by a Regularized Gradient Flow. A Streaming Implementation in DX9 Graphics Hardware , 2004, Computing.

[109]  L. P. Geldart,et al.  Exploration Seismology: Data Processing , 1995 .

[110]  F. Bornemann,et al.  Finite-element Discretization of Static Hamilton-Jacobi Equations based on a Local Variational Principle , 2004, math/0403517.

[111]  Satinder Chopra,et al.  Coherence Cube and beyond , 2002 .

[112]  Ross T. Whitaker,et al.  Axon tracking in serial block-face scanning electron microscopy , 2009, Medical Image Anal..

[113]  Dinesh Manocha,et al.  Fast computation of generalized Voronoi diagrams using graphics hardware , 1999, SIGGRAPH.

[114]  J. Krüger,et al.  Linear algebra operators for GPU implementation of numerical algorithms , 2003, ACM Trans. Graph..

[115]  Ronald R. Coifman,et al.  Local discontinuity measures for 3-D seismic data , 2002 .

[116]  Jean-Laurent Mallet,et al.  Automatic Faults Extraction Using Double Hough Transform , 2005 .

[117]  Joachim Weickert,et al.  Coherence-Enhancing Diffusion Filtering , 1999, International Journal of Computer Vision.

[118]  Morten Bro-Nielsen,et al.  Fast Fluid Registration of Medical Images , 1996, VBC.

[119]  Dinesh Manocha,et al.  DiFi: Fast 3D Distance Field Computation Using Graphics Hardware , 2004, Comput. Graph. Forum.

[120]  Trygve Randen,et al.  Automatic Fault Extraction Using Artificial Ants , 2002 .

[121]  Heinz-Otto Peitgen,et al.  GPU Accelerated Image Registration in Two and Three Dimensions , 2006, Bildverarbeitung für die Medizin.

[122]  Stanley Osher,et al.  Fast Sweeping Algorithms for a Class of Hamilton-Jacobi Equations , 2003, SIAM J. Numer. Anal..

[123]  Paul A. Viola,et al.  Texture recognition using a non-parametric multi-scale statistical model , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[124]  Alexander M. Bronstein,et al.  Parallel algorithms for approximation of distance maps on parametric surfaces , 2008, TOGS.

[125]  Lucas J. van Vliet,et al.  Edge preserving orientation adaptive filtering , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[126]  S. Lai,et al.  Robust and efficient algorithms for optical flow computation , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[127]  Wenkai Lu,et al.  Higher-order-statistics and supertrace-based coherence-estimation algorithm , 2005 .

[128]  Markus H. Gross,et al.  Signed distance transform using graphics hardware , 2003, IEEE Visualization, 2003. VIS 2003..

[129]  Ivan Viola,et al.  Hardware-based nonlinear filtering and segmentation using high-level shading languages , 2003, IEEE Visualization, 2003. VIS 2003..

[130]  Joseph S. B. Mitchell,et al.  The Discrete Geodesic Problem , 1987, SIAM J. Comput..

[131]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[132]  Kurt J. Marfurt,et al.  Emerging and future trends in seismic attributes , 2008 .

[133]  J. Shewchuk An Introduction to the Conjugate Gradient Method Without the Agonizing Pain , 1994 .

[134]  Greg Humphreys,et al.  A multigrid solver for boundary value problems using programmable graphics hardware , 2003, HWWS '03.

[135]  Johan Wiklund,et al.  Multidimensional Orientation Estimation with Applications to Texture Analysis and Optical Flow , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[136]  Christopher Nimsky,et al.  Non-rigid Registration with Use of Hardware-Based 3D Bézier Functions , 2002, MICCAI.

[137]  Demetri Terzopoulos,et al.  Deformable models in medical image analysis: a survey , 1996, Medical Image Anal..

[138]  P. Bakker,et al.  Image structure analysis for seismic interpretation , 2002 .

[139]  Ruigang Yang,et al.  Fast Image Segmentation and Smoothing Using Commodity Graphics Hardware , 2002, J. Graphics, GPU, & Game Tools.

[140]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .