Fast evolution of image manifolds and application to filtering and segmentation in 3D medical images

In many instances, numerical integration of space-scale PDEs is the most time consuming operation of image processing. This is because the scale step is limited by conditional stability of explicit schemes. We introduce the unconditionally stable semiimplicit linearized difference scheme that is fashioned after additive operator split (AOS) [Weickert, J. et al. (1998)], [Goldenberg, R et al., (2001)] for Beltrami and the subjective surface computation. The Beltrami flow [Kimmel, R. (1997) (1999)], [Sochen, N. et al. (1998)], is one of the most effective denoising algorithms in image processing. For gray-level images, we show that the flow equation can be arranged in an advection-diffusion form, revealing the edge-enhancing properties of this flow. This also suggests the application of AOS method for faster convergence. The subjective surface [Sarti, A. et al. (2002)] deals with constructing a perceptually meaningful interpretation from partial image data by mimicking the human visual system. However, initialization of the surface is critical for the final result and its main drawbacks are very slow convergence and the huge number of iterations required. We first show that the governing equation for the subjective surface flow can be rearranged in an AOS implementation, providing a near real-time solution to the shape completion problem in 2D and 3D. Then, we devise a new initialization paradigm where we first "condition" the viewpoint surface using the fast-marching algorithm. We compare the original method with our new algorithm on several examples of real 3D medical images, thus revealing the improvement achieved.

[1]  Ron Kimmel,et al.  Images as Embedded Maps and Minimal Surfaces: Movies, Color, Texture, and Volumetric Medical Images , 2000, International Journal of Computer Vision.

[2]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[3]  Ron Kimmel,et al.  Orientation Diffusion or How to Comb a Porcupine , 2002, J. Vis. Commun. Image Represent..

[4]  Curtis R. Vogel,et al.  Ieee Transactions on Image Processing Fast, Robust Total Variation{based Reconstruction of Noisy, Blurred Images , 2022 .

[5]  Roman Goldenberg,et al.  Fast Geodesic Active Contours , 1999, Scale-Space.

[6]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[7]  R. Malladi,et al.  Fast difference scheme for anisotropic Beltrami smoothing and edge contrast enhancement of gray level and color images , 2001 .

[8]  Bart M. ter Haar Romeny,et al.  Geometry-Driven Diffusion in Computer Vision , 1994, Computational Imaging and Vision.

[9]  Ravi Malladi,et al.  Fast Difference Schemes for Edge Enhancing Beltrami Flow , 2002, ECCV.

[10]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[11]  R Malladi,et al.  Subjective surfaces: a method for completing missing boundaries. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[12]  Ron Kimmel,et al.  3D Shape Reconstruction from Autostereograms and Stereo , 2002, J. Vis. Commun. Image Represent..

[13]  Ron Kimmel,et al.  From High Energy Physics to Low Level Vision , 1997, Scale-Space.

[14]  Alessandro Sarti,et al.  Subjective Surfaces: A Geometric Model for Boundary Completion , 2000, International Journal of Computer Vision.

[15]  A. Polyakov Quantum Geometry of Bosonic Strings , 1981 .

[16]  J. Sethian Level set methods : evolving interfaces in geometry, fluid mechanics, computer vision, and materials science , 1996 .

[17]  Guillermo Sapiro,et al.  Diffusion of General Data on Non-Flat Manifolds via Harmonic Maps Theory: The Direction Diffusion Case , 2000, International Journal of Computer Vision.

[18]  Anthony J. Yezzi,et al.  Modified curvature motion for image smoothing and enhancement , 1998, IEEE Trans. Image Process..

[19]  James A. Sethian,et al.  A real-time algorithm for medical shape recovery , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[20]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Max A. Viergever,et al.  Efficient and reliable schemes for nonlinear diffusion filtering , 1998, IEEE Trans. Image Process..

[22]  R Malladi,et al.  Image processing via level set curvature flow. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[23]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[24]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[25]  J A Sethian,et al.  A fast marching level set method for monotonically advancing fronts. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[26]  R. LeVeque Numerical methods for conservation laws , 1990 .

[27]  Ron Kimmel,et al.  A general framework for low level vision , 1998, IEEE Trans. Image Process..

[28]  Tony F. Chan,et al.  Variational Restoration of Nonflat Image Features: Models and Algorithms , 2001, SIAM J. Appl. Math..

[29]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[30]  Joe Michael Kniss,et al.  Multidimensional Transfer Functions for Interactive Volume Rendering , 2002, IEEE Trans. Vis. Comput. Graph..

[31]  James A. Sethian,et al.  Image Processing: Flows under Min/Max Curvature and Mean Curvature , 1996, CVGIP Graph. Model. Image Process..

[32]  G I Barenblatt Self-similar intermediate asymptotics for nonlinear degenerate parabolic free-boundary problems that occur in image processing , 2001, Proceedings of the National Academy of Sciences of the United States of America.