GPU Accelerated Edge-Region Based Level Set Evolution Constrained by 2D Gray-Scale Histogram

Due to its intrinsic nature which allows to easily handle complex shapes and topological changes, the level set method (LSM) has been widely used in image segmentation. Nevertheless, LSM is computationally expensive, which limits its applications in real-time systems. For this purpose, we propose a new level set algorithm, which uses simultaneously edge, region, and 2D histogram information in order to efficiently segment objects of interest in a given scene. The computational complexity of the proposed LSM is greatly reduced by using the highly parallelizable lattice Boltzmann method (LBM) with a body force to solve the level set equation (LSE). The body force is the link with image data and is defined from the proposed LSE. The proposed LSM is then implemented using an NVIDIA graphics processing units to fully take advantage of the LBM local nature. The new algorithm is effective, robust against noise, independent to the initial contour, fast, and highly parallelizable. The edge and region information enable to detect objects with and without edges, and the 2D histogram information enable the effectiveness of the method in a noisy environment. Experimental results on synthetic and real images demonstrate subjectively and objectively the performance of the proposed method.

[1]  J. Buick,et al.  Gravity in a lattice Boltzmann model , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[2]  Chunming Li,et al.  Level set evolution without re-initialization: a new variational formulation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Chunming Li,et al.  Implicit Active Contours Driven by Local Binary Fitting Energy , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Pierre Kornprobst,et al.  Mathematical problems in image processing - partial differential equations and the calculus of variations , 2010, Applied mathematical sciences.

[5]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[6]  Bin Wang,et al.  A Fast and Robust Level Set Method for Image Segmentation Using Fuzzy Clustering and Lattice Boltzmann Method , 2013, IEEE Transactions on Cybernetics.

[7]  J. B. Rosen The Gradient Projection Method for Nonlinear Programming. Part I. Linear Constraints , 1960 .

[8]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[9]  Xuelong Li,et al.  A Relay Level Set Method for Automatic Image Segmentation , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Ye Zhao,et al.  Lattice Boltzmann based PDE solver on the GPU , 2008, The Visual Computer.

[11]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Xuelong Li,et al.  A Unified Tensor Level Set for Image Segmentation , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  S. Succi The Lattice Boltzmann Equation for Fluid Dynamics and Beyond , 2001 .

[14]  Jitendra Malik,et al.  An empirical approach to grouping and segmentation , 2002 .

[15]  Chunming Li,et al.  A Level Set Method for Image Segmentation in the Presence of Intensity Inhomogeneities With Application to MRI , 2011, IEEE Transactions on Image Processing.

[16]  Xinbo Gao,et al.  Image multi-thresholding by combining the lattice Boltzmann model and a localized level set algorithm , 2012, Neurocomputing.

[17]  V. Caselles,et al.  A geometric model for active contours in image processing , 1993 .

[18]  Sylvie Philipp-Foliguet,et al.  Évaluation de la segmentation d'images : état de l'art, nouveaux indices et comparaison Evaluation of image segmentation : state of the art, new criteria and comparison , 2006 .

[19]  Xinbo Gao,et al.  A Multiphase Entropy-Based Level Set Algorithm for MR Breast Image Segmentation Using Lattice Boltzmann Model , 2012, IScIDE.

[20]  S. Philipp-Foliguet,et al.  Évaluation de la segmentation d'images : état de l'art, nouveaux indices et comparaison Evaluation of image segmentation : state of the art, new criteria and comparison , 2006 .

[21]  L. Evans Measure theory and fine properties of functions , 1992 .

[22]  Lei Zhang,et al.  Active contours with selective local or global segmentation: A new formulation and level set method , 2010, Image Vis. Comput..

[23]  Rémi Ronfard,et al.  Region-based strategies for active contour models , 1994, International Journal of Computer Vision.

[24]  Bin Wang,et al.  Level Set Region Based Image Segmentation Using Lattice Boltzmann Method , 2011, 2011 Seventh International Conference on Computational Intelligence and Security.

[25]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[26]  Zhuangzhi Yan,et al.  Cellular Automata based Level Set Method for Image Segmentation , 2007, 2007 IEEE/ICME International Conference on Complex Medical Engineering.

[27]  Petros Maragos,et al.  Multigrid Geometric Active Contour Models , 2007, IEEE Transactions on Image Processing.

[28]  Baba C. Vemuri,et al.  Topology-independent shape modeling scheme , 1993, Optics & Photonics.

[29]  Ye Zhao,et al.  Parallel 3D Image Segmentation of Large Data Sets on a GPU Cluster , 2009, ISVC.

[30]  J. B. Rosen The gradient projection method for nonlinear programming: Part II , 1961 .

[31]  T. G. Cowling,et al.  The mathematical theory of non-uniform gases : an account of the kinetic theory of viscosity, thermal conduction, and diffusion in gases , 1954 .

[32]  G. Aubert,et al.  Mathematical Problems in Image Processing: Partial Differential Equations and the Calculus of Variations (Applied Mathematical Sciences) , 2006 .

[33]  Paul M. Thompson,et al.  A Nonconservative Lagrangian Framework for Statistical Fluid Registration—SAFIRA , 2011, IEEE Transactions on Medical Imaging.

[34]  Margarida Silveira,et al.  Separation Between Water and Land in SAR Images Using Region-Based Level Sets , 2009, IEEE Geoscience and Remote Sensing Letters.

[35]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[36]  Allen R. Tannenbaum,et al.  Self-Crossing Detection and Location for Parametric Active Contours , 2012, IEEE Transactions on Image Processing.

[37]  L. Luo,et al.  Lattice Boltzmann Model for the Incompressible Navier–Stokes Equation , 1997 .

[38]  Hélène Laurent,et al.  Comparative Study of Contour Detection Evaluation Criteria Based on Dissimilarity Measures , 2008, EURASIP J. Image Video Process..

[39]  George Chen,et al.  Lattice Boltzmann Method of Active Contour for Image Segmentation , 2011, 2011 Sixth International Conference on Image and Graphics.

[40]  W. F. Chen,et al.  Hessian based image structure adaptive gradient vector flow for parametric active contours , 2010, 2010 IEEE International Conference on Image Processing.

[41]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[42]  Laurent D. Cohen,et al.  On active contour models and balloons , 1991, CVGIP Image Underst..

[43]  Tao Li,et al.  A robust parametric active contour based on fourier descriptors , 2011, 2011 18th IEEE International Conference on Image Processing.

[44]  Rachid Deriche,et al.  Geodesic active contours for supervised texture segmentation , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[45]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.