A Review on Graph Based Segmentation

Image segmentation plays a crucial role in effective understanding of digital images. Past few decades saw hundreds of research contributions in this field. However, the research on the existence of general purpose segmentation algorithm that suits for variety of applications is still very much active. Among the many approaches in performing image segmentation, graph based approach is gaining popularity primarily due to its ability in reflecting global image properties. This paper critically reviews existing important graph based segmentation methods. The review is done based on the classification of various segmentation algorithms within the framework of graph based approaches. The major four categorizations we have employed for the purpose of review are: graph cut based methods, interactive methods, minimum spanning tree based methods and pyramid based methods. This review not only reveals the pros in each method and category but also explores its limitations. In addition, the review highlights the need for creating a database for benchmarking intensity based algorithms, and the need for further research in graph based segmentation for automated real time applications.

[1]  Martial Hebert,et al.  Toward Objective Evaluation of Image Segmentation Algorithms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Patrick C. Chen,et al.  Image segmentation as an estimation problem , 1979, 1979 18th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[3]  Ugo Montanari,et al.  On the optimal detection of curves in noisy pictures , 1971, CACM.

[4]  Ning Situ,et al.  A narrow band graph partitioning method for skin lesion segmentation , 2009, Pattern Recognit..

[5]  Alexandre X. Falcão,et al.  Links Between Image Segmentation Based on Optimum-Path Forest and Minimum Cut in Graph , 2009, Journal of Mathematical Imaging and Vision.

[6]  Pascal Bertolino,et al.  Similarity-based and perception-based image segmentation , 2005, IEEE International Conference on Image Processing 2005.

[7]  Guillermo Sapiro,et al.  Interactive Image Segmentation via Adaptive Weighted Distances , 2007, IEEE Transactions on Image Processing.

[8]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[9]  Alberto Sanfeliu,et al.  Graph-based representations and techniques for image processing and image analysis , 2002, Pattern Recognit..

[10]  H. Yan,et al.  Skin Segmentation Based on Graph Cuts , 2009 .

[11]  D. Greig,et al.  Exact Maximum A Posteriori Estimation for Binary Images , 1989 .

[12]  Ming Zhang,et al.  Improving the Graph-Based Image Segmentation Method , 2006, 2006 18th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'06).

[13]  Andrew Blake,et al.  Image Segmentation by Branch-and-Mincut , 2008, ECCV.

[14]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[15]  Francisco Sandoval Hernández,et al.  Pyramid segmentation algorithms revisited , 2006, Pattern Recognit..

[16]  Olga Veksler,et al.  Star Shape Prior for Graph-Cut Image Segmentation , 2008, ECCV.

[17]  Anders P. Eriksson,et al.  Normalized Cuts Revisited: A Reformulation for Segmentation with Linear Grouping Constraints , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[18]  Azriel Rosenfeld,et al.  Hierarchical Image Analysis Using Irregular Tessellations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Hui Zhang,et al.  Image segmentation evaluation: A survey of unsupervised methods , 2008, Comput. Vis. Image Underst..

[20]  Jeffrey Mark Siskind,et al.  Image Segmentation with Minimum Mean Cut , 2001, ICCV.

[21]  Alexandre X. Falcão,et al.  Data clustering as an optimum‐path forest problem with applications in image analysis , 2009, Int. J. Imaging Syst. Technol..

[22]  Tao Zhang,et al.  Interactive graph cut based segmentation with shape priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[23]  Yogesh Rathi,et al.  A Graph Cut Approach to Image Segmentation in Tensor Space , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Hong Yan,et al.  Clothing segmentation using foreground and background estimation based on the constrained Delaunay triangulation , 2008, Pattern Recognit..

[25]  Ron Kikinis,et al.  Improved watershed transform for medical image segmentation using prior information , 2004, IEEE Transactions on Medical Imaging.

[26]  Ingemar J. Cox,et al.  "Ratio regions": a technique for image segmentation , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[27]  Pushmeet Kohli,et al.  Dynamic Graph Cuts for Efficient Inference in Markov Random Fields , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Vikas Singh,et al.  An experimental evaluation of diffusion tensor image segmentation using graph-cuts , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[29]  Luc Brun,et al.  Image Segmentation with Topological Maps and Inter-pixel Representation , 1998, J. Vis. Commun. Image Represent..

[30]  Yoonsuck Choe,et al.  Cell tracking and segmentation in electron microscopy images using graph cuts , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[31]  Olga Veksler,et al.  Semiautomatic segmentation with compact shape prior , 2009, Image Vis. Comput..

[32]  Ramin Zabih,et al.  Graph Cuts Segmentation with Statistical Shape Priors for Medical Images , 2007, 2007 Third International IEEE Conference on Signal-Image Technologies and Internet-Based System.

[33]  Richard M. Leahy,et al.  An Optimal Graph Theoretic Approach to Data Clustering: Theory and Its Application to Image Segmentation , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Alberto Martelli,et al.  An application of heuristic search methods to edge and contour detection , 1976, CACM.

[35]  Azriel Rosenfeld,et al.  A critical view of pyramid segmentation algorithms , 1990, Pattern Recognit. Lett..

[36]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[37]  Daniel Cremers,et al.  Efficient planar graph cuts with applications in Computer Vision , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Azriel Rosenfeld,et al.  Segmentation and Estimation of Image Region Properties through Cooperative Hierarchial Computation , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[39]  Roberto de Alencar Lotufo,et al.  Watershed by image foresting transform, tie-zone, and theoretical relationships with other watershed definitions , 2007, ISMM.

[40]  Björn Jensen,et al.  Unsupervised image segmentation using the modified pyramidal linking approach , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[41]  Mo Chen,et al.  Progressive Cut: An Image Cutout Algorithm that Models User Intentions , 2007, IEEE MultiMedia.

[42]  Tim Morris,et al.  A Faster Graph-Based Segmentation Algorithm with Statistical Region Merge , 2006, ISVC.

[43]  李丽,et al.  《Tsinghua Science and Technology》网上国际审稿 , 2002 .

[44]  Tian Zheng,et al.  Optimum cut-based clustering , 2007, Signal Process..

[45]  Yuri Boykov,et al.  A Scalable graph-cut algorithm for N-D grids , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[46]  J. T. Mahajan,et al.  A Review on Graph Based Segmentation , 2013 .

[47]  Camille Couprie,et al.  Power watersheds: A new image segmentation framework extending graph cuts, random walker and optimal spanning forest , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[48]  Ning Xu,et al.  Object segmentation using graph cuts based active contours , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[49]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Chris H. Q. Ding,et al.  A min-max cut algorithm for graph partitioning and data clustering , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[51]  William A. Barrett,et al.  Interactive Segmentation with Intelligent Scissors , 1998, Graph. Model. Image Process..

[52]  Jayaram K. Udupa,et al.  Comparison of fuzzy connectedness and graph cut segmentation algorithms , 2011, Medical Imaging.

[53]  Jayaram K. Udupa,et al.  An ultra-fast user-steered image segmentation paradigm: live wire on the fly , 2000, IEEE Transactions on Medical Imaging.

[54]  Jayaram K. Udupa,et al.  Cloud bank: A multiple clouds model and its use in MR brain image segmentation , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[55]  Jayaram K. Udupa,et al.  User-Steered Image Segmentation Paradigms: Live Wire and Live Lane , 1998, Graph. Model. Image Process..

[56]  Jayaram K. Udupa,et al.  Synergistic arc-weight estimation for interactive image segmentation using graphs , 2010, Comput. Vis. Image Underst..

[57]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[58]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[59]  SarkarSudeep,et al.  Supervised Learning of Large Perceptual Organization , 2000 .

[60]  Daniel P. Huttenlocher,et al.  Image segmentation using local variation , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[61]  Roberto Marcondes Cesar Junior,et al.  A New Algorithm for Interactive Structural Image Segmentation , 2008, ArXiv.

[62]  Francisco Sandoval Hernández,et al.  Bounded irregular pyramid: a new structure for color image segmentation , 2004, Pattern Recognit..

[63]  Ghassan Hamarneh,et al.  DT-MRI segmentation using graph cuts , 2007, SPIE Medical Imaging.

[64]  Serge Miguet,et al.  A Segmentation Algorithm for Noisy Images , 2005, CAIP.

[65]  Olga Veksler,et al.  Semiautomatic Segmentation with Compact Shapre Prior , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[66]  Abderrahim Elmoataz,et al.  Graph-based tools for microscopic cellular image segmentation , 2009, Pattern Recognit..

[67]  Luc Brun,et al.  Construction of Combinatorial Pyramids , 2003, GbRPR.

[68]  Jorge Stolfi,et al.  The image foresting transform: theory, algorithms, and applications , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[69]  Olivier Juan,et al.  Capacity Scaling for Graph Cuts in Vision , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[70]  Y. J. Zhang,et al.  A survey on evaluation methods for image segmentation , 1996, Pattern Recognit..

[71]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[72]  Milan Sonka,et al.  Robust simultaneous detection of coronary borders in complex images , 1995, IEEE Trans. Medical Imaging.

[73]  Xiaobo Zhou,et al.  Automated Segmentation of Drosophila RNAi Fluorescence Cellular Images Using Graph Cuts , 2007, MMM.

[74]  Jayaram K. Udupa,et al.  Iterative relative fuzzy connectedness for multiple objects with multiple seeds , 2007, Comput. Vis. Image Underst..

[75]  Guillermo Sapiro,et al.  Distancecut: Interactive Segmentation and Matting of Images and Videos , 2007, 2007 IEEE International Conference on Image Processing.

[76]  Leo Grady,et al.  A multilevel banded graph cuts method for fast image segmentation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[77]  Jeffrey Mark Siskind,et al.  Image Segmentation with Ratio Cut , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[78]  Vladimir Kolmogorov,et al.  Graph cut based image segmentation with connectivity priors , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[79]  Gareth Funka-Lea,et al.  Automatic heart isolation for CT coronary visualization using graph-cuts , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[80]  Jean-Michel Jolion,et al.  The adaptive pyramid: A framework for 2D image analysis , 1991, CVGIP Image Underst..

[81]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[82]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[83]  Yin Ping,et al.  A new image segmentation approach based on linked pyramid , 1996, Proceedings of Third International Conference on Signal Processing (ICSP'96).

[84]  C. K. Ogden A Source Book Of Gestalt Psychology , 2013 .

[85]  Jayaram K. Udupa,et al.  Oriented Active Shape Models , 2009, IEEE Transactions on Medical Imaging.

[86]  V. K. Govindan,et al.  Computer-Aided Identification of the Pectoral Muscle in Digitized Mammograms , 2010, Journal of Digital Imaging.

[87]  Andrew V. Goldberg,et al.  A new approach to the maximum flow problem , 1986, STOC '86.

[88]  Ketan Mayer-Patel,et al.  Proceedings of the 14th annual ACM international conference on Multimedia , 2006, MM 2006.

[89]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[90]  Ronen Basri,et al.  Hierarchy and adaptivity in segmenting visual scenes , 2006, Nature.

[91]  Arthur W. Toga,et al.  Detection and Segmentation of Pathological Structures by the Extended Graph-Shifts Algorithm , 2007, MICCAI.

[92]  Dimitris Samaras,et al.  Topology cuts: A novel min-cut/max-flow algorithm for topology preserving segmentation in N-D images , 2008, Comput. Vis. Image Underst..

[93]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[94]  Yuanyuan Wang,et al.  An improved graph cut segmentation method for cervical lymph nodes on sonograms and its relationship with node's shape assessment , 2009, Comput. Medical Imaging Graph..

[95]  E. A. Dinic Algorithm for solution of a problem of maximal flow in a network with power estimation , 1970 .

[96]  Javier Montero,et al.  A graph coloring approach for image segmentation , 2007 .

[97]  Gilles Bertrand,et al.  Watershed Cuts: Minimum Spanning Forests and the Drop of Water Principle , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[98]  Jayaram K. Udupa,et al.  Relative Fuzzy Connectedness and Object Definition: Theory, Algorithms, and Applications in Image Segmentation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[99]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[100]  Andrew Zisserman,et al.  OBJ CUT , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[101]  Jayaram K. Udupa,et al.  Relative Fuzzy Connectedness among Multiple Objects: Theory, Algorithms, and Applications in Image Segmentation , 2001, Comput. Vis. Image Underst..

[102]  Bojan Mohar,et al.  Isoperimetric numbers of graphs , 1989, J. Comb. Theory, Ser. B.

[103]  Yan Zhang,et al.  Interactive Image Segmentation Based on Hierarchical Graph-Cut Optimization with Generic Shape Prior , 2009, ICIAR.

[104]  Alberto Martelli,et al.  Edge detection using heuristic search methods , 1972, Comput. Graph. Image Process..

[105]  Charles T. Zahn,et al.  Graph-Theoretical Methods for Detecting and Describing Gestalt Clusters , 1971, IEEE Transactions on Computers.

[106]  Dorit S. Hochbaum Polynomial Time Algorithms for Ratio Regions and a Variant of Normalized Cut , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[107]  Vladimir Kolmogorov,et al.  Computing geodesics and minimal surfaces via graph cuts , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[108]  Davi Geiger,et al.  Segmentation by grouping junctions , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[109]  Ying Xu,et al.  2D image segmentation using minimum spanning trees , 1997, Image Vis. Comput..

[110]  Mo Chen,et al.  Progressive cut , 2006, MM '06.

[111]  Ian H. Jermyn,et al.  Globally Optimal Regions and Boundaries as Minimum Ratio Weight Cycles , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[112]  Gregory G. Slabaugh,et al.  Graph cuts segmentation using an elliptical shape prior , 2005, IEEE International Conference on Image Processing 2005.

[113]  Dale Schuurmans,et al.  Fast normalized cut with linear constraints , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[114]  Jianbo Shi,et al.  Segmentation given partial grouping constraints , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[115]  Leo Grady,et al.  Isoperimetric graph partitioning for image segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.