Connected operators

Connected operators are filtering tools that act by merging elementary regions called flat zones. Connecting operators cannot create new contours nor modify their position. Therefore, they have very good contour-preservation properties and are capable of both low-level filtering and higher-level object recognition. This article gives an overview on connected operators and their application to image and video filtering. There are two popular techniques used to create connected operators. The first one relies on a reconstruction process. The operator involves first a simplification step based on a "classical" filter and then a reconstruction process. In fact, the reconstruction can be seen as a way to create a connected version of an arbitrary operator. The simplification effect is defined and limited by the first step. The examples we show include simplification in terms of size or contrast. The second strategy to define connected operators relies on a hierarchical region-based representation of the input image, i.e., a tree, computed in an initial step. Then, the simplification is obtained by pruning the tree, and, third, the output image is constructed from the pruned tree. This article presents the most important trees that have been used to create connected operators and also discusses important families of simplification or pruning criteria. We also give a brief overview on efficient implementations of the reconstruction process and of tree construction. Finally, the possibility to define and to use nonclassical notions of connectivity is discussed and illustrated.

[1]  Hui Gao,et al.  Concurrent Computation of Attribute Filters on Shared Memory Parallel Machines , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  José Crespo,et al.  Theoretical aspects of morphological filters by reconstruction , 1995, Signal Process..

[3]  David García,et al.  Extensive operators in partition lattices for image sequence analysis , 1998, Signal Process..

[4]  Guido Gerig,et al.  3D Multi-scale line filter for segmentation and visualization of curvilinear structures in medical images , 1997, CVRMed.

[5]  Michael H. F. Wilkinson,et al.  Attribute-space connectivity and connected filters , 2007, Image Vis. Comput..

[6]  Michael H. F. Wilkinson,et al.  A Comparison of Algorithms for Connected Set Openings and Closings , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Murat Kunt,et al.  Size-sensitive multiresolution decomposition of images with rank order based filters , 1992, Signal Process..

[8]  Fernand Meyer,et al.  The levelings , 1998 .

[9]  Yair Shoham,et al.  Efficient bit allocation for an arbitrary set of quantizers [speech coding] , 1988, IEEE Trans. Acoust. Speech Signal Process..

[10]  Anastasios N. Venetsanopoulos,et al.  An adaptive morphological filter for image processing , 1992, IEEE Trans. Image Process..

[11]  Petros Maragos,et al.  Differential morphology and image processing , 1996, IEEE Trans. Image Process..

[12]  Myungcheol Lee,et al.  Graph theory for image analysis: an approach based on the shortest spanning tree , 1986 .

[13]  Ulisses Braga-Neto,et al.  A Theoretical Tour of Connectivity in Image Processing and Analysis , 2003, Journal of Mathematical Imaging and Vision.

[14]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[15]  Philippe Salembier,et al.  Flat zones filtering, connected operators, and filters by reconstruction , 1995, IEEE Trans. Image Process..

[16]  Christian Ronse,et al.  Set-Theoretical Algebraic Approaches to Connectivity in Continuous or Digital Spaces , 2004, Journal of Mathematical Imaging and Vision.

[17]  Emmanuel Bertin,et al.  Effective Component Tree Computation with Application to Pattern Recognition in Astronomical Imaging , 2007, 2007 IEEE International Conference on Image Processing.

[18]  Victor Maojo,et al.  The Strong Property of Morphological Connected Alternated Filters , 2008, Journal of Mathematical Imaging and Vision.

[19]  Michael H. F. Wilkinson,et al.  Connected Shape-Size Pattern Spectra for Rotation and Scale-Invariant Classification of Gray-Scale Images , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Ulisses Braga-Neto,et al.  Connectivity on Complete Lattices: New Results , 2002, Comput. Vis. Image Underst..

[21]  Ming-Ting Sun,et al.  Extensive partition operators, gray-level connected operators, and region merging/classification segmentation algorithms: theoretical links , 2001, IEEE Trans. Image Process..

[22]  Petros Maragos,et al.  Leveling cartoons, texture energy markers, and image decomposition , 2007, ISMM.

[23]  Christian Ronse,et al.  Partial Partitions, Partial Connections and Connective Segmentation , 2008, Journal of Mathematical Imaging and Vision.

[24]  Ronald Jones,et al.  Connected Filtering and Segmentation Using Component Trees , 1999, Comput. Vis. Image Underst..

[25]  Philippe Salembier,et al.  Connected operators and pyramids , 1993, Optics & Photonics.

[26]  Arnold W. M. Smeulders,et al.  The Morphological Structure of Images: The Differential Equations of Morphological Scale-Space , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Verónica Vilaplana,et al.  Binary Partition Trees for Object Detection , 2008, IEEE Transactions on Image Processing.

[28]  Guido Gerig,et al.  Three-dimensional multi-scale line filter for segmentation and visualization of curvilinear structures in medical images , 1998, Medical Image Anal..

[29]  Jean Paul Frédéric Serra Connectivity on Complete Lattices , 2004, Journal of Mathematical Imaging and Vision.

[30]  Scott T. Acton,et al.  Inclusion filters: a class of self-dual connected operators , 2005, IEEE Transactions on Image Processing.

[31]  Ronald Jones,et al.  Attribute Openings, Thinnings, and Granulometries , 1996, Comput. Vis. Image Underst..

[32]  Michel Grimaud,et al.  New measure of contrast: the dynamics , 1992, Optics & Photonics.

[33]  Petros Maragos,et al.  Nonlinear Scale-Space Representation with Morphological Levelings , 2000, J. Vis. Commun. Image Represent..

[34]  Fernand Meyer,et al.  From connected operators to levelings , 1998 .

[35]  Luc Vincent,et al.  Morphological grayscale reconstruction in image analysis: applications and efficient algorithms , 1993, IEEE Trans. Image Process..

[36]  Philippe Salembier,et al.  Binary partition tree as an efficient representation for image processing, segmentation, and information retrieval , 2000, IEEE Trans. Image Process..

[37]  Michael H. F. Wilkinson,et al.  Mask-Based Second-Generation Connectivity and Attribute Filters , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Michel Couprie,et al.  Building the Component Tree in Quasi-Linear Time , 2006, IEEE Transactions on Image Processing.

[39]  Thierry Géraud Ruminations on Tarjan's Union-Find Algorithm and Connected Operators , 2005, ISMM.

[40]  Henk J. A. M. Heijmans Connected Morphological Operators for Binary Images , 1999, Comput. Vis. Image Underst..

[41]  Ferran Marqués,et al.  General region merging approaches based on information theory statistical measures , 2008, 2008 15th IEEE International Conference on Image Processing.

[42]  Pierre Soille,et al.  Constrained connectivity for hierarchical image partitioning and simplification , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Robert E. Tarjan,et al.  Efficiency of a Good But Not Linear Set Union Algorithm , 1972, JACM.

[44]  José Crespo,et al.  The flat zone approach: A general low-level region merging segmentation method , 1997, Signal Process..

[45]  Philippe Salembier,et al.  Antiextensive connected operators for image and sequence processing , 1998, IEEE Trans. Image Process..

[46]  Michael H. F. Wilkinson,et al.  Shape Preserving Filament Enhancement Filtering , 2001, MICCAI.

[47]  Pascal Monasse,et al.  Fast computation of a contrast-invariant image representation , 2000, IEEE Trans. Image Process..

[48]  Georgios K. Ouzounis Generalized Connected Morphological Operators for Robust Shape Extraction , 2009 .

[49]  Michael H. F. Wilkinson,et al.  Vector-Attribute Filters , 2005, ISMM.

[50]  L. Vincent Graphs and mathematical morphology , 1989 .

[51]  Fernand Meyer,et al.  Levelings in vector spaces , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[52]  Jean Paul Frédéric Serra,et al.  A Lattice Approach to Image Segmentation , 2005, Journal of Mathematical Imaging and Vision.

[53]  Michael H. F. Wilkinson,et al.  Volumetric Attribute Filtering and Interactive Visualization Using the Max-Tree Representation , 2007, IEEE Transactions on Image Processing.

[54]  José Crespo,et al.  Locality and Adjacency Stability Constraints for Morphological Connected Operators , 2004, Journal of Mathematical Imaging and Vision.

[55]  Makoto Nagao,et al.  Region extraction and shape analysis in aerial photographs , 1979 .