Efficient tree construction for multiscale image representation and processing

With the continuous growth of sensor performances, image analysis and processing algorithms have to cope with larger and larger data volumes. Besides, the informative components of an image might not be the pixels themselves, but rather the objects they belong to. This has led to a wide range of successful multiscale techniques in image analysis and computer vision. Hierarchical representations are thus of first importance, and require efficient algorithms to be computed in order to address real-life applications. Among these hierarchical models, we focus on morphological trees (e.g., min/max-tree, tree of shape, binary partition tree, α-tree) that come with interesting properties and already led to appropriate techniques for image processing and analysis, with a growing interest from the image processing community. More precisely, we build upon two recent algorithms for efficient α-tree computation and introduce several improvements to achieve higher performance. We also discuss the impact of the data structure underlying the tree representation, and provide for the sake of illustration several applications where efficient multiscale image representation leads to fast but accurate techniques, e.g., in remote sensing image analysis or video segmentation.

[1]  Aidong Zhang,et al.  Analyzing scenery images by monotonic tree , 2003, Multimedia Systems.

[2]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[3]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[4]  Roberto Marcondes Cesar Junior,et al.  Interactive image segmentation by matching attributed relational graphs , 2012, Pattern Recognit..

[5]  Scott Cohen,et al.  LIVEcut: Learning-based interactive video segmentation by evaluation of multiple propagated cues , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[6]  Shin'ichi Satoh,et al.  VabCut: A video extension of GrabCut for unsupervised video foreground object segmentation , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[7]  C. Schmid,et al.  Hamming Embedding and Weak Geometry Consistency for Large Scale Image Search - extended version , 2008 .

[8]  Pierre Gançarski,et al.  Interactive video segmentation based on quasi-flat zones , 2011, 2011 7th International Symposium on Image and Signal Processing and Analysis (ISPA).

[9]  Marie-Pierre Jolly,et al.  Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images , 2001, ICCV.

[10]  Maneesh Agrawala,et al.  Interactive video cutout , 2005, SIGGRAPH 2005.

[11]  Pierre Soille,et al.  Iterative area filtering of multichannel images , 2007, Image Vis. Comput..

[12]  Guillermo Sapiro,et al.  Video SnapCut: robust video object cutout using localized classifiers , 2009, ACM Trans. Graph..

[13]  Thierry Géraud,et al.  A Comparison of Many Max-tree Computation Algorithms , 2013, ISMM.

[14]  Jocelyn Chanussot,et al.  Processing Multidimensional SAR and Hyperspectral Images With Binary Partition Tree , 2013, Proceedings of the IEEE.

[15]  Pierre Soille,et al.  Pattern Spectra from Partition Pyramids and Hierarchies , 2011, ISMM.

[16]  Nicolas Passat,et al.  Interactive Segmentation Based on Component-trees , 2011, Image Process. Line.

[17]  Silvia Valero Valbuena Hyperspectral image representation and processing with binary partition trees , 2012 .

[18]  Nicolas Passat,et al.  Selection of Relevant Nodes from Component-Trees in Linear Time , 2011, DGCI.

[19]  Michael H. F. Wilkinson,et al.  Mask-Based Second-Generation Connectivity and Attribute Filters , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Michel Couprie,et al.  Building the Component Tree in Quasi-Linear Time , 2006, IEEE Transactions on Image Processing.

[21]  Soille Pierre,et al.  THE SWITCHBOARD PLATFORM FOR INTERACTIVE IMAGE INFORMATION MINING , 2012 .

[22]  Benjamin Perret,et al.  Playing with Kruskal: Algorithms for Morphological Trees in Edge-Weighted Graphs , 2013, ISMM.

[23]  Philippe Salembier,et al.  Binary partition tree as an efficient representation for image processing, segmentation, and information retrieval , 2000, IEEE Trans. Image Process..

[24]  Hui Gao,et al.  Concurrent Computation of Attribute Filters on Shared Memory Parallel Machines , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Pascal Monasse,et al.  Contrast invariant registration of images , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[26]  Laurent Najman,et al.  A Quasi-linear Algorithm to Compute the Tree of Shapes of nD Images , 2013, ISMM.

[27]  Benjamin Perret,et al.  Constructive Links between Some Morphological Hierarchies on Edge-Weighted Graphs , 2013, ISMM.

[28]  James M. Rehg,et al.  Motion Coherent Tracking with Multi-label MRF optimization , 2010, BMVC.

[29]  Jean Paul Frédéric Serra,et al.  Optima on Hierarchies of Partitions , 2013, ISMM.

[30]  Sébastien Lefèvre,et al.  Hyperspectral image classification from multiscale description with constrained connectivity and metric learning , 2014, 2014 6th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[31]  Sébastien Lefèvre,et al.  Fast Image and Video Segmentation Based on Alpha-tree Multiscale Representation , 2012, 2012 Eighth International Conference on Signal Image Technology and Internet Based Systems.

[32]  Sébastien Lefèvre,et al.  Hyperspectral image representation through alpha-trees , 2014 .

[33]  Lionel Gueguen,et al.  Interactive collection of training samples from the Max-Tree structure , 2011, 2011 18th IEEE International Conference on Image Processing.

[34]  Verónica Vilaplana,et al.  Binary Partition Trees for Object Detection , 2008, IEEE Transactions on Image Processing.

[35]  Chenliang Xu,et al.  Evaluation of super-voxel methods for early video processing , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Pierre Soille,et al.  Constrained connectivity for hierarchical image partitioning and simplification , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Robert E. Tarjan,et al.  Efficiency of a Good But Not Linear Set Union Algorithm , 1972, JACM.

[38]  David Nistér,et al.  Linear Time Maximally Stable Extremal Regions , 2008, ECCV.

[39]  Sébastien Lefèvre,et al.  Efficient Schemes for Computing α-tree Representations , 2013, ISMM.

[40]  Thierry Géraud,et al.  A Comparative Review of Component Tree Computation Algorithms , 2014, IEEE Transactions on Image Processing.

[41]  Yong Jae Lee,et al.  Key-segments for video object segmentation , 2011, 2011 International Conference on Computer Vision.

[42]  Bo Han,et al.  TouchCut: Fast image and video segmentation using single-touch interaction , 2014, Comput. Vis. Image Underst..

[43]  Jean Paul Frédéric Serra,et al.  The "False Colour" Problem , 2009, ISMM.

[44]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[45]  Ewa Kijak,et al.  Hierarchical Image Representation Simplification Driven by Region Complexity , 2013, ICIAP.

[46]  Pierre Soille,et al.  Constrained Connectivity and Transition Regions , 2009, ISMM.

[47]  Pascal Monasse,et al.  Fast computation of a contrast-invariant image representation , 2000, IEEE Trans. Image Process..

[48]  Mei Han,et al.  Efficient hierarchical graph-based video segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[49]  Philippe Salembier,et al.  Antiextensive connected operators for image and sequence processing , 1998, IEEE Trans. Image Process..

[50]  Michael Cramer,et al.  The DGPF-Test on Digital Airborne Camera Evaluation - Over- view and Test Design , 2010 .

[51]  Jean Serra Anamorphoses and function lattices , 1993, Optics & Photonics.

[52]  Mohamed Akil,et al.  Parallel Hardware Implementation of Connected Component Tree Computation , 2010, 2010 International Conference on Field Programmable Logic and Applications.