Image Analysis and Processing – ICIAP 2019: 20th International Conference, Trento, Italy, September 9–13, 2019, Proceedings, Part II

Superpixel computation can be seen as a process of grouping similar pixels trying to preserve image boundaries. In this work, we propose a label propagation method guided by hierarchy of partitions in the context of the marked (supervised) segmentation problem. The main idea of the proposed method is to propagate labels on a tree modelling a hierarchical representation of the image. We propose several criteria to decide, in the case of a conflict, which of the competing labels must be propagated into a neighbor region of the tree. According to our experiments, the proposed method outperforms the baseline provided by the

[1]  Olga Sorkine-Hornung,et al.  A comparative study of image retargeting , 2010, ACM Trans. Graph..

[2]  Jerry L. Prince,et al.  Generalized gradient vector flow external forces for active contours , 1998, Signal Process..

[3]  Pierre Buyssens,et al.  Eikonal based region growing for superpixels generation : Application to semi-supervised real time organ segmentation in CT images , 2014 .

[4]  Rita Cucchiara,et al.  Optimized Block-Based Connected Components Labeling With Decision Trees , 2010, IEEE Transactions on Image Processing.

[5]  Olga Sorkine-Hornung,et al.  Robust Image Retargeting via Axis‐Aligned Deformation , 2012, Comput. Graph. Forum.

[6]  Kenji Suzuki,et al.  Configuration-Transition-Based Connected-Component Labeling , 2014, IEEE Transactions on Image Processing.

[7]  Benjamin Perret,et al.  Playing with Kruskal: Algorithms for Morphological Trees in Edge-Weighted Graphs , 2013, ISMM.

[8]  Jean Cousty,et al.  Incremental Algorithm for Hierarchical Minimum Spanning Forests and Saliency of Watershed Cuts , 2011, ISMM.

[9]  Philippe Salembier,et al.  Binary partition tree as an efficient representation for image processing, segmentation, and information retrieval , 2000, IEEE Trans. Image Process..

[10]  Azriel Rosenfeld,et al.  Sequential Operations in Digital Picture Processing , 1966, JACM.

[11]  Jordi Pont-Tuset,et al.  Convolutional Oriented Boundaries: From Image Segmentation to High-Level Tasks , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Roberto Vezzani,et al.  YACCLAB - Yet Another Connected Components Labeling Benchmark , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[13]  Tae-Hyun Oh,et al.  Weakly- and Self-Supervised Learning for Content-Aware Deep Image Retargeting , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[14]  Victor M. Oliveira,et al.  A Study on Connected Components Labeling algorithms using GPUs , 2010 .

[15]  Benjamin Perret,et al.  Evaluation of Morphological Hierarchies for Supervised Segmentation , 2015, ISMM.

[16]  Benjamin Perret,et al.  Evaluation of Hierarchical Watersheds , 2018, IEEE Transactions on Image Processing.

[17]  Ariel Shamir,et al.  Seam Carving for Content-Aware Image Resizing , 2007, ACM Trans. Graph..

[18]  Benjamin Perret,et al.  Constructive Links between Some Morphological Hierarchies on Edge-Weighted Graphs , 2013, ISMM.

[19]  Serge Beucher,et al.  Watershed, Hierarchical Segmentation and Waterfall Algorithm , 1994, ISMM.

[20]  Kenneth A. Hawick,et al.  Parallel graph component labelling with GPUs and CUDA , 2010, Parallel Comput..

[21]  Feiniu Yuan,et al.  Optimized Multioperator Image Retargeting Based on Perceptual Similarity Measure , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[22]  Yukihiro Komura,et al.  GPU-based cluster-labeling algorithm without the use of conventional iteration: Application to the Swendsen-Wang multi-cluster spin flip algorithm , 2015, Comput. Phys. Commun..

[23]  Anil K. Jain,et al.  Handbook of Fingerprint Recognition , 2005, Springer Professional Computing.

[24]  Makoto Nagao,et al.  Region extraction and shape analysis in aerial photographs , 1979 .

[25]  Diego Gutierrez,et al.  Objective Quality Prediction of Image Retargeting Algorithms , 2017, IEEE Transactions on Visualization and Computer Graphics.

[26]  Ariel Shamir,et al.  Cropping Scaling Seam carving Warping Multi-operator , 2009 .

[27]  Kesheng Wu,et al.  Two Strategies to Speed up Connected Component Labeling Algorithms , 2005 .

[28]  Hervé Le Men,et al.  Scale-Sets Image Analysis , 2005, International Journal of Computer Vision.

[29]  Frédéric Bouchara,et al.  FAIR: A Fast Algorithm for Document Image Restoration , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Giovanni Maria Farinella,et al.  Saliency-Based Selection of Gradient Vector Flow Paths for Content Aware Image Resizing , 2014, IEEE Transactions on Image Processing.

[31]  Weisi Lin,et al.  Saliency Detection in the Compressed Domain for Adaptive Image Retargeting , 2012, IEEE Transactions on Image Processing.

[32]  Costantino Grana,et al.  Augmenting data with GANs to segment melanoma skin lesions , 2019, Multimedia Tools and Applications.

[33]  Jean Cousty,et al.  Hierarchical Segmentations with Graphs: Quasi-flat Zones, Minimum Spanning Trees, and Saliency Maps , 2018, Journal of Mathematical Imaging and Vision.

[34]  Yong-Jin Liu,et al.  Image Retargeting Quality Assessment , 2011, Comput. Graph. Forum.

[35]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[37]  Ronen Basri,et al.  Image Segmentation by Probabilistic Bottom-Up Aggregation and Cue Integration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Kenji Suzuki,et al.  A Linear-Time Two-Scan Labeling Algorithm , 2007, 2007 IEEE International Conference on Image Processing.

[39]  Jonathan T. Barron,et al.  Multiscale Combinatorial Grouping for Image Segmentation and Object Proposal Generation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Xuelong Li,et al.  Perceptually Aware Image Retargeting for Mobile Devices , 2018, IEEE Transactions on Image Processing.

[41]  David Cárdenas-Peña,et al.  Waterpixels , 2015, IEEE Transactions on Image Processing.

[42]  Junaed Sattar Snakes , Shapes and Gradient Vector Flow , 2022 .

[43]  Weisi Lin,et al.  Objective Quality Assessment for Image Retargeting Based on Perceptual Geometric Distortion and Information Loss , 2014, IEEE Journal of Selected Topics in Signal Processing.

[44]  Shlomo Argamon,et al.  Building a test collection for complex document information processing , 2006, SIGIR.

[45]  Bastian Leibe,et al.  Superpixels: An evaluation of the state-of-the-art , 2016, Comput. Vis. Image Underst..

[46]  Shoujun Zhou,et al.  Extension of the virtual electric field model using bilateral-like filter for active contours , 2019, Signal Image Video Process..

[47]  Daniel Peter Playne,et al.  A New Algorithm for Parallel Connected-Component Labelling on GPUs , 2018, IEEE Transactions on Parallel and Distributed Systems.

[48]  Antonio Torralba,et al.  SIFT Flow: Dense Correspondence across Scenes and Its Applications , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  C. Lawrence Zitnick,et al.  Fast Edge Detection Using Structured Forests , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Myung Jin Chung,et al.  External force of snake: virtual electric field , 2002 .

[51]  Shiping Zhu,et al.  A novel generalized gradient vector flow snake model using minimal surface and component-normalized method for medical image segmentation , 2016, Biomed. Signal Process. Control..

[52]  Costantino Grana,et al.  Improving Skin Lesion Segmentation with Generative Adversarial Networks , 2018, 2018 IEEE 31st International Symposium on Computer-Based Medical Systems (CBMS).

[53]  Luc Van Gool,et al.  AENet: Learning Deep Audio Features for Video Analysis , 2017, IEEE Transactions on Multimedia.

[54]  Ralf Schneider,et al.  Connected component labeling on a 2D grid using CUDA , 2011, J. Parallel Distributed Comput..

[55]  Mark J. Huiskes,et al.  The MIR flickr retrieval evaluation , 2008, MIR '08.

[56]  Laurent Najman,et al.  Geodesic Saliency of Watershed Contours and Hierarchical Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[57]  Wen Gao,et al.  Learning Affective Features With a Hybrid Deep Model for Audio–Visual Emotion Recognition , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[58]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.