Improving sampling-based image matting with cooperative coevolution differential evolution algorithm

Image matting is a fundamental operator in image editing and has significant influence on video production. This paper explores sampling-based image matting technology, with the aim to improve the accuracy of matting result. The result of sampling-based image matting technology is determined by the selected samples. Every undetermined pixel needs both a foreground and background pixel to estimate whether the undetermined one is in the foreground region of the image. These foreground pixels and background pixels are sampled from known regions, which form sample pairs. High-quality sample pairs can improve the accuracy of matting results. Therefore, how to search for the best sample pairs for all undetermined pixels is a key optimization problem of sampling-based image matting technology, termed “sample optimization problem.” In this paper, in order to improve the efficiency of searching for high-quality sample pairs, we propose a cooperative coevolution differential evolution (DE) algorithm in solution to this optimization problem. Strong-correlate pixels are divided into a group to cooperatively search for the best sample pairs. In order to avoid premature convergence of DE algorithm, a scattered strategy is used to keep the diversity of population. Besides, a simple but effective evaluation function is proposed to distinguish the quality of various candidate solutions. The existing optimization method, original DE algorithm and a popular evolution algorithm are used for comparison. The experimental results demonstrate that the proposed cooperative coevolution DE algorithm can search for higher-quality sample pairs and improve the accuracy of sampling-based image matting.

[1]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[3]  Yun Yang,et al.  Linear Feature Separation From Topographic Maps Using Energy Density and the Shear Transform , 2013, IEEE Transactions on Image Processing.

[4]  Yaochu Jin,et al.  A Competitive Swarm Optimizer for Large Scale Optimization , 2015, IEEE Transactions on Cybernetics.

[5]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[6]  Bin Gu,et al.  Incremental Support Vector Learning for Ordinal Regression , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Michael F. Cohen,et al.  An iterative optimization approach for unified image segmentation and matting , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[8]  Yuxiang Wang,et al.  Construction of Tree Network with Limited Delivery Latency in Homogeneous Wireless Sensor Networks , 2014, Wirel. Pers. Commun..

[9]  Peng Guo,et al.  Self-Adaptive Threshold Based on Differential Evolution for Image Segmentation , 2015, 2015 2nd International Conference on Information Science and Control Engineering.

[10]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[11]  Zhihua Xia,et al.  Steganalysis of least significant bit matching using multi-order differences , 2014, Secur. Commun. Networks.

[12]  Michael F. Cohen,et al.  Optimized Color Sampling for Robust Matting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[14]  X. Yao,et al.  Scaling up fast evolutionary programming with cooperative coevolution , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[15]  B. Majhi,et al.  Gray-level image enhancement using differential evolution optimization algorithm , 2014, 2014 International Conference on Signal Processing and Integrated Networks (SPIN).

[16]  Jue Wang,et al.  A perceptually motivated online benchmark for image matting , 2009, CVPR.

[17]  Heinz Mühlenbein,et al.  Parallel Genetic Algorithms, Population Genetics, and Combinatorial Optimization , 1989, Parallelism, Learning, Evolution.

[18]  Xiaodong Li,et al.  Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[19]  Jian Sun,et al.  A global sampling method for alpha matting , 2011, CVPR 2011.

[20]  Dorin Comaniciu,et al.  Robust analysis of feature spaces: color image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[22]  Raymond Fielding,et al.  The technique of special effects cinematography , 1965 .

[23]  Sam Kwong,et al.  Efficient Motion and Disparity Estimation Optimization for Low Complexity Multiview Video Coding , 2015, IEEE Transactions on Broadcasting.

[24]  Naixue Xiong,et al.  Steganalysis of LSB matching using differences between nonadjacent pixels , 2016, Multimedia Tools and Applications.

[25]  Yuhui Zheng,et al.  Image segmentation by generalized hierarchical fuzzy C-means algorithm , 2015, J. Intell. Fuzzy Syst..

[26]  Hui Li,et al.  Enhanced Differential Evolution With Adaptive Strategies for Numerical Optimization , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[27]  Mei Yang,et al.  A novel algorithm of image fusion using shearlets , 2011 .

[28]  Pengfei Xu,et al.  An edge detection algorithm based on the multi-direction shear transform , 2012, J. Vis. Commun. Image Represent..

[29]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[30]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[31]  Shih-Sian Cheng,et al.  A novel algorithm of remote sensing image fusion based on Shearlets and PCNN , 2013 .

[32]  Tom Duff,et al.  Compositing digital images , 1984, SIGGRAPH.

[33]  Adam Finkelstein,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, SIGGRAPH 2009.

[34]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[35]  Xiaodong Li,et al.  Smart use of computational resources based on contribution for cooperative co-evolutionary algorithms , 2011, GECCO '11.

[36]  Carsten Rother,et al.  Improving Color Modeling for Alpha Matting , 2008, BMVC.

[37]  Ying Wu,et al.  Nonlocal matting , 2011, CVPR 2011.

[38]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[39]  Yuanxiang Li,et al.  Image retrieval based on interactive differential evolution , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[40]  Manuel Menezes de Oliveira Neto,et al.  Shared Sampling for Real‐Time Alpha Matting , 2010, Comput. Graph. Forum.

[41]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.