Alpha matting with image pixel correlation

Alpha matting aims at estimating the foreground opacity matte in an image. It is critical to find the best known samples for foreground and background color of unknown pixels in color sampling-based matting approaches. Most matting approaches can only select color sample for each pixel each time, which prevent them from maintaining the same correlation in image pixels. In particular, they may fail to collect appropriate samples from complex images and thus lead to artifacts. In order to solve the problem, we present a correlation-based sampling method in which the image pixel correlation is employed in color sampling and optimal sample selection for the alpha matte estimation of the image. First, the foreground and background colors of sample set can completely cover the color of unknown pixels to avoid missing the true samples. This is accomplished by artificial immune network adaptively learning the image correlation in unknown pixels. Besides, we propose the sample selection process as a global optimization problem with image correlation. All unknown pixels are treated as a high-dimensional input variable, particle swarm optimization algorithms is employed to solve the global optimization problem selecting the best sample pairs for all unknown pixels. The experimental study on images dataset shows that image pixels correlation is effective to improve matting, and that our matting results are comparable to some recent approaches.

[1]  Jian Sun,et al.  A global sampling method for alpha matting , 2011, CVPR 2011.

[2]  Deepu Rajan,et al.  Weighted color and texture sample selection for image matting , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Chi-Keung Tang,et al.  KNN Matting , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Lei Wang,et al.  A Novel Nonlinear Regression Approach for Efficient and Accurate Image Matting , 2013, IEEE Signal Processing Letters.

[5]  Zhihui Lai,et al.  Manifold discriminant regression learning for image classification , 2015, Neurocomputing.

[6]  Jonathan Timmis,et al.  Artificial immune systems as a novel soft computing paradigm , 2003, Soft Comput..

[7]  Manuel Menezes de Oliveira Neto,et al.  Shared Sampling for Real‐Time Alpha Matting , 2010, Comput. Graph. Forum.

[8]  H. Abbass,et al.  aiNet : An Artificial Immune Network for Data Analysis , 2022 .

[9]  Qinping Zhao,et al.  Image Matting with Local and Nonlocal Smooth Priors , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[11]  Deepu Rajan,et al.  Improving Image Matting Using Comprehensive Sampling Sets , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Michael F. Cohen,et al.  Image and Video Matting: A Survey , 2007, Found. Trends Comput. Graph. Vis..

[13]  Xizhao Wang,et al.  Fuzziness based sample categorization for classifier performance improvement , 2015, J. Intell. Fuzzy Syst..

[14]  René Vidal,et al.  Estimation of Alpha Mattes for Multiple Image Layers , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  George Baciu,et al.  Lightness biased cartoon-and-texture decomposition for textile image segmentation , 2015, Neurocomputing.

[16]  Ling Shao,et al.  Targeting Accurate Object Extraction From an Image: A Comprehensive Study of Natural Image Matting , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Michael F. Cohen,et al.  Optimized Color Sampling for Robust Matting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Xizhao Wang,et al.  Learning from big data with uncertainty - editorial , 2015, J. Intell. Fuzzy Syst..

[21]  Tai Sing Lee,et al.  Statistical correlations between two-dimensional images and three-dimensional structures in natural scenes. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[22]  LinLin Shen,et al.  Joint representation and pattern learning for robust face recognition , 2015, Neurocomputing.

[23]  Pushmeet Kohli,et al.  A perceptually motivated online benchmark for image matting , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.