A Three-Stage Matting Method

Natural image matting is an important image processing task. How to leverage the advantages of both sampling matting and propagation matting is a challenge issue. In this paper, we propose a novel sampling-propagation matting method. First, in an overall framework, we propose a three-stage method for sampling-propagation matting, in which the sampling matting stage and propagation matting stage are bridged by a new stage (stage 2). Second, in the sampling matting stage (stage 1), a new gradient sampling matting is presented to cover more diversified samples, and a new equation is proposed to calculate the impact of sample-pair overlap. Third, in bridge stage (stage 2), we propose a judgment criterion to distinguish each pixel of matte after stage 1. For pixels that fail to meet the criterion, we propose an automatic labeling method. Fourth, in the propagation stage (stage 3), we discriminatingly process non-labeled pixels and labeled pixels with separate weight coefficients. The non-labeled pixels are smoothed by propagation, and the labeled pixels are solved by propagation matting. Finally, the proposed method is compared with other methods on public available benchmark. The results show that our method outperforms many other methods and achieves a good ranking.

[1]  Michael F. Cohen,et al.  Optimized Color Sampling for Robust Matting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2008 .

[3]  Gui-Lin Yao A Survey on Pre-Processing in Image Matting , 2017, Journal of Computer Science and Technology.

[4]  Yi Zhou,et al.  Parallel ant colony optimization on multi-core SIMD CPUs , 2018, Future Gener. Comput. Syst..

[5]  Yuan Cheng,et al.  A string-wise CRDT algorithm for smart and large-scale collaborative editing systems , 2017, Adv. Eng. Informatics.

[6]  Yusheng Liu,et al.  Automatic hierarchical mid-surface abstraction of thin-walled model based on rib decomposition , 2016, Adv. Eng. Softw..

[7]  Yi Zhou,et al.  Optimization of parallel iterated local search algorithms on graphics processing unit , 2016, The Journal of Supercomputing.

[8]  Xiao Chen,et al.  A parallel and robust object tracking approach synthesizing adaptive Bayesian learning and improved incremental subspace learning , 2019, Frontiers of Computer Science.

[9]  Guanglin Li,et al.  A Novel Technique for Robust and Fast Segmentation of Corneal Layer Interfaces Based on Spectral-Domain Optical Coherence Tomography Imaging , 2017, IEEE Access.

[10]  Yuanjie Zheng,et al.  Learning based digital matting , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[11]  Ying Wu,et al.  Nonlocal matting , 2011, CVPR 2011.

[12]  Fazhi He,et al.  Using shapes correlation for active contour segmentation of uterine fibroid ultrasound images in computer-aided therapy , 2016 .

[13]  Carsten Rother,et al.  Improving Color Modeling for Alpha Matting , 2008, BMVC.

[14]  Ping Wang,et al.  Three-layer graph framework with the sumD feature for alpha matting , 2017, Comput. Vis. Image Underst..

[15]  Qingsong Zhu,et al.  A Novel Image Matting Approach Based on Naive Bayes Classifier , 2012, ICIC.

[16]  Yiqi Wu,et al.  A local start search algorithm to compute exact Hausdorff Distance for arbitrary point sets , 2017, Pattern Recognit..

[17]  Pan Zhigeng,et al.  Dynamic Crowd Emotion Contagion Simulation with GPU Acceleration , 2016, 2016 International Conference on Cyberworlds (CW).

[18]  Fazhi He,et al.  A Novel Hardware/Software Partitioning Method Based on Position Disturbed Particle Swarm Optimization with Invasive Weed Optimization , 2017, Journal of Computer Science and Technology.

[19]  Deepu Rajan,et al.  Improving Image Matting Using Comprehensive Sampling Sets , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  John M. Hannah,et al.  Alpha channel estimation in high resolution images and image sequences , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[21]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[22]  Kang Li,et al.  Robust Visual Tracking Based on Convolutional Features with Illumination and Occlusion Handing , 2018, Journal of Computer Science and Technology.

[23]  Shaohui Liu,et al.  A Comprehensive Survey on Sampling‐Based Image Matting , 2017, Comput. Graph. Forum.

[24]  Ryota Arai,et al.  Seamline Determination Based on Semantic Segmentation for Aerial Image Mosaicking , 2015, IEEE Access.

[25]  Hui Chen,et al.  A novel image matting method using sparse manual clicks , 2015, Multimedia Tools and Applications.

[26]  Deepu Rajan,et al.  Sparse Coding for Alpha Matting , 2016, IEEE Transactions on Image Processing.

[27]  Soonhung Han,et al.  Collaborative CAD Synchronization Based on a Symmetric and Consistent Modeling Procedure , 2017, Symmetry.

[28]  Yusheng Liu,et al.  Pattern-based integration of system optimization in mechatronic system design , 2016, Adv. Eng. Softw..

[29]  Fazhi He,et al.  Service-Oriented Feature-Based Data Exchange for Cloud-Based Design and Manufacturing , 2018, IEEE Transactions on Services Computing.

[30]  Xiao Chen,et al.  Real-time object tracking via compressive feature selection , 2016, Frontiers of Computer Science.

[31]  Manuel Menezes de Oliveira Neto,et al.  Shared Sampling for Real‐Time Alpha Matting , 2010, Comput. Graph. Forum.

[32]  Xiao Pan,et al.  Parsing main structures of indoor scenes from single RGB-D image , 2016 .

[33]  Wang Hu,et al.  A Fast Image Matting Method Based on Interval-Line Sampling , 2017, 22017 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC).

[34]  Fazhi He,et al.  An Efficient Particle Swarm Optimization for Large-Scale Hardware/Software Co-Design System , 2017, Int. J. Cooperative Inf. Syst..

[35]  Alexander Wong,et al.  Deep Randomly-Connected Conditional Random Fields For Image Segmentation , 2017, IEEE Access.

[36]  Carlo Tomasi,et al.  Alpha estimation in natural images , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[37]  Aykut Erdem,et al.  Alpha Matting With KL-Divergence-Based Sparse Sampling , 2017, IEEE Transactions on Image Processing.

[38]  Fazhi He,et al.  Quantitative optimization of interoperability during feature-based data exchange , 2015, Integr. Comput. Aided Eng..

[39]  Soonhung Han,et al.  An efficient approach to directly compute the exact Hausdorff distance for 3D point sets , 2017, Integr. Comput. Aided Eng..

[40]  Marc Pollefeys,et al.  Designing Effective Inter-Pixel Information Flow for Natural Image Matting , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Ning Xu,et al.  Deep Image Matting , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Kun Zhou,et al.  Efficient GPU path rendering using scanline rasterization , 2016, ACM Trans. Graph..

[43]  Michael F. Cohen,et al.  An iterative optimization approach for unified image segmentation and matting , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[44]  In-So Kweon,et al.  Natural Image Matting Using Deep Convolutional Neural Networks , 2016, ECCV.

[45]  Chi-Keung Tang,et al.  KNN Matting , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[46]  Shesheng Gao,et al.  Image Segmentation-Based Multi-Focus Image Fusion Through Multi-Scale Convolutional Neural Network , 2017, IEEE Access.

[47]  Fazhi He,et al.  A correlative classifiers approach based on particle filter and sample set for tracking occluded target , 2017 .

[48]  Yi Zhou,et al.  Dynamic strategy based parallel ant colony optimization on GPUs for TSPs , 2017, Science China Information Sciences.

[49]  Deepu Rajan,et al.  Weighted color and texture sample selection for image matting , 2012, CVPR.

[50]  Jian Sun,et al.  A global sampling method for alpha matting , 2011, CVPR 2011.

[51]  Qingsong Zhu,et al.  Learning based alpha matting using support vector regression , 2012, ICIP.