Learning based digital matting

We cast some new insights into solving the digital matting problem by treating it as a semi-supervised learning task in machine learning. A local learning based approach and a global learning based approach are then produced, to fit better the scribble based matting and the trimap based matting, respectively. Our approaches are easy to implement because only some simple matrix operations are needed. They are also extremely accurate because they can efficiently handle the nonlinear local color distributions by incorporating the kernel trick, that are beyond the ability of many previous works. Our approaches can outperform many recent matting methods, as shown by the theoretical analysis and comprehensive experiments. The new insights may also inspire several more works.

[1]  Richard F. Gunst,et al.  Applied Regression Analysis , 1999, Technometrics.

[2]  Bernhard Schölkopf,et al.  Transductive Classification via Local Learning Regularization , 2007, AISTATS.

[3]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[4]  Maneesh Agrawala,et al.  Soft scissors: an interactive tool for realtime high quality matting , 2007, ACM Trans. Graph..

[5]  Dani Lischinski,et al.  Spectral Matting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Michael F. Cohen,et al.  Optimized Color Sampling for Robust Matting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Bernhard Schölkopf,et al.  A Local Learning Approach for Clustering , 2006, NIPS.

[8]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[9]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[10]  Michael F. Cohen,et al.  An iterative optimization approach for unified image segmentation and matting , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[11]  Michael F. Cohen,et al.  Image and Video Matting: A Survey , 2007, Found. Trends Comput. Graph. Vis..

[12]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  Jian Sun,et al.  Poisson matting , 2004, ACM Trans. Graph..

[14]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[15]  Guillermo Sapiro,et al.  A Geodesic Framework for Fast Interactive Image and Video Segmentation and Matting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[16]  P. Holland Weighted Ridge Regression: Combining Ridge and Robust Regression Methods , 1973 .

[17]  René Vidal,et al.  Interactive image matting for multiple layers , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Xiaojin Zhu,et al.  Semi-Supervised Learning Literature Survey , 2005 .

[20]  Yuanjie Zheng,et al.  FuzzyMatte: A computationally efficient scheme for interactive matting , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Rüdiger Westermann,et al.  RANDOM WALKS FOR INTERACTIVE ALPHA-MATTING , 2005 .