Fast environment matting extraction using compressive sensing

The existing high-accuracy environment matting extraction methods usually require the capturing of thousands of sample images and spend several hours in data acquisition. In this paper, a fast environment matting algorithm is proposed to extract the environment matte data effectively and efficiently. In particular, we incorporate the recently developed compressive sensing theory to simplify the data acquisition process. Moreover, taking into account special properties of light refraction and reflection effects of transparent object, we further propose to use hierarchical sampling and group clustering based recovery to accelerate the matte extraction process. Compared with the state-of-the-art approaches, our proposed algorithm significantly accelerates the environment matting extraction process while still achieving high-accuracy results.

[1]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[2]  Hans-Peter Seidel,et al.  Adaptive sampling of reflectance fields , 2007, TOGS.

[3]  David Salesin,et al.  Environment matting and compositing , 1999, SIGGRAPH.

[4]  Yang Yu,et al.  Automatic image annotation using group sparsity , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Pieter Peers,et al.  Compressive light transport sensing , 2009, ACM Trans. Graph..

[6]  Andrew W. Fitzgibbon,et al.  Image-based environment matting , 2002, SIGGRAPH '02.

[7]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[8]  Wojciech Matusik,et al.  Acquisition and Rendering of Transparent and Refractive Objects , 2002, Rendering Techniques.

[9]  Pieter Peers,et al.  Wavelet Environment matting , 2003, Rendering Techniques.

[10]  Pieter Peers,et al.  Inferring reflectance functions from wavelet noise , 2005, EGSR '05.

[11]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[12]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[13]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[14]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[15]  David Salesin,et al.  Environment matting extensions: towards higher accuracy and real-time capture , 2000, SIGGRAPH.

[16]  Yee-Hong Yang,et al.  Frequency-based environment matting , 2004, 12th Pacific Conference on Computer Graphics and Applications, 2004. PG 2004. Proceedings..

[17]  Junzhou Huang,et al.  Learning with dynamic group sparsity , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[18]  Soheil Darabi,et al.  Compressive Dual Photography , 2009, Comput. Graph. Forum.

[19]  Wojciech Matusik,et al.  Progressively-Refined Reflectance Functions from Natural Illumination , 2004 .

[20]  Pieter Peers,et al.  Relighting with 4D incident light fields , 2003, ACM Trans. Graph..