Automatic selection of regions of interest in a video by a depth-color image matting

The automatic detection of regions of interest in a video is fundamental for a fast generation of many ground truth images. In this paper we introduce a new solution for selecting regions of interest based on an automatic image matting method. Image matting is a set of techniques designed to obtain a precise separation of background and foreground in image or video sequences. Basically all the matting approaches need a direct human interaction, there are only few total automatic solutions. To achieve this goal we combine two different video streams: the color one and the depth one. In particular, we use an automatic depth based segmentation to substitute the human input in the Soft Scissors, one of the most precise matting algorithm. The overall efficiency is achieved using the Nvidia CUDA architecture to execute the most computational intensive sections of algorithm. The result of the matting can be used as a ground truth for successive elaborations.

[1]  Luca Lombardi,et al.  Fast Real-time Segmentation and Tracking of Multiple Subjects by Time-of-Flight Camera - A New Approach for Real-time Multimedia Applications with 3D Camera Sensor , 2011, VISAPP.

[2]  Frédo Durand,et al.  Defocus video matting , 2005, ACM Trans. Graph..

[3]  Maneesh Agrawala,et al.  Soft scissors: an interactive tool for realtime high quality matting , 2007, ACM Trans. Graph..

[4]  Michael F. Cohen,et al.  Optimized Color Sampling for Robust Matting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Dani Lischinski,et al.  Spectral Matting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Roberto Scopigno,et al.  Computer Graphics forum , 2003, Computer Graphics Forum.

[7]  Reinhard Koch,et al.  Time‐of‐Flight Cameras in Computer Graphics , 2010, Comput. Graph. Forum.

[8]  Jie Cheng,et al.  Programming Massively Parallel Processors. A Hands-on Approach , 2010, Scalable Comput. Pract. Exp..

[9]  Rüdiger Westermann,et al.  RANDOM WALKS FOR INTERACTIVE ALPHA-MATTING , 2005 .

[10]  Tom Duff,et al.  Compositing digital images , 1984, SIGGRAPH.

[11]  Michael F. Cohen,et al.  An iterative optimization approach for unified image segmentation and matting , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[12]  K. Hartmann,et al.  Data-Fusion of PMD-Based Distance-Information and High-Resolution RGB-Images , 2007, 2007 International Symposium on Signals, Circuits and Systems.

[13]  Ruigang Yang,et al.  Automatic Natural Video Matting with Depth , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[14]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Ralf Reulke,et al.  Combination of distance data with high resolution images , 2006 .

[16]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[17]  Luca Lombardi,et al.  Evaluation of a Foreground Segmentation Algorithm for 3D Camera Sensors , 2009, ICIAP.

[18]  Michael F. Cohen,et al.  Image and Video Matting: A Survey , 2007, Found. Trends Comput. Graph. Vis..

[19]  Jian Sun,et al.  Poisson matting , 2004, ACM Trans. Graph..