Robust background removal in 4D Studio images

In this paper we discuss background removal techniques developed for the 4D Reconstruction Studio at MTA SZTAKI. The 4D Studio enables creation of dynamic 3D models of real objects and actors. Robust foreground segmentation is a key element for 4D reconstruction, since the visual quality of the 3D model highly depends on the precision of the extracted silhouette. We present our novel solution for background removal based on exploiting the background colour in a robust manner. We also perform an analysis of shadow detection methods using different colour spaces, with the motivation of determining which colour representation is more suitable for shadow detection in a 4D Studio.

[1]  Brian C. Lovell,et al.  Shadow detection: A survey and comparative evaluation of recent methods , 2012, Pattern Recognit..

[2]  Jovan Popović,et al.  Dynamic shape capture using multi-view photometric stereo , 2009, SIGGRAPH 2009.

[3]  Csaba Benedek,et al.  Study on color space selection for detecting cast shadows in video surveillance , 2007, Int. J. Imaging Syst. Technol..

[4]  Dmitry Chetverikov,et al.  4D studio for future internet: Improving foreground-background segmentation , 2012, 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom).

[5]  Dmitrij Csetverikov,et al.  Enhanced Object Segmentation in a 4D Studio , 2013 .

[6]  Touradj Ebrahimi,et al.  Cast shadow segmentation using invariant color features , 2004, Comput. Vis. Image Underst..

[7]  Larry S. Davis,et al.  A Robust Background Subtraction and Shadow Detection , 1999 .

[8]  Zsolt Jankó,et al.  4D Reconstruction Studio: Creating dynamic 3D models of moving actors , 2012 .

[9]  Rita Cucchiara,et al.  Improving shadow suppression in moving object detection with HSV color information , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[10]  Dmitry Chetverikov,et al.  Real-Time 4D Reconstruction of Human Motion , 2012, AMDO.

[11]  Jérémie Allard,et al.  Multicamera Real-Time 3D Modeling for Telepresence and Remote Collaboration , 2010, Int. J. Digit. Multim. Broadcast..

[12]  Nicolas Martel-Brisson,et al.  Moving cast shadow detection from a Gaussian mixture shadow model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Touradj Ebrahimi,et al.  Detecting shadows in image sequences , 2004 .