Detection of highly articulated moving objects by using co-segmentation with application to athletic video sequences

In this paper, we adapt the co-segmentation for the fundamental problem of segmenting automatically and accurately highly articulated athletes in a large variety of poses without any initialization or prior knowledge. Our intention is to reduce the complexity of athlete segmentation by formulating it as a constrained 2D pair of frames’ co-segmentation, in order to extract the common foreground objects under unconstrained environments without any user input. In fact, the co-segmentation allows to integrate implicitly the temporal information for automatic moving object segmentation without any assumption or prior knowledge on camera motion. The proposed method was applied on various real-world video sequences of athletic sports meetings, and promising results are obtained. Experiments show that suggested method witnessed a significant improvement over background subtraction methods, which are commonly used for athlete segmentation.

[1]  Vikas Singh,et al.  An efficient algorithm for Co-segmentation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[2]  Yongdong Zhang,et al.  Combining Template Matching and Model Fitting for Human Body Segmentation and Tracking with Applications to Sports Training , 2006, ICIAR.

[3]  Stefano Messelodi,et al.  Scene text recognition and tracking to identify athletes in sport videos , 2011, Multimedia Tools and Applications.

[4]  Takumi Kobayashi,et al.  Automated Service Scene Detection for Badminton Game Analysis Using CHLAC and MRA , 2010 .

[5]  Joan Serrat,et al.  Video Co-segmentation , 2012, ACCV.

[6]  Ezzeddine Zagrouba,et al.  Color Images Co-segmentation Based on Fuzzy Local-Entropy Classification , 2012, MMSP 2012.

[7]  Chiou-Ting Hsu,et al.  Mosaics of video sequences with moving objects , 2004, Signal Process. Image Commun..

[8]  Wen Gao,et al.  Semantic object segmentation by a spatio-temporal MRF model , 2004, ICPR 2004.

[9]  Ezzeddine Zagrouba,et al.  An online approach for multi-sprite generation based on camera parameters estimation , 2013, Signal Image Video Process..

[10]  Chiou-Shann Fuh,et al.  Segmenting Highly Articulated Video Objects with Weak-Prior Random Forests , 2006, ECCV.

[11]  Enrique F. Torres Moreno,et al.  Real-time GPU color-based segmentation of football players , 2011, Journal of Real-Time Image Processing.

[12]  S. Messelodi,et al.  Tracking for context extraction in athletic events , 2010, SAPMIA '10.

[13]  Long-Wen Chang,et al.  Video object cosegmentation , 2012, ACM Multimedia.

[14]  Manish Khare,et al.  Moving object segmentation in Daubechies complex wavelet domain , 2015, Signal Image Video Process..

[15]  Yongdong Zhang,et al.  Automatic Detection and Recognition of Athlete Actions in Diving Video , 2007, MMM.

[16]  Tianxu Zhang,et al.  Local entropy-based transition region extraction and thresholding , 2003, Pattern Recognit. Lett..

[17]  M. Omair Ahmad,et al.  Title of the Paper : An efficient method of cast shadow removal using multiple features , 2013 .

[18]  Nasrollah Moghaddam Charkari,et al.  Robust moving shadow detection with hierarchical mixture of MLP experts , 2014, Signal Image Video Process..

[19]  Yongdong Zhang,et al.  Automatic Video-based Analysis of Athlete Action , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[20]  Alain Simac-Lejeune Moving Object Analysis in Video Sequences using Space-time Interest Points , 2012, VISAPP.

[21]  Yuan Dong,et al.  Supervised TV logo detection based on SVMS , 2010, 2010 2nd IEEE InternationalConference on Network Infrastructure and Digital Content.

[22]  Vladimir Kolmogorov,et al.  Cosegmentation Revisited: Models and Optimization , 2010, ECCV.

[23]  Hongsheng Li,et al.  A hierarchical image clustering cosegmentation framework , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Georgios Tziritas,et al.  Automatic human motion analysis and action recognition in athletics videos , 2006, 2006 14th European Signal Processing Conference.

[25]  Georgios Tziritas,et al.  Human Shape-Motion Analysis In Athletics Videos for Coarse To Fine Action/Activity Recognition Using Transferable Belief Model , 2009 .

[26]  Vladimir Kolmogorov,et al.  Object cosegmentation , 2011, CVPR 2011.

[27]  Xin Li,et al.  Simultaneous Video Stabilization and Moving Object Detection in Turbulence , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Georgios Tziritas,et al.  Automatic people detection and counting for athletic videos classification , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[29]  Ezzeddine Zagrouba,et al.  A robust framework for joint background/foreground segmentation of complex video scenes filmed with freely moving camera , 2009, Multimedia Tools and Applications.

[30]  Nikos Paragios,et al.  Unsupervised co-segmentation through region matching , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Jia Wang,et al.  A Diving Posture Recognition Method Based on Multiple Features Fusion , 2011 .

[32]  Mario Fritz,et al.  Multi-class Video Co-segmentation with a Generative Multi-video Model , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.