A video semantic object extraction method based on motion feature and visual attention

In order to solve the semantic object extraction problem under complex background in video retrieval, a semantic object extraction method based on combination of motion features and visual attention is presented. First, moving object is extracted using motion features; then static object that has important semantic characteristic is extracted using visual attention; finally, a complete integration method is proposed to combine moving semantic object and static semantic object in the above. In this method, we take full advantages of motion feature of moving object and color and edge feature of static object. Experimental results show that this method has achieved remarkable results.

[1]  Zhi Li-ding Video Object Segmentation Based on MAP of Pixel Blocks , 2009 .

[2]  Pankoo Kim,et al.  Key Objects Based Profile for a Content-Based Video Information Retrieval and Streaming System Using Viewpoint Invariant Regions , 2008, 2008 International Conference on Computational Sciences and Its Applications.

[3]  Guangshe Chen,et al.  Design of Comprehensive Color Feature Vector for Tile Color Online Inspection , 2008, 2008 International Symposium on Information Science and Engineering.

[4]  Wenming Yang,et al.  Automatic extraction of moving objects in video sequences based on spatio-temporal information , 2005, 31st Annual Conference of IEEE Industrial Electronics Society, 2005. IECON 2005..

[5]  Wu Si,et al.  Automatic Segmentation of Moving Objects in Video Sequences Based on Dynamic Background Construction , 2005 .

[6]  Seong-Dae Kim,et al.  Spatio-temporal video segmentation using a joint similarity measure , 1997, IEEE Trans. Circuits Syst. Video Technol..

[7]  Bertram E. Shi,et al.  Recursive Anisotropic 2-D Gaussian Filtering Based on a Triple-Axis Decomposition , 2007, IEEE Transactions on Image Processing.

[8]  Zoltan Kato,et al.  Unsupervised segmentation of color textured images using a multilayer MRF model , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[9]  Jia Zhen A Video Object Segment Algorithm Based on Moving Edge Detection , 2003 .

[10]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[11]  Yo-Sung Ho,et al.  A VOP generation tool: automatic segmentation of moving objects in image sequences based on spatio-temporal information , 1999, IEEE Trans. Circuits Syst. Video Technol..