Annotating Dance Posture Images Using Multi Kernel Feature Combination

We present a novel dance posture based annotation model by combining features using Multiple Kernel Learning (MKL). We have proposed a novel feature representation which represents the local texture properties of the image. The annotation model is defined in the direct a cyclic graph structure using the binary MKL algorithm. The bag-of-words model is applied for image representation. The experiments have been performed on the image collection belonging to two Indian classical dances (Bharatnatyam and Odissi). The annotation model has been tested using SIFT and the proposed feature individually and by optimally combining both the features. The experiments have shown promising results.

[1]  Yanfeng Sun,et al.  MiAlbum - a system for home photo managemet using the semi-automatic image annotation approach , 2000, MM 2000.

[2]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Farshad Fotouhi,et al.  Region based image annotation through multiple-instance learning , 2005, MULTIMEDIA '05.

[4]  Yong Wang,et al.  Refining image annotation using contextual relations between words , 2007, CIVR '07.

[5]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[6]  CARLO MEGHINI,et al.  A model of multimedia information retrieval , 2001, JACM.

[7]  Daniel Gatica-Perez,et al.  PLSA-based image auto-annotation: constraining the latent space , 2004, MULTIMEDIA '04.

[8]  Yong Wang,et al.  Combining global, regional and contextual features for automatic image annotation , 2009, Pattern Recognit..

[9]  David A. Forsyth,et al.  Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary , 2002, ECCV.

[10]  Vasant G Honavar,et al.  Annotating images and image objects using a hierarchical dirichlet process model , 2008, MDM '08.

[11]  Xiaojun Qi,et al.  Incorporating multiple SVMs for automatic image annotation , 2007, Pattern Recognit..

[12]  Jiayu Tang,et al.  Using multiple segmentations for image auto-annotation , 2007, CIVR '07.

[13]  Santanu Chaudhury,et al.  Multimedia ontology learning for automatic annotation and video browsing , 2008, MIR '08.

[14]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[15]  Nello Cristianini,et al.  Large Margin DAGs for Multiclass Classification , 1999, NIPS.

[16]  Andreas Nürnberger,et al.  Adaptive Multimedial Retrieval: Retrieval, User, and Semantics, 5th International Workshop, AMR 2007, Paris, France, July 5-6, 2007, Revised Selected Papers , 2008, Adaptive Multimedia Retrieval.

[17]  Yves Grandvalet,et al.  More efficiency in multiple kernel learning , 2007, ICML '07.

[18]  Jianping Fan,et al.  Hierarchical classification for automatic image annotation , 2007, SIGIR.

[19]  Nello Cristianini,et al.  Learning the Kernel Matrix with Semidefinite Programming , 2002, J. Mach. Learn. Res..

[20]  Sebastian Nowozin,et al.  Let the kernel figure it out; Principled learning of pre-processing for kernel classifiers , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Lei Zhang,et al.  Image annotation by incorporating word correlations into multi-class SVM , 2011, Soft Comput..

[22]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[23]  Tamás D. Gedeon,et al.  Learning based automatic face annotation for arbitrary poses and expressions from frontal images only , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.