Automatic image annotation using fuzzy association rules and decision tree

The problem of sharp boundary widely exists in image classification algorithms that use traditional association rules. This problem makes classification more difficult and inaccurate. On the other hand, massive image data will produce a lot of redundant association rules, which greatly decrease the accuracy and efficiency of image classification. To relieve the influence of these two problems, this paper proposes a novel approach integrating fuzzy association rules and decision tree to accomplish the task of automatic image annotation. According to the original features with membership functions, the approach first obtains fuzzy feature vectors, which can describe the ambiguity and vagueness of images. Then fuzzy association rules are generated from fuzzy feature vectors with fuzzy support and fuzzy confidence. Fuzzy association rules can capture correlations between low-level visual features and high-level semantic concepts of images. Finally, to tackle the large size of fuzzy association rules base, we adopt decision tree to reduce the unnecessary rules. As a result, the algorithm complexity is decreased to a large extent. We conduct the experiments on two baseline datasets, i.e. Corel5k and IAPR-TC12. The evaluation measures include precision, recall, F-measure and rule number. The experimental results show that our approach performs better than many state-of-the-art automatic image annotation approaches.

[1]  Vladimir Pavlovic,et al.  Baselines for Image Annotation , 2010, International Journal of Computer Vision.

[2]  Dong Jie and Shen Guojie.  Remote Sensing Image Classification Based on Fuzzy Associative Classification , 2012 .

[3]  Vikram Pudi,et al.  A Fuzzy Associative Classification Approach to Visual Concept Detection , 2014, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[4]  R. Manmatha,et al.  Automatic image annotation and retrieval using cross-media relevance models , 2003, SIGIR.

[5]  Lu Jing.  Boosting-based Automatic Linguistic Indexing of Pictures , 2006 .

[6]  Md. Monirul Islam,et al.  A review on automatic image annotation techniques , 2012, Pattern Recognit..

[7]  Jing Zhang,et al.  Effective multi-modal multi-label learning for automatic image annotation , 2012, 2012 9th International Conference on Fuzzy Systems and Knowledge Discovery.

[8]  Pietro Perona,et al.  One-shot learning of object categories , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Daniel Gatica-Perez,et al.  Modeling Semantic Aspects for Cross-Media Image Indexing , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Alex A. Freitas,et al.  A survey of hierarchical classification across different application domains , 2010, Data Mining and Knowledge Discovery.

[11]  Amir-Masoud Eftekhari-Moghadam,et al.  A semantic image classifier based on hierarchical fuzzy association rule mining , 2012, Multimedia Tools and Applications.

[12]  Zhenjun Tang,et al.  Learning semantic concepts from image database with hybrid generative/discriminative approach , 2013, Eng. Appl. Artif. Intell..

[13]  H. Ishibuchi,et al.  Distributed representation of fuzzy rules and its application to pattern classification , 1992 .

[14]  Qi Tian,et al.  Image classification by non-negative sparse coding, low-rank and sparse decomposition , 2011, CVPR 2011.

[15]  R. Manmatha,et al.  Multiple Bernoulli relevance models for image and video annotation , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[16]  R. Manmatha,et al.  A Model for Learning the Semantics of Pictures , 2003, NIPS.

[17]  Yi-Chung Hu,et al.  Mining fuzzy association rules for classification problems , 2002 .

[18]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[19]  Qi Tian,et al.  Object categorization in sub-semantic space , 2014, Neurocomputing.

[20]  Ramin Zabih,et al.  Histogram refinement for content-based image retrieval , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[21]  Gustavo Carneiro,et al.  Supervised Learning of Semantic Classes for Image Annotation and Retrieval , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Shi-Kuo Chang,et al.  Image Information Systems: Where Do We Go From Here? , 1992, IEEE Trans. Knowl. Data Eng..

[23]  Man Hon Wong,et al.  Mining fuzzy association rules in databases , 1998, SGMD.

[24]  Svetlozar Nestorov,et al.  Comprehensive data warehouse exploration with qualified association-rule mining , 2006, Decis. Support Syst..

[25]  David A. Forsyth,et al.  Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary , 2002, ECCV.

[26]  Yong Wang,et al.  Combining global, regional and contextual features for automatic image annotation , 2009, Pattern Recognit..

[27]  Baoyong Zhao,et al.  New method about how to construct decision tree based on association rule , 2011, 2011 IEEE International Workshop on Open-source Software for Scientific Computation.

[28]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[29]  Eero Sormunen,et al.  End-User Searching Challenges Indexing Practices in the Digital Newspaper Photo Archive , 2004, Information Retrieval.

[30]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[31]  M. Hemalatha,et al.  An Innovative Hybrid Hierarchical Model for Automatic Image Annotation , 2012 .

[32]  Vikram Pudi,et al.  Fuzzy association rule mining algorithm for fast and efficient performance on very large datasets , 2009, 2009 IEEE International Conference on Fuzzy Systems.

[33]  P. Venkata Krishna,et al.  Global Trends in Information Systems and Software Applications , 2012, Communications in Computer and Information Science.