Transductive inference using multiple experts for brushwork annotation in paintings domain

Many recent studies perform annotation of paintings based on brushwork. In these studies the brushwork is modeled indirectly as part of the annotation of high-level artistic concepts such as the artist name using low-level texture. In this paper, we develop a serial multi-expert framework for explicit annotation of paintings with brushwork classes. In the proposed framework, each individual expert implements transductive inference by exploiting both labeled and unlabelled data. To minimize the problem of noise in the feature space, the experts select appropriate features based on their relevance to the brushwork classes. The selected features are utilized to generate several models to annotate the unlabelled patterns. The experts select the best performing model based on Vapnik combined bound. The transductive annotation using multiple experts out-performs the conventional baseline method in annotating patterns with brushwork classes.

[1]  Jerome H. Friedman,et al.  An Overview of Predictive Learning and Function Approximation , 1994 .

[2]  M. Yelizaveta,et al.  Analysis and Retrieval of Paintings Using Artistic Color Concepts , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[3]  Fuad Rahman,et al.  Serial Combination of Multiple Experts: A Unified Evaluation , 1999, Pattern Analysis & Applications.

[4]  Eric O. Postma,et al.  Discovering the Visual Signature of Painters , 2000 .

[5]  James Ze Wang,et al.  Studying digital imagery of ancient paintings by mixtures of stochastic models , 2004, IEEE Transactions on Image Processing.

[6]  Tat-Seng Chua,et al.  Content-based retrieval of segmented images , 1994, MULTIMEDIA '94.

[7]  Marchenko Yelizaveta,et al.  Semi-supervised annotation of brushwork in paintings domain using serial combinations of multiple experts , 2006, MM 2006.

[8]  C.-C. Jay Kuo,et al.  Texture Roughness Analysis and Synthesis via Extended Self-Similar (ESS) Model , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  V. Vapnik Estimation of Dependences Based on Empirical Data , 2006 .

[10]  Wolfgang Doster,et al.  A decision theoretic approach to hierarchical classifier design , 1984, Pattern Recognit..

[11]  Ramesh C. Jain,et al.  Representation and retrieval of paintings based on art history concepts , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[12]  M. Teague Image analysis via the general theory of moments , 1980 .

[13]  R. Michalski,et al.  Discovering attribute dependence in databases by integrating symbolic learning and statistical analysis techniques , 1993 .

[14]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..