Automatic Classification Of Digital Photographs Based On Decision Forests

Annotating photographs with broad semantic labels can be useful in both image processing and content-based image retrieval. We show here how low-level features can be related to semantic photo categories, such as indoor, outdoor and close-up, using decision forests consisting of trees constructed according to CART methodology. We also show how the results can be improved by introducing a rejection option in the classification process. Experimental results on a test set of 4,500 photographs are reported and discussed.

[1]  Robert King,et al.  Textural features corresponding to textural properties , 1989, IEEE Trans. Syst. Man Cybern..

[2]  Anil K. Jain,et al.  Image classification for content-based indexing , 2001, IEEE Trans. Image Process..

[3]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Rainer Lienhart,et al.  Classifying images on the web automatically , 2002, J. Electronic Imaging.

[5]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Arnold W. M. Smeulders,et al.  PicToSeek: combining color and shape invariant features for image retrieval , 2000, IEEE Trans. Image Process..

[7]  Raimondo Schettini,et al.  A method for the automatic indexing of colour images for effective image retrieval , 1997, New Rev. Hypermedia Multim..

[8]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[9]  Sethuraman Panchanathan,et al.  Storage and Retrieval of Compressed Images Using Wavelet Vector Quantization , 1997, J. Vis. Lang. Comput..

[10]  Theofanis Sapatinas,et al.  Discriminant Analysis and Statistical Pattern Recognition , 2005 .

[11]  Paolo Gallina,et al.  Innovative algorithm for cast detection , 2001, IS&T/SPIE Electronic Imaging.

[12]  G. McLachlan.  Discriminant Analysis and Statistical Pattern Recognition , 1992 .

[13]  Anil K. Jain,et al.  On image classification: city images vs. landscapes , 1998, Pattern Recognit..

[14]  Y. Miyake,et al.  Facial pattern detection and color correction from television picture for newspaper printing , 1990 .

[15]  Shih-Fu Chang,et al.  Digital image/video library and MPEG-7: standardization and research issues , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[16]  P. Bühlmann,et al.  Analyzing Bagging , 2001 .

[17]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Markus A. Stricker,et al.  Similarity of color images , 1995, Electronic Imaging.

[19]  Martin Szummer,et al.  Indoor-outdoor image classification , 1998, Proceedings 1998 IEEE International Workshop on Content-Based Access of Image and Video Database.

[20]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Markus A. Stricker,et al.  Spectral covariance and fuzzy regions for image indexing , 1997, Machine Vision and Applications.

[22]  C. Frankel,et al.  Distinguishing photographs and graphics on the World Wide Web , 1997, 1997 Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries.

[23]  Raimondo Schettini,et al.  A hierarchical classification strategy for digital documents , 2002, Pattern Recognit..

[24]  Elaine C. Yiu.  Image classification using color cues and texture orientation , 1996 .

[25]  Markus A. Stricker,et al.  Color indexing with weak spatial constraints , 1996, Electronic Imaging.

[26]  Thomas G. Dietterich.  Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[27]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[28]  Raimondo Schettini,et al.  Content-based Classification of Digital Documents , 2001, PRIS.

[29]  Geoffrey J. McLachlan,et al.  Discriminant Analysis and Statistical Pattern Recognition: McLachlan/Discriminant Analysis & Pattern Recog , 2005 .

[30]  Horst Bunke,et al.  Automatic Identification of Diatoms Using Decision Forests , 2001, MLDM.

[31]  Raimondo Schettini,et al.  A relevance feedback mechanism for content-based image retrieval , 1999, Inf. Process. Manag..

[32]  John P. Oakley,et al.  Storage and Retrieval for Image and Video Databases , 1993 .

[33]  Anil K. Jain,et al.  Reject option for VQ-based Bayesian classification , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[34]  Mark R. Wade,et al.  Construction and Assessment of Classification Rules , 1999, Technometrics.