Impressionism, expressionism, surrealism: Automated recognition of painters and schools of art

We describe a method for automated recognition of painters and schools of art based on their signature styles and studied the computer-based perception of visual art. Paintings of nine artists, representing three different schools of art—impressionism, surrealism and abstract expressionism—were analyzed using a large set of image features and image transforms. The computed image descriptors were assessed using Fisher scores, and the most informative features were used for the classification and similarity measurements of paintings, painters, and schools of art. Experimental results show that the classification accuracy when classifying paintings into nine painter classes is 77%, and the accuracy of associating a given painting with its school of art is 91%. An interesting feature of the proposed method is its ability to automatically associate different artists that share the same school of art in an unsupervised fashion. The source code used for the image classification and image similarity described in this article is available for free download.

[1]  Yiannis Aloimonos,et al.  Active vision , 2004, International Journal of Computer Vision.

[2]  Jorge Herbert de Lira,et al.  Two-Dimensional Signal and Image Processing , 1989 .

[3]  Eric O. Postma,et al.  Discovering the Visual Signature of Painters , 2000 .

[4]  David A. Forsyth,et al.  Clustering art , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Lior Shamir,et al.  Computer Vision for Microscopy Applications , 2007 .

[6]  Ewert Bengtsson,et al.  A Feature Set for Cytometry on Digitized Microscopic Images , 2003, Analytical cellular pathology : the journal of the European Society for Analytical Cellular Pathology.

[7]  H. Petsche,et al.  Shadows of artistry: cortical synchrony during perception and imagery of visual art. , 2002, Brain research. Cognitive brain research.

[8]  M. Teague.  Image analysis via the general theory of moments , 1980 .

[9]  Lior Shamir,et al.  Human Perception-based Color Segmentation Using Fuzzy Logic , 2006, IPCV.

[10]  Nicolai Petkov,et al.  Comparison of texture features based on Gabor filters , 2002, IEEE Trans. Image Process..

[11]  C. Lollar.  Inner Vision , 1991, Science.

[12]  Richard P. Taylor,et al.  Fractal analysis of Pollock's drip paintings , 1999, Nature.

[13]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[14]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[15]  Daniel Keren,et al.  Painter identification using local features and naive Bayes , 2002, Object recognition supported by user interaction for service robots.

[16]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[17]  V. Ramachandran,et al.  The science of art: A neurological theory of aesthetic experience , 1999 .

[18]  Lior Shamir,et al.  WND-CHARM: Multi-purpose image classification using compound image transforms , 2008, Pattern Recognit. Lett..

[19]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[20]  Prashant Parikh.  A Theory of Communication , 2010 .

[21]  Nicolai Petkov,et al.  Comparison of texture features based on Gabor filters , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[22]  Stephen B. Gray,et al.  Local Properties of Binary Images in Two Dimensions , 1971, IEEE Transactions on Computers.

[23]  Richard Taylor,et al.  Authenticating Pollock paintings using fractal geometry , 2007, Pattern Recognit. Lett..

[24]  I. S. Gradshteyn,et al.  Table of Integrals, Series, and Products , 1976 .

[25]  Lior Shamir,et al.  Source Code for Biology and Medicine Open Access Wndchrm – an Open Source Utility for Biological Image Analysis , 2022 .

[26]  Jie Yao,et al.  Searching online journals for fluorescence microscope images depicting protein subcellular location patterns , 2001, Proceedings 2nd Annual IEEE International Symposium on Bioinformatics and Bioengineering (BIBE 2001).

[27]  Harsh Mathur,et al.  Fractal Analysis: Revisiting Pollock's drip paintings , 2006, Nature.

[28]  E. Y. Chang,et al.  Toward perception-based image retrieval , 2000, 2000 Proceedings Workshop on Content-based Access of Image and Video Libraries.

[29]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[30]  Robert Sablatnig,et al.  Identification of drawing tools by classification of textural and boundary features of strokes , 2007, Pattern Recognit. Lett..

[31]  Heinrich H. Bülthoff,et al.  Psychophysics for perception of (in)determinate art , 2007, APGV.

[32]  Thorsten Joachims,et al.  Training linear SVMs in linear time , 2006, KDD '06.

[33]  I. Gurevich,et al.  Comparative analysis and classification of features for image models , 2006, Pattern Recognition and Image Analysis.

[34]  Joan L. Russell A. Kirsch,et al.  The Anatomy of Painting Style: Description with Computer Rules , 2017 .

[35]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[36]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[37]  M. P. Cummings.  PHYLIP (Phylogeny Inference Package) , 2004 .

[38]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[39]  I. M. Pyshik,et al.  Table of integrals, series, and products , 1965 .

[40]  Shree K. Nayar,et al.  Spatial information in multiresolution histograms , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[41]  Wee Kheng Leow,et al.  Identifying painters from color profiles of skin patches in painting images , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[42]  James Ze Wang,et al.  Studying digital imagery of ancient paintings by mixtures of stochastic models , 2004, IEEE Transactions on Image Processing.

[43]  Dennis Gabor,et al.  Theory of communication , 1946 .

[44]  Azriel Rosenfeld,et al.  A Comparative Study of Texture Measures for Terrain Classification , 1975, IEEE Transactions on Systems, Man, and Cybernetics.