Toward automated discovery of artistic influence

Considering the huge amount of art pieces that exist, there is valuable information to be discovered. Examining a painting, an expert can determine its style, genre, and the time period that the painting belongs. One important task for art historians is to find influences and connections between artists. Is influence a task that a computer can measure? The contribution of this paper is in exploring the problem of computer-automated suggestion of influences between artists, a problem that was not addressed before in a general setting. We first present a comparative study of different classification methodologies for the task of fine-art style classification. A two-level comparative study is performed for this classification problem. The first level reviews the performance of discriminative vs. generative models, while the second level touches the features aspect of the paintings and compares semantic-level features vs. low-level and intermediate-level features present in the painting. Then, we investigate the question “Who influenced this artist?” by looking at his masterpieces and comparing them to others. We pose this interesting question as a knowledge discovery problem. For this purpose, we investigated several painting-similarity and artist-similarity measures. As a result, we provide a visualization of artists (Map of Artists) based on the similarity between their works

[1]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[2]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Ravneet Singh Arora,et al.  Towards automated classification of fine-art painting style: A comparative study , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[4]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[5]  Andrew Zisserman,et al.  Efficient Visual Search of Videos Cast as Text Retrieval , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[7]  Lois Fichner-Rathus Foundations of Art and Design , 2007 .

[8]  Kilian Q. Weinberger,et al.  Learning a kernel matrix for nonlinear dimensionality reduction , 2004, ICML.

[9]  Gustavo Carneiro,et al.  Graph-based methods for the automatic annotation and retrieval of art prints , 2011, ICMR.

[10]  Michael I. Jordan,et al.  On Discriminative vs. Generative Classifiers: A comparison of logistic regression and naive Bayes , 2001, NIPS.

[11]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[12]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[13]  Alessio Del Bue,et al.  Artistic Image Classification: An Analysis on the PRINTART Database , 2012, ECCV.

[14]  Robert Sablatnig,et al.  Hierarchical classification of paintings using face- and brush stroke models , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[15]  Aly A. Farag,et al.  CSIFT: A SIFT Descriptor with Color Invariant Characteristics , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[16]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Anil K. Jain,et al.  A modified Hausdorff distance for object matching , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[18]  Lei Yao,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Rhythmic Brushstrokes Distinguish Van Gogh from His Contemporaries: Findings via Automated Brushstroke Extraction , 2022 .

[19]  Shannon M. Hughes,et al.  Detection of forgery in paintings using supervised learning , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[20]  Alexandre Bernardino,et al.  Time and order estimation of paintings based on visual features and expert priors , 2011, Electronic Imaging.

[21]  GeversTheo,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010 .

[22]  Alexei A. Efros,et al.  Discovering objects and their location in images , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[23]  Andrew W. Fitzgibbon,et al.  Efficient Object Category Recognition Using Classemes , 2010, ECCV.

[24]  Patrick J. F. Groenen,et al.  Modern Multidimensional Scaling: Theory and Applications , 2003 .

[25]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[26]  Robert Sablatnig,et al.  Structural analysis of paintings based on brush strokes , 1998, Electronic Imaging.

[27]  Andrea Fusiello,et al.  A Bag of Words Approach for 3D Object Categorization , 2009, MIRAGE.

[28]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[30]  Sung-Hyuk Cha,et al.  The classification of style in fine-art painting , 2005 .

[31]  Ye Duan,et al.  Robust Harris-Laplace Detector by Scale Multiplication , 2009, ISVC.

[32]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[33]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[34]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[35]  D. Field,et al.  Mapping the similarity space of paintings: Image statistics and visual perception , 2010 .

[36]  Alan Pipes Foundations of Art and Design , 2004 .

[37]  Wee Kheng Leow,et al.  Identifying painters from color profiles of skin patches in painting images , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[38]  Chong-Wah Ngo,et al.  Evaluating bag-of-visual-words representations in scene classification , 2007, MIR '07.