A CNN-LSTM framework for authorship classification of paintings

The authenticity of digital painting image is an urgent demand in the field of art. Yet, determining the authorship of a certain painting is a challenging task due to two reasons: (1) various artists might share similar painting styles; and (2) an artist could create different styles. In this paper, we present a novel method for authorship classification of paintings based on a CNN-LSTM framework. First, a multiscale pyramid is constructed from a painting image. Second, a CNN-LSTM model is learned and it returns possibly multiple labels for one image. To aggregate the final classification result, an adaptive fusion method is employed. Experimental results show that the proposed method has superior classification performance compared with the state-of-the-art techniques.

[1]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[2]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[3]  Tsuhan Chen,et al.  Cross-layer features in convolutional neural networks for generic classification tasks , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[4]  Hanchao Qi,et al.  A new method for visual stylometry on impressionist paintings , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Jinchang Ren,et al.  Brushstroke based sparse hybrid convolutional neural networks for author classification of Chinese ink-wash paintings , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[6]  Navdeep Jaitly,et al.  Hybrid speech recognition with Deep Bidirectional LSTM , 2013, 2013 IEEE Workshop on Automatic Speech Recognition and Understanding.

[7]  Mei-Chen Yeh,et al.  Artist-based Classification via Deep Learning with Multi-scale Weighted Pooling , 2016, ACM Multimedia.

[8]  Hongxun Yao,et al.  Predicting discrete probability distribution of image emotions , 2015, 2015 IEEE International Conference on Image Processing (ICIP).