Organizing Cultural Heritage with Deep Features

In recent years, the preservation and diffusion of culture in the digital form has been a priority for the governments in different countries, as in Mexico, with the objective of preserving and spreading culture through information technologies. Nowadays, a large amount of multimedia content is produced. Therefore, more efficient and accurate systems are required to organize it. In this work, we analyze the ability of a pre-trained residual network (ResNet) to describe information through the extracted deep features and we analyze its behavior by grouping new data into clusters by the K-means method at different levels of compression with the PCA algorithm showing that the structuring of new input data can be done with the proposed method.

[1]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Abraham Montoya Obeso,et al.  Image annotation for Mexican buildings database , 2016, Optical Engineering + Applications.

[3]  David Stutz,et al.  Neural Codes for Image Retrieval , 2015 .

[4]  Zheng Zhang,et al.  MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems , 2015, ArXiv.

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Ngai-Man Cheung,et al.  Selective Deep Convolutional Features for Image Retrieval , 2017, ACM Multimedia.

[7]  Valérie Gouet-Brunet,et al.  Image retrieval based on saliency for urban image contents , 2017, 2017 Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA).

[8]  Danna Zhou,et al.  d. , 1934, Microbial pathogenesis.

[9]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[10]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Jenny Benois-Pineau,et al.  Introduction of Explicit Visual Saliency in Training of Deep CNNs: Application to Architectural Styles Classification , 2018, 2018 International Conference on Content-Based Multimedia Indexing (CBMI).

[12]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[13]  Jenny Benois-Pineau,et al.  Comparative study of visual saliency maps in the problem of classification of architectural images with Deep CNNs , 2018, 2018 Eighth International Conference on Image Processing Theory, Tools and Applications (IPTA).

[14]  Julia Hirschberg,et al.  V-Measure: A Conditional Entropy-Based External Cluster Evaluation Measure , 2007, EMNLP.

[15]  P. Rousseeuw Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .