Applying Deep Learning Techniques to Cultural Heritage Images Within the INCEPTION Project

The digital documentation of cultural heritage (CH) often requires interpretation and classification of a huge amount of images. The INCEPTION European project focuses on the development of tools and methodologies for obtaining 3D models of cultural heritage assets, enriched by semantic information and integration of both parts on a new H-BIM (Heritage - Building Information Modeling) platform. In this sense, the availability of automated techniques that allow the interpretation of photos and the search using semantic terms would greatly facilitate the work to develop the project. In this article the use of deep learning techniques, specifically the convolutional neural networks (CNNs) for analyzing images of cultural heritage is assessed. It is considered that the application of these techniques can make a significant contribution to the objectives sought in the INCEPTION project and, more generally, the digital documentation of cultural heritage.

[1]  Roberto Cipolla,et al.  Refining Architectures of Deep Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Marinos Ioannides,et al.  In the wild image retrieval and clustering for 3D cultural heritage landmarks reconstruction , 2014, Multimedia Tools and Applications.

[3]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[6]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.