Markerless detection of ancient rock carvings in the wild: rock art in Vathy, Astypalaia

Abstract In this paper, we discuss the problem of object detection in a cultural heritage application context. In particular, the objects to be detected are ancient rock carvings, discovered at the archaeological site of Vathy, Astypalaia in Greece. Without the help of a marker or a human expert, the rock carvings are extremely difficult for a visitor of the site to discern from their surroundings. We explore the possibility of using a computational method that could replace the human expert and detect the rock carvings of interest without the aid of a specific marker. We present a dataset of images that is comprised of annotated photographs of the rock carvings, taken in situ and under differing poses and lighting parameters. Two methods for detection are applied; the first method makes use of a supervised, deep learning-based model, while the other relies on feature point-based matching to an annotated template, in the context of which we propose a simple image matching distance. We show that each method is applicable under different conditions, and evaluate their effectiveness with numerical trials.

[1]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Angelos Barmpoutis,et al.  A novel framework for 3D reconstruction and analysis of ancient inscriptions , 2009, Machine Vision and Applications.

[3]  Tim Weyrich,et al.  Global Consistency in the Automatic Assembly of Fragmented Artefacts , 2011, VAST.

[4]  Fabio Remondino,et al.  Orientation and 3D modelling from markerless terrestrial images: combining accuracy with automation , 2010 .

[5]  George Pavlidis,et al.  Methods for 3D digitization of Cultural Heritage , 2007 .

[6]  Anestis Koutsoudis,et al.  Partial matching of 3D cultural heritage objects using panoramic views , 2016, Multimedia Tools and Applications.

[7]  Francesco Colace,et al.  An adaptive app for tourist contents contextualization , 2017, ICC.

[8]  Luciano Silva,et al.  3D reconstruction methods for digital preservation of cultural heritage: A survey , 2014, Pattern Recognit. Lett..

[9]  Pan Hui,et al.  Mobile Augmented Reality Survey: From Where We Are to Where We Go , 2017, IEEE Access.

[10]  Nassir Navab,et al.  Visual marker detection and decoding in AR systems: a comparative study , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[11]  F. Stanco,et al.  Digital Imaging for Cultural Heritage Preservation: Analysis, Restoration, and Reconstruction of Ancient Artworks , 2011 .

[12]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[13]  Paul L. Rosin,et al.  Selection of the optimal parameter value for the Isomap algorithm , 2006, Pattern Recognit. Lett..

[14]  Basilios Gatos,et al.  Using attributes for word spotting and recognition in polytonic greek documents , 2015, 2015 13th International Conference on Document Analysis and Recognition (ICDAR).

[15]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[16]  Claudio De Stefano,et al.  Reliable writer identification in medieval manuscripts through page layout features: The "Avila" Bible case , 2018, Eng. Appl. Artif. Intell..

[17]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Tim Weyrich,et al.  A system for high-volume acquisition and matching of fresco fragments: reassembling Theran wall paintings , 2008, SIGGRAPH 2008.

[19]  Reinhard Klette,et al.  Concise Computer Vision , 2014, Undergraduate Topics in Computer Science.

[20]  Paul Zikas,et al.  A Mobile, AR Inside-Out Positional Tracking Algorithm, (MARIOPOT), Suitable for Modern, Affordable Cardboard-Style VR HMDs , 2016, EuroMed.