An Open System for Collection and Automatic Recognition of Pottery through Neural Network Algorithms

In the last ten years, artificial intelligence (AI) techniques have been applied in archaeology. The ArchAIDE project realised an AI-based application to recognise archaeological pottery. Pottery is of paramount importance for understanding archaeological contexts. However, recognition of ceramics is still a manual, time-consuming activity, reliant on analogue catalogues. The project developed two complementary machine-learning tools to propose identifications based on images captured on-site, for optimising and economising this process, while retaining key decision points necessary to create trusted results. One method relies on the shape of a potsherd; the other is based on decorative features. For the shape-based recognition, a novel deep-learning architecture was employed, integrating shape information from points along the inner and outer profile of a sherd. The decoration classifier is based on relatively standard architectures used in image recognition. In both cases, training the algorithms meant facing challenges related to real-world archaeological data: the scarcity of labelled data; extreme imbalance between instances of different categories; and the need to take note of minute differentiating features. Finally, the creation of a desktop and mobile application that integrates the AI classifiers provides an easy-to-use interface for pottery classification and storing pottery data.

[1]  D. Scaradozzi,et al.  Underwater Photogrammetry for Archaeology- The Venus Project Framework , 2008, GRAPP.

[2]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[3]  Christos-Nikolaos Anagnostopoulos,et al.  3D digital reassembling of archaeological ceramic pottery fragments based on their thickness profile , 2016, ArXiv.

[4]  Barak Itkin,et al.  Developing the ArchAIDE application: A digital workflow for identifying, organising and sharing archaeological pottery using automated image recognition , 2020 .

[5]  Norihiro Hagita,et al.  Lexical Entrainment in Human Robot Interaction , 2014, International Journal of Social Robotics.

[6]  M. H. van den Dries Archaeology and the Application of Artificial Intelligence. Case-studies on use-wear analysis of prehistoric flint tools , 1998 .

[7]  J. Spijker,et al.  A supervised machine-learning approach towards geochemical predictive modelling in archaeology , 2015 .

[8]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Christopher M. Clark,et al.  Multi‐AUV motion planning for archeological site mapping and photogrammetric reconstruction , 2019, J. Field Robotics.

[10]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[11]  Barak Itkin,et al.  Computational Ceramicology , 2019, ArXiv.

[12]  Eric B. Baum,et al.  On the capabilities of multilayer perceptrons , 1988, J. Complex..

[13]  D. Filippas,et al.  DEVELOPMENT OF AN ALGORITHMIC PROCEDURE FOR THE DETECTION OF CONJUGATE FRAGMENTS , 2013 .

[14]  Marie Beurton-Aimar,et al.  Matching ostraca fragments using a siamese neural network , 2020, Pattern Recognit. Lett..

[15]  S. Kogou,et al.  From remote sensing and machine learning to the history of the Silk Road: large scale material identification on wall paintings , 2020, Scientific Reports.

[16]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Ilan Shimshoni,et al.  Solving Archaeological Puzzles , 2018, Pattern Recognit..

[18]  H. Orengo,et al.  New developments in drone‐based automated surface survey: Towards a functional and effective survey system , 2021, Archaeological Prospection.

[19]  Scott L. Andresen John McCarthy: Father of AI , 2002, IEEE Intell. Syst..

[20]  P. A. Lyakhov,et al.  Application of the residue number system to reduce hardware costs of the convolutional neural network implementation , 2020, Math. Comput. Simul..

[21]  Lior Wolf,et al.  The automatic recognition of ceramics from only one photo: The ArchAIDE app , 2021 .

[22]  Patricia Martín-Rodilla,et al.  Automatic process model discovery from textual methodologies , 2015, 2015 IEEE 9th International Conference on Research Challenges in Information Science (RCIS).

[23]  Ulrich W. Eisenecker,et al.  AI: The Tumultuous History of the Search for Artificial Intelligence , 1995 .

[24]  Gabriele Gattiglia,et al.  Think big about data: Archaeology and the Big Data challenge , 2015 .

[25]  M. Doerr Archaeological Predictive Modelling in Intelligent Network Structures , 2003 .

[26]  Ivan Tyukin,et al.  Exploring automated pottery identification [Arch-I-Scan] , 2018 .

[27]  F. C. Conesa,et al.  Automated detection of archaeological mounds using machine-learning classification of multisensor and multitemporal satellite data , 2020, Proceedings of the National Academy of Sciences.

[28]  Douglas Tudhope,et al.  Text Mining in Archaeology : Extracting Information from Archaeological Reports , 2015 .

[29]  Gino Caspari,et al.  Convolutional neural networks for archaeological site detection – Finding “princely” tombs , 2019, Journal of Archaeological Science.

[30]  F. Anichini,et al.  Big Archaeological Data. The ArchAIDE project approach , 2018 .

[31]  Christian Breiteneder,et al.  Automated petroglyph image segmentation with interactive classifier fusion , 2012, ICVGIP '12.

[32]  Tim Weyrich,et al.  Learning how to match fresco fragments , 2011, JOCCH.

[33]  F. Amigoni The Minerva Multiagent System for Supporting Creativity in Museums Organization Francesco Amigoni and Viola Schiaffonati , 2003 .

[34]  Douglas Tudhope,et al.  Excavating grey literature: A case study on the rich indexing of archaeological documents via natural language-processing techniques and knowledge-based resources , 2010, Aslib Proc..

[35]  J. J. Paijmans,et al.  Computer vision and machine learning for archaeology , 2006 .

[36]  Binh-Son Hua,et al.  Pointwise Convolutional Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[37]  Maciej Henneberg,et al.  Artificial intelligence for sex determination of skeletal remains: Application of a deep learning artificial neural network to human skulls. , 2019, Journal of forensic and legal medicine.

[38]  Mikael Bodén,et al.  A guide to recurrent neural networks and backpropagation , 2001 .

[39]  Alexander J. Smola,et al.  Deep Sets , 2017, 1703.06114.

[40]  Alexandre Guyot,et al.  Detecting Neolithic Burial Mounds from LiDAR-Derived Elevation Data Using a Multi-Scale Approach and Machine Learning Techniques , 2018, Remote. Sens..

[41]  David J. C. MacKay,et al.  A Practical Bayesian Framework for Backpropagation Networks , 1992, Neural Computation.

[42]  G. Philip,et al.  Potential of deep learning segmentation for the extraction of archaeological features from historical map series , 2021, Archaeological prospection.

[43]  Yannis Assael,et al.  Restoring ancient text using deep learning: a case study on Greek epigraphy , 2019, EMNLP.

[44]  Fabio Remondino,et al.  APPLICATION OF MACHINE AND DEEP LEARNING STRATEGIES FOR THE CLASSIFICATION OF HERITAGE POINT CLOUDS , 2019, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[45]  Roberto Scopigno,et al.  From Paper to Web: Automatic Generation of a Web-Accessible 3D Repository of Pottery Types , 2017, GCH.

[46]  Ioan-Gabriel Mircea,et al.  Machine learning-based approaches for predicting stature from archaeological skeletal remains using long bone lengths , 2016 .