Interactive Knowledge Learning for Ancient Images

This paper deals with cultural heritage preservation and ancient document indexing. In the management of historical documents, ancient images are described using semantic information, often manually annotated by historians. In this paper, we propose an approach to interactively propagate the historians' knowledge to a database of drop caps images manually populated by historians with drop caps image annotations. Based on a novel document indexing processing scheme which combines the use of the Zipf law and the use of bag of patterns, our approach extends the Bag of Words model to represent the knowledge by visual features through relevance feedback. Then annotation propagation is automatically performed to propagate knowledge to the drop caps image database. In this article, our approach is presented together with preliminary experimental results and an illustrative example.

[1]  Nicole Vincent,et al.  Ancient Initial Letters Indexing , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[2]  Andrew Zisserman,et al.  Efficient Visual Search for Objects in Videos , 2008, Proceedings of the IEEE.

[3]  Nicole Vincent,et al.  Towards historical document indexing: extraction of drop cap letters , 2011, International Journal on Document Analysis and Recognition (IJDAR).

[4]  Nicole Vincent,et al.  Graphical Drop Caps Indexing , 2009, GREC.

[5]  George Kingsley Zipf,et al.  Human behavior and the principle of least effort , 1949 .

[6]  Hsin-Hsi Chen,et al.  Integrating textual and visual information for cross-language image retrieval: A trans-media dictionary approach , 2007, Inf. Process. Manag..

[7]  Karen Spärck Jones Experiments in relevance weighting of search terms , 1979, Inf. Process. Manag..

[8]  Mickaël Coustaty,et al.  Discrimination of Old Document Images Using Their Style , 2011, 2011 International Conference on Document Analysis and Recognition.

[9]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[10]  J. H. Ward Hierarchical Grouping to Optimize an Objective Function , 1963 .

[11]  Hichem Frigui,et al.  Clustering by competitive agglomeration , 1997, Pattern Recognit..