Discovering characteristic landmarks on ancient coins using convolutional networks

In this paper, we propose a novel method to find characteristic landmarks on ancient Roman imperial coins using deep convolutional neural network models (CNNs). We formulate an optimization problem to discover class-specific regions while guaranteeing specific controlled loss of accuracy. Analysis on visualization of the discovered region confirms that not only can the proposed method successfully find a set of characteristic regions per class, but also the discovered region is consistent with human expert annotations. We also propose a new framework to recognize the Roman coins which exploits hierarchical structure of the ancient Roman coins using the state-of-the-art classification power of the CNNs adopted to a new task of coin classification. Experimental results show that the proposed framework is able to effectively recognize the ancient Roman coins. For this research, we have collected a new Roman coin dataset where all coins are annotated and consist of observe (head) and reverse (tail) images.

[1]  Bolei Zhou,et al.  Object Detectors Emerge in Deep Scene CNNs , 2014, ICLR.

[2]  Junwei Han,et al.  Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[4]  Igor Holländer,et al.  Dagobert - A New Coin Recognition and Sorting System , 2003, DICTA.

[5]  Arnold W. M. Smeulders,et al.  Fine-Grained Categorization by Alignments , 2013, 2013 IEEE International Conference on Computer Vision.

[6]  Laurens van der Maaten,et al.  COIN-O-MATIC: A fast system for reliable coin classification , 2006 .

[7]  Martin Kampel,et al.  A Bag of Visual Words Approach for Symbols-Based Coarse-Grained Ancient Coin Classification , 2013, ArXiv.

[8]  Jitendra Malik,et al.  Region-Based Convolutional Networks for Accurate Object Detection and Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Martin Kampel,et al.  A rotation-invariant bag of visual words model for symbols based ancient coin classification , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[10]  Trevor Darrell,et al.  Part-Based R-CNNs for Fine-Grained Category Detection , 2014, ECCV.

[11]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Kun Duan,et al.  Discovering localized attributes for fine-grained recognition , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[14]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Andrew Zisserman,et al.  Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps , 2013, ICLR.

[16]  Junwei Han,et al.  A Survey on Object Detection in Optical Remote Sensing Images , 2016, ArXiv.

[17]  Martin Kampel,et al.  Coarse-grained ancient coin classification using image-based reverse side motif recognition , 2015, Machine Vision and Applications.

[18]  Martin Kampel,et al.  Recognizing Ancient Coins Based on Local Features , 2008, ISVC.

[19]  Andrew Zisserman,et al.  Symbiotic Segmentation and Part Localization for Fine-Grained Categorization , 2013, 2013 IEEE International Conference on Computer Vision.

[20]  Stefanos Zafeiriou,et al.  Subspace Learning from Image Gradient Orientations , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Martin Kampel,et al.  Ancient Coin Classification Using Reverse Motif Recognition: Image-based classification of Roman Republican coins , 2015, IEEE Signal Processing Magazine.

[22]  Vladimir Pavlovic,et al.  Improving Ancient Roman Coin Recognition with Alignment and Spatial Encoding , 2014, ECCV Workshops.

[23]  Arnold W. M. Smeulders,et al.  Local Alignments for Fine-Grained Categorization , 2014, International Journal of Computer Vision.

[24]  Ognjen Arandjelovic,et al.  Automatic attribution of ancient Roman imperial coins , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[25]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[26]  Trevor Darrell,et al.  PANDA: Pose Aligned Networks for Deep Attribute Modeling , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Martin Kampel,et al.  Identification of ancient coins based on fusion of shape and local features , 2011, Machine Vision and Applications.

[28]  Bolei Zhou,et al.  Learning Deep Features for Scene Recognition using Places Database , 2014, NIPS.