ChainLineNet: Deep-Learning-Based Segmentation and Parameterization of Chain Lines in Historical Prints

The paper structure of historical prints is sort of a unique fingerprint. Paper with the same origin shows similar chain line distances. As the manual measurement of chain line distances is time consuming, the automatic detection of chain lines is beneficial. We propose an end-to-end trainable deep learning method for segmentation and parameterization of chain lines in transmitted light images of German prints from the 16th Century. We trained a conditional generative adversarial network with a multitask loss for line segmentation and line parameterization. We formulated a fully differentiable pipeline for line coordinates’ estimation that consists of line segmentation, horizontal line alignment, and 2D Fourier filtering of line segments, line region proposals, and differentiable line fitting. We created a dataset of high-resolution transmitted light images of historical prints with manual line coordinate annotations. Our method shows superior qualitative and quantitative chain line detection results with high accuracy and reliability on our historical dataset in comparison to competing methods. Further, we demonstrated that our method achieves a low error of less than 0.7 mm in comparison to manually measured chain line distances.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[3]  Han-Ul Kim,et al.  Semantic Line Detection and Its Applications , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[4]  Robert Jenssen,et al.  LS-Net: Fast Single-Shot Line-Segment Detector , 2021, Mach. Vis. Appl..

[5]  Kun Huang,et al.  Learning to Parse Wireframes in Images of Man-Made Environments , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[6]  Eric Brachmann,et al.  Neural-Guided RANSAC: Learning Where to Sample Model Hypotheses , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[7]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[8]  Kai Zhao,et al.  Deep Hough Transform for Semantic Line Detection , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Yao Li,et al.  ContourGAN: Image contour detection with generative adversarial network , 2019, Knowl. Based Syst..

[10]  K. Linnet,et al.  Performance of Deming regression analysis in case of misspecified analytical error ratio in method comparison studies. , 1998, Clinical chemistry.

[11]  Automatic Chain Line Segmentation in Historical Prints , 2020, ICPR Workshops.

[12]  Eric Backer,et al.  Paper Retrieval Based on Specific Paper Features: Chain and Laid Lines , 2006, MRCS.

[13]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Gui-Song Xia,et al.  Holistically-Attracted Wireframe Parsing , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Yi Ma,et al.  End-to-End Wireframe Parsing , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[16]  Silvia L. Pintea,et al.  Deep Hough-Transform Line Priors , 2020, ECCV.

[17]  Andreas Maier,et al.  Art2Contour: Salient Contour Detection in Artworks Using Generative Adversarial Networks , 2020, 2020 IEEE International Conference on Image Processing (ICIP).

[18]  Ersin Yumer,et al.  Photo-Sketching: Inferring Contour Drawings From Images , 2019, 2019 IEEE Winter Conference on Applications of Computer Vision (WACV).

[19]  Kia Ng,et al.  A system for segmenting and extracting paper-based watermark designs , 2007, International Journal on Digital Libraries.

[20]  Marcel J. T. Reinders,et al.  Dating and Authentication of Rembrandt's Etchings with the Help of Computational Intelligence , 2001, ICHIM.

[21]  Andreas K. Maier,et al.  Learning with Known Operators reduces Maximum Training Error Bounds , 2019, Nature Machine Intelligence.

[22]  Vlad Atanasiu Assessing paper origin and quality through large-scale laid lines density measurements , 2002 .

[23]  C. Richard Johnson,et al.  Hunting for Paper Moldmates Among Rembrandt's Prints: Chain-line pattern matching , 2015, IEEE Signal Processing Magazine.

[24]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[25]  Eric Brachmann,et al.  DSAC — Differentiable RANSAC for Camera Localization , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).