Detection of comic books twin pages with a non-overlapping stitching method

We address in this paper the issue of stitching non overlapping pairs of real digitized comic books' pages. The main objective is to be able to decide if two pages are meant to be displayed together for their content to be understood. First, the relevant content is separated from the background so the pairing is done over relevant pieces of visual information. We define the different kinds of noise that one can found on the edges of such documents and how to get rid of it. Then we propose a method to decide whether a couple of pages should be paired or not, based on the analysis of the relevant content. Our compatibility methods are evaluated against the methods from the literature, adapted from jigsaw puzzles solvers. Results are discussed over an actual commercial dataset of digitized comic books.

[1]  Fenghui Yao,et al.  A shape and image merging technique to solve jigsaw puzzles , 2003, Pattern Recognit. Lett..

[2]  Margaret M. Fleck,et al.  Jigsaw puzzle solver using shape and color , 1998, ICSP '98. 1998 Fourth International Conference on Signal Processing (Cat. No.98TH8344).

[3]  Shmuel Peleg,et al.  Seamless image stitching by minimizing false edges , 2006, IEEE Transactions on Image Processing.

[4]  Matthew Brown Image Stitching , 2014, Computer Vision, A Reference Guide.

[5]  Klaus Hansen,et al.  Solving jigsaw puzzles using image features , 2008, Pattern Recognit. Lett..

[6]  Shmuel Peleg,et al.  Seamless Image Stitching in the Gradient Domain , 2004, ECCV.

[7]  Alain Bouju,et al.  eBDtheque: A Representative Database of Comics , 2013, 2013 12th International Conference on Document Analysis and Recognition.

[8]  Reinhard Klette,et al.  Image Stitching - Comparisons and New Techniques , 1999, CAIP.

[9]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[10]  William T. Freeman,et al.  A probabilistic image jigsaw puzzle solver , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Ohad Ben-Shahar,et al.  A fully automated greedy square jigsaw puzzle solver , 2011, CVPR 2011.

[12]  Tarak Gandhi,et al.  An automatic jigsaw puzzle solver , 1994, Proceedings of 12th International Conference on Pattern Recognition.