Crossing cuts polygonal puzzles: Models and Solvers

Jigsaw puzzle solving, the problem of constructing a coherent whole from a set of non-overlapping un-ordered fragments, is fundamental to numerous applications, and yet most of the literature has focused thus far on less realistic puzzles whose pieces are identical squares. Here we formalize a new type of jigsaw puzzle where the pieces are general convex polygons generated by cutting through a global polygonal shape with an arbitrary number of straight cuts. We analyze the theoretical properties of such puzzles, including the inherent challenges in solving them once pieces are contaminated with geometrical noise. To cope with such difficulties and obtain tractable solutions, we abstract the problem as a multi-body spring-mass dynamical sys-tem endowed with hierarchical loop constraints and a layered reconstruction process that is guided by the pictorial content of the pieces. We define evaluation metrics and present experimental results on both apictorial and pictorial puzzles to indicate that they are solvable completely automatically.

[1]  Ohad Ben-Shahar,et al.  From Square Pieces to Brick Walls: The Next Challenge in Solving Jigsaw Puzzles , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[2]  Fenghui Yao,et al.  A shape and image merging technique to solve jigsaw puzzles , 2003, Pattern Recognit. Lett..

[3]  Wilfried Philips,et al.  Constructing the topological solution of jigsaw puzzles , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[4]  Longin Jan Latecki,et al.  Sequential Monte Carlo for Maximum Weight Subgraphs with Application to Solving Image Jigsaw Puzzles , 2014, International Journal of Computer Vision.

[5]  W. Marande,et al.  Mitochondrial DNA as a Genomic Jigsaw Puzzle , 2007, Science.

[6]  Nikos Papamarkos,et al.  A New Technique for Solving a Jigsaw Puzzle , 2006, 2006 International Conference on Image Processing.

[7]  Ioannis Pitas,et al.  Automatic Color Based Reassembly of Fragmented Images and Paintings , 2010, IEEE Transactions on Image Processing.

[8]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[9]  Zhao Yanzheng,et al.  An image processing approach for jigsaw puzzle assembly , 2007 .

[10]  Kang Zhang,et al.  A graph-based optimization algorithm for fragmented image reassembly , 2014, Graph. Model..

[11]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[12]  H. Wolfson,et al.  Solving jigsaw puzzles by computer , 1988 .

[13]  Aytül Erçil,et al.  Optimization for automated assembly of puzzles , 2010 .

[14]  Longin Jan Latecki,et al.  Particle filter with state permutations for solving image jigsaw puzzles , 2011, CVPR 2011.

[15]  Shuicheng Yan,et al.  Automated Assembly of Shredded Pieces From Multiple Photos , 2010, IEEE Transactions on Multimedia.

[16]  Nathan S. Netanyahu,et al.  A Genetic Algorithm-Based Solver for Very Large Jigsaw Puzzles , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Kenji Shoji,et al.  Assembly of puzzles by connecting between blocks , 2008, 2008 19th International Conference on Pattern Recognition.

[18]  Nathan S. Netanyahu,et al.  A novel hybrid scheme using genetic algorithms and deep learning for the reconstruction of portuguese tile panels , 2019, GECCO.

[19]  Benjamin B. Kimia,et al.  On solving 2D and 3D puzzles using curve matching , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[20]  Andrew C. Gallagher Jigsaw puzzles with pieces of unknown orientation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Rui Yu,et al.  Solving Jigsaw Puzzles with Linear Programming , 2016, BMVC.

[22]  Mu-Chun Su,et al.  A puzzle solver and its application in speech descrambling , 2007 .

[23]  Yang Wang,et al.  Robust Solvers for Square Jigsaw Puzzles , 2013, 2013 International Conference on Computer and Robot Vision.

[24]  Kenji Shoji,et al.  Assembly of puzzles using a genetic algorithm , 2002, Object recognition supported by user interaction for service robots.

[25]  David B. Cooper,et al.  Solving Square Jigsaw Puzzles with Loop Constraints , 2014, ECCV.

[26]  Ohad Ben-Shahar,et al.  A fully automated greedy square jigsaw puzzle solver , 2011, CVPR 2011.

[27]  Tarak Gandhi,et al.  An automatic jigsaw puzzle solver , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[28]  Nathan S. Netanyahu,et al.  A Generalized Genetic Algorithm-Based Solver for Very Large Jigsaw Puzzles of Complex Types , 2014, AAAI.

[29]  Paul LaFollette,et al.  Isthmus critical points for solving jigsaw puzzles in computer vision , 1991, IEEE Trans. Syst. Man Cybern..

[30]  Kilho Son,et al.  Solving Square Jigsaw Puzzle by Hierarchical Loop Constraints , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Horst Bunke,et al.  Jigsaw Puzzle Solving Using Approximate String Matching and Best-First Search , 1993, CAIP.

[32]  Margaret M. Fleck,et al.  Jigsaw puzzle solver using shape and color , 1998, ICSP '98. 1998 Fourth International Conference on Signal Processing (Cat. No.98TH8344).

[33]  Susana Brandão,et al.  Hot Tiles: A Heat Diffusion Based Descriptor for Automatic Tile Panel Assembly , 2016, ECCV Workshops.

[34]  Naif Alajlan,et al.  Solving Square Jigsaw Puzzles Using Dynamic Programming and the Hungarian Procedure , 2009 .

[35]  William T. Freeman,et al.  A probabilistic image jigsaw puzzle solver , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[36]  Huei-Yung Lin,et al.  Reconstruction of shredded document based on image feature matching , 2012, Expert Syst. Appl..

[37]  Xin Li,et al.  JigsawNet: Shredded Image Reassembly Using Convolutional Neural Network and Loop-Based Composition , 2019, IEEE Transactions on Image Processing.

[38]  Erik D. Demaine,et al.  Jigsaw Puzzles, Edge Matching, and Polyomino Packing: Connections and Complexity , 2007, Graphs Comb..

[39]  David B. Cooper,et al.  Solving Small-Piece Jigsaw Puzzles by Growing Consensus , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  H. Freeman,et al.  Apictorial Jigsaw Puzzles: The Computer Solution of a Problem in Pattern Recognition , 1964, IEEE Trans. Electron. Comput..

[41]  Kenneth Steiglitz,et al.  Analyzing and simulating fracture patterns of theran wall paintings , 2012, JOCCH.

[42]  Klaus Hansen,et al.  Solving jigsaw puzzles using image features , 2008, Pattern Recognit. Lett..

[43]  Gabriel Taubin,et al.  Solving Image Puzzles with a Simple Quadratic Programming Formulation , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images.

[44]  Norman I. Badler,et al.  Jigsaw puzzle matching using a boundary-centered polar encoding , 1982, Comput. Graph. Image Process..

[45]  Marshall W. Bern,et al.  A global approach to automatic solution of jigsaw puzzles , 2002, SCG '02.

[46]  Ayellet Tal,et al.  Solving multiple square jigsaw puzzles with missing pieces , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).