Lazy caterer jigsaw puzzles: Models, properties, and a mechanical system-based solver

Jigsaw puzzle solving, the problem of constructing a coherent whole from a set of non-overlapping unordered fragments, is fundamental to numerous applications, and yet most of the literature has focused thus far on less realistic puzzles whose pieces are identical squares. Here we formalize a new type of jigsaw puzzle where the pieces are general convex polygons generated by cutting through a global polygonal shape with an arbitrary number of straight cuts, a generation model inspired by the celebrated Lazy caterer's sequence. We analyze the theoretical properties of such puzzles, including the inherent challenges in solving them once pieces are contaminated with geometrical noise. To cope with such difficulties and obtain tractable solutions, we abstract the problem as a multi-body spring-mass dynamical system endowed with hierarchical loop constraints and a layered reconstruction process. We define evaluation metrics and present experimental results to indicate that such puzzles are solvable completely automatically.

[1]  W. Marande,et al.  Mitochondrial DNA as a Genomic Jigsaw Puzzle , 2007, Science.

[2]  Kilho Son,et al.  Solving Square Jigsaw Puzzle by Hierarchical Loop Constraints , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Tarak Gandhi,et al.  An automatic jigsaw puzzle solver , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[4]  Benjamin B. Kimia,et al.  On solving 2D and 3D puzzles using curve matching , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Nathan S. Netanyahu,et al.  A Generalized Genetic Algorithm-Based Solver for Very Large Jigsaw Puzzles of Complex Types , 2014, AAAI.

[6]  Rui Yu,et al.  Solving Jigsaw Puzzles with Linear Programming , 2016, BMVC.

[7]  Yang Wang,et al.  Robust Solvers for Square Jigsaw Puzzles , 2013, 2013 International Conference on Computer and Robot Vision.

[8]  Margaret M. Fleck,et al.  Jigsaw puzzle solver using shape and color , 1998, ICSP '98. 1998 Fourth International Conference on Signal Processing (Cat. No.98TH8344).

[9]  Longin Jan Latecki,et al.  Particle filter with state permutations for solving image jigsaw puzzles , 2011, CVPR 2011.

[10]  Longin Jan Latecki,et al.  Sequential Monte Carlo for Maximum Weight Subgraphs with Application to Solving Image Jigsaw Puzzles , 2014, International Journal of Computer Vision.

[11]  Gabriel Taubin,et al.  Solving Image Puzzles with a Simple Quadratic Programming Formulation , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images.

[12]  Ohad Ben-Shahar,et al.  A fully automated greedy square jigsaw puzzle solver , 2011, CVPR 2011.

[13]  Ohad Ben-Shahar,et al.  From Square Pieces to Brick Walls: The Next Challenge in Solving Jigsaw Puzzles , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[14]  Fenghui Yao,et al.  A shape and image merging technique to solve jigsaw puzzles , 2003, Pattern Recognit. Lett..

[15]  Paul LaFollette,et al.  Isthmus critical points for solving jigsaw puzzles in computer vision , 1991, IEEE Trans. Syst. Man Cybern..

[16]  Xin Li,et al.  JigsawNet: Shredded Image Reassembly Using Convolutional Neural Network and Loop-Based Composition , 2019, IEEE Transactions on Image Processing.

[17]  Ali Esmaili,et al.  Probability Models in Engineering and Science , 2006, Technometrics.

[18]  Nathan S. Netanyahu,et al.  A novel hybrid scheme using genetic algorithms and deep learning for the reconstruction of portuguese tile panels , 2019, GECCO.

[19]  Horst Bunke,et al.  Jigsaw Puzzle Solving Using Approximate String Matching and Best-First Search , 1993, CAIP.

[20]  Nathan S. Netanyahu,et al.  A Genetic Algorithm-Based Solver for Very Large Jigsaw Puzzles , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Ioannis Pitas,et al.  Automatic Color Based Reassembly of Fragmented Images and Paintings , 2010, IEEE Transactions on Image Processing.

[22]  William T. Freeman,et al.  A probabilistic image jigsaw puzzle solver , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Huei-Yung Lin,et al.  Reconstruction of shredded document based on image feature matching , 2012, Expert Syst. Appl..

[24]  Naif Alajlan,et al.  Solving Square Jigsaw Puzzles Using Dynamic Programming and the Hungarian Procedure , 2009 .

[25]  Ayellet Tal,et al.  Solving multiple square jigsaw puzzles with missing pieces , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Shuicheng Yan,et al.  Automated Assembly of Shredded Pieces From Multiple Photos , 2010, IEEE Transactions on Multimedia.

[27]  Zhao Yanzheng,et al.  An image processing approach for jigsaw puzzle assembly , 2007 .

[28]  Marshall W. Bern,et al.  A global approach to automatic solution of jigsaw puzzles , 2002, SCG '02.

[29]  Horst Bunke,et al.  An optimal algorithm for extracting the regions of a plane graph , 1993, Pattern Recognit. Lett..

[30]  David B. Cooper,et al.  Solving Square Jigsaw Puzzles with Loop Constraints , 2014, ECCV.

[31]  Mu-Chun Su,et al.  A puzzle solver and its application in speech descrambling , 2007 .

[32]  H. Wolfson,et al.  Solving jigsaw puzzles by computer , 1988 .

[33]  Thomas L. Moore Using Euler's Formula to Solve Plane Separation Problems , 1991 .

[34]  H. Freeman,et al.  Apictorial Jigsaw Puzzles: The Computer Solution of a Problem in Pattern Recognition , 1964, IEEE Trans. Electron. Comput..

[35]  Susana Brandão,et al.  Hot Tiles: A Heat Diffusion Based Descriptor for Automatic Tile Panel Assembly , 2016, ECCV Workshops.

[36]  Norman I. Badler,et al.  Jigsaw puzzle matching using a boundary-centered polar encoding , 1982, Comput. Graph. Image Process..

[37]  Grigore C. Burdea,et al.  Solving jigsaw puzzles by a robot , 1989, IEEE Trans. Robotics Autom..

[38]  David B. Cooper,et al.  Solving Small-Piece Jigsaw Puzzles by Growing Consensus , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Andrew C. Gallagher Jigsaw puzzles with pieces of unknown orientation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Klaus Hansen,et al.  Solving jigsaw puzzles using image features , 2008, Pattern Recognit. Lett..

[41]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[42]  Kenji Shoji,et al.  Assembly of puzzles by connecting between blocks , 2008, 2008 19th International Conference on Pattern Recognition.

[43]  Aytül Erçil,et al.  Optimization for automated assembly of puzzles , 2010 .

[44]  Erik D. Demaine,et al.  Jigsaw Puzzles, Edge Matching, and Polyomino Packing: Connections and Complexity , 2007, Graphs Comb..

[45]  Wilfried Philips,et al.  Constructing the topological solution of jigsaw puzzles , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[46]  Kenji Shoji,et al.  Assembly of puzzles using a genetic algorithm , 2002, Object recognition supported by user interaction for service robots.

[47]  Nikos Papamarkos,et al.  A New Technique for Solving a Jigsaw Puzzle , 2006, 2006 International Conference on Image Processing.

[48]  Yasushi Makihara,et al.  Object recognition supported by user interaction for service robots , 2002, Object recognition supported by user interaction for service robots.

[49]  Kang Zhang,et al.  A graph-based optimization algorithm for fragmented image reassembly , 2014, Graph. Model..

[50]  Kenneth Steiglitz,et al.  Analyzing and simulating fracture patterns of theran wall paintings , 2012, JOCCH.