A New Intelligent Jigsaw Puzzle Algorithm Base on Mixed Similarity and Symbol Matrix

Jigsaw puzzle algorithm is important as it can be applied to many areas such as biology, image editing, archaeology and incomplete crime-scene reconstruction. But, still, some problems exist in the process of practical application, for example, when there are a large number of similar objects in the puzzle fragments, the error rate will reach 30%–50%. When some fragments are missing, most algorithms fail to restore the images accurately. When the number of fragments of the jigsaw puzzle is large, efficiency is reduced. During the intelligent puzzle, mainly the Sum of Squared Distance Scoring (SSD), Mahalanobis Gradient Compatibility (MGC) and other metrics are used to calculate the similarity between the fragments. On the basis of these two measures, we put forward some new methods: 1. MGC is one of the most effective measures, but using MGC to reassemble the puzzle can cause an error image every 30 or 50 times, so we combine the Jaccard and MGC metric measure to compute the similarity between the image fragments, and reassemble the puzzle with a greedy algorithm. This algorithm not only reduces the error rate, but can also maintain a high accuracy in the case of a large number of fragments of similar objects. 2. For the lack of fragmentation and low efficiency, this paper uses a new method of SSD measurement and mark matrix, it is general in the sense that it can handle puzzles of unknown size, with fragments of unknown orientation, and even puzzles with missing fragments. The algorithm does not require any preset conditions and is more practical in real life. Finally, experiments show that the algorithm proposed in this paper improves not only the accuracy but also the efficiency of the operation.

[1]  Nikos Papamarkos,et al.  A New Technique for Solving a Jigsaw Puzzle , 2006, 2006 International Conference on Image Processing.

[2]  Nathan S. Netanyahu,et al.  Genetic algorithm-based solver for very large multiple jigsaw puzzles of unknown dimensions and piece orientation , 2014, GECCO.

[3]  Nathan S. Netanyahu,et al.  A Genetic Algorithm-Based Solver for Very Large Jigsaw Puzzles , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  William T. Freeman,et al.  A probabilistic image jigsaw puzzle solver , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Erik D. Demaine,et al.  Jigsaw Puzzles, Edge Matching, and Polyomino Packing: Connections and Complexity , 2007, Graphs Comb..

[6]  Shuicheng Yan,et al.  Automated assembly of shredded pieces from multiple photos , 2011, 2010 IEEE International Conference on Multimedia and Expo.

[7]  Ho-Jin Choi,et al.  Jigsaw puzzle image retrieval via pairwise compatibility measurement , 2014, 2014 International Conference on Big Data and Smart Computing (BIGCOMP).

[8]  Tarak Gandhi,et al.  An automatic jigsaw puzzle solver , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[9]  H. Wolfson,et al.  Solving jigsaw puzzles by computer , 1988 .

[10]  Klaus Hansen,et al.  Solving jigsaw puzzles using image features , 2008, Pattern Recognit. Lett..

[11]  William T. Freeman,et al.  The Patch Transform , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Edson Justino,et al.  Reconstructing shredded documents through feature matching. , 2006, Forensic science international.

[13]  Tim Weyrich,et al.  A system for high-volume acquisition and matching of fresco fragments: reassembling Theran wall paintings , 2008, SIGGRAPH 2008.

[14]  Yang Wang,et al.  Robust Solvers for Square Jigsaw Puzzles , 2013, 2013 International Conference on Computer and Robot Vision.

[15]  Aytül Erçil,et al.  A Texture Based Matching Approach for Automated Assembly of Puzzles , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[16]  H. Freeman,et al.  Apictorial Jigsaw Puzzles: The Computer Solution of a Problem in Pattern Recognition , 1964, IEEE Trans. Electron. Comput..

[17]  Margaret M. Fleck,et al.  Jigsaw puzzle solver using shape and color , 1998, ICSP '98. 1998 Fourth International Conference on Signal Processing (Cat. No.98TH8344).

[18]  Longin Jan Latecki,et al.  Particle filter with state permutations for solving image jigsaw puzzles , 2011, CVPR 2011.

[19]  Andrew C. Gallagher Jigsaw puzzles with pieces of unknown orientation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Ohad Ben-Shahar,et al.  A fully automated greedy square jigsaw puzzle solver , 2011, CVPR 2011.

[21]  W. Marande,et al.  Mitochondrial DNA as a Genomic Jigsaw Puzzle , 2007, Science.

[22]  Fenghui Yao,et al.  A shape and image merging technique to solve jigsaw puzzles , 2003, Pattern Recognit. Lett..

[23]  Naif Alajlan,et al.  Solving Square Jigsaw Puzzles Using Dynamic Programming and the Hungarian Procedure , 2009 .

[24]  Cinthia O. A. Freitas,et al.  Reconstructing strip-shredded documents using color as feature matching , 2009, SAC '09.

[25]  Ayellet Tal,et al.  Solving multiple square jigsaw puzzles with missing pieces , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Tsukasa Ogasawara,et al.  Joint detection for potsherds of broken earthenware , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).