1 Report on Shape Analysis and Matching and on Semantic Matching 2016-03-16

that have been already implemented in cultural heritage or we think are useful for the GRAVITATE project. These fields are relatively disjoint, and the research and development challenge of GRAVITATE is precisely to merge them. After the review of the current literature on these fields, we end the report with common remarks on possible or plausible crossconnections that suggest themselves. These considerations will be refined for the Roadmap for Research deliverable. D3.1

[1]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[2]  H. Wolfson,et al.  Solving jigsaw puzzles by computer , 1988 .

[3]  Tom Altman.  Solving the JIGSAW puzzle problem in linear time , 1989, Appl. Artif. Intell..

[4]  Paul LaFollette,et al.  Isthmus critical points for solving jigsaw puzzles in computer vision , 1991, IEEE Trans. Syst. Man Cybern..

[5]  Katsushi Ikeuchi,et al.  The Complex EGI: A New Representation for 3-D Pose Determination , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Tarak Gandhi,et al.  An automatic jigsaw puzzle solver , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[7]  Leo Dorst,et al.  Morphological signal processing and the slope transform , 1994, Signal Process..

[8]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[9]  Leo Dorst,et al.  Quadratic Structuring Functions in Mathematical Morphology , 1996, ISMM.

[10]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Margaret M. Fleck,et al.  Jigsaw puzzle solver using shape and color , 1998, ICSP '98. 1998 Fourth International Conference on Signal Processing (Cat. No.98TH8344).

[12]  Andrew E. Johnson,et al.  Surface Matching for Object Recognition in Complex 3-D Scenes , 1998 .

[13]  Hans-Peter Kriegel,et al.  OPTICS: ordering points to identify the clustering structure , 1999, SIGMOD '99.

[14]  Marc Rioux,et al.  Description of shape information for 2-D and 3-D objects , 2000, Signal Process. Image Commun..

[15]  Leo Dorst,et al.  The Systems Theory of Contact , 2000, AFPAC.

[16]  Herbert Edelsbrunner,et al.  Topological persistence and simplification , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[17]  Ron Kimmel,et al.  Efficient Dilation, Erosion, Opening and Closing Algorithms , 2000, ISMM.

[18]  Paul A. Viola,et al.  Boosting Image Retrieval , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[19]  Benjamin B. Kimia,et al.  On solving 2D and 3D puzzles using curve matching , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[20]  Marshall W. Bern,et al.  A global approach to automatic solution of jigsaw puzzles , 2002, SCG '02.

[21]  Michael Elad,et al.  Content based retrieval of VRML objects: an iterative and interactive approach , 2002 .

[22]  Georgios Papaioannou,et al.  Reconstruction of Three-Dimensional Objects through Matching of Their Parts , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Titus B. Zaharia,et al.  Shape-based retrieval of 3D mesh models , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[24]  K. Kraus.  PHOTOGRAMMETRY, REMOTE SENSING AND SPATIAL INFORMATION SCIENCE FOR HERITAGE DOCUMENTATION , 2003 .

[25]  Thomas S. Huang,et al.  Relevance feedback in image retrieval: A comprehensive review , 2003, Multimedia Systems.

[26]  Fenghui Yao,et al.  A shape and image merging technique to solve jigsaw puzzles , 2003, Pattern Recognit. Lett..

[27]  Ming Ouhyoung,et al.  On Visual Similarity Based 3D Model Retrieval , 2003, Comput. Graph. Forum.

[28]  Dejan V. Vranic,et al.  3D model retrieval , 2004 .

[29]  Remco C. Veltkamp,et al.  A survey of content based 3D shape retrieval methods , 2004, Proceedings Shape Modeling Applications, 2004..

[30]  Rui Xu,et al.  Survey of clustering algorithms , 2005, IEEE Transactions on Neural Networks.

[31]  Giovanna Sansoni,et al.  Inspection, 3D modelling, and rapid prototyping of cultural heritage by means of a 3D optical digitiser , 2005, SPIE Optical Metrology.

[32]  David Cohen-Steiner,et al.  Stability of Persistence Diagrams , 2005, Discret. Comput. Geom..

[33]  BENJAMIN BUSTOS,et al.  Feature-based similarity search in 3D object databases , 2005, CSUR.

[34]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  R. Veltkamp,et al.  SHREC 2007 3 D Shape Retrieval Contest , 2006 .

[36]  H. Pottmann,et al.  Reassembling fractured objects by geometric matching , 2006, SIGGRAPH 2006.

[37]  Nikos Papamarkos,et al.  A New Technique for Solving a Jigsaw Puzzle , 2006, 2006 International Conference on Image Processing.

[38]  Paul Over,et al.  Evaluation campaigns and TRECVid , 2006, MIR '06.

[39]  Aytül Erçil,et al.  A Texture Based Matching Approach for Automated Assembly of Puzzles , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[40]  Daniel Cohen-Or,et al.  Salient geometric features for partial shape matching and similarity , 2006, TOGS.

[41]  Shi-Min Hu,et al.  Geometry and Convergence Analysis of Algorithms for Registration of 3D Shapes , 2006, International Journal of Computer Vision.

[42]  Matthieu Cord,et al.  Feature-based approach to semi-supervised similarity learning , 2006, Pattern Recognit..

[43]  Paolo Cignoni,et al.  Using 3D Scanning to Analyze a Proposal for the Attribution of a Bronze Horse to Leonardo da Vinci , 2007, VAST.

[44]  Daniel A. Keim,et al.  Content-Based 3D Object Retrieval , 2007, IEEE Computer Graphics and Applications.

[45]  Erik D. Demaine,et al.  Jigsaw Puzzles, Edge Matching, and Polyomino Packing: Connections and Complexity , 2007, Graphs Comb..

[46]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[47]  Marcel Worring,et al.  Interactive Search by Direct Manipulation of Dissimilarity Space , 2007, IEEE Transactions on Multimedia.

[48]  P. Rousopoulos,et al.  Automated reconstruction of fragmented objects using their 3D representation - application to important archaeological finds , 2008, 2008 9th International Conference on Signal Processing.

[49]  Klaus Hansen,et al.  Solving jigsaw puzzles using image features , 2008, Pattern Recognit. Lett..

[50]  Patrizio Frosini,et al.  Natural Pseudo-Distance and Optimal Matching between Reduced Size Functions , 2008, ArXiv.

[51]  Petros Daras,et al.  Semantic force relevance feedback, content-free 3D object retrieval and annotation propagation: bridging the gap and beyond , 2008, Multimedia Tools and Applications.

[52]  Umberto Castellani,et al.  Sparse points matching by combining 3D mesh saliency with statistical descriptors , 2008, Comput. Graph. Forum.

[53]  Jan-Michael Frahm,et al.  3D model matching with Viewpoint-Invariant Patches (VIP) , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[54]  Indriyati Atmosukarto,et al.  A Learning Approach to 3D Object Representation for Classification , 2008, SSPR/SPR.

[55]  Tim Weyrich,et al.  A system for high-volume acquisition and matching of fresco fragments: reassembling Theran wall paintings , 2008, ACM Trans. Graph..

[56]  D.B. Cooper,et al.  Computational reconstruction of ancient artifacts , 2008, IEEE Signal Processing Magazine.

[57]  Michela Spagnuolo,et al.  3D Media and the Semantic Web , 2009, IEEE Intelligent Systems.

[58]  Leonidas J. Guibas,et al.  A concise and provably informative multi-scale signature based on heat diffusion , 2009 .

[59]  Paul Over,et al.  High-level feature detection from video in TRECVid: a 5-year retrospective of achievements , 2009 .

[60]  Eneko Agirre,et al.  A Study on Similarity and Relatedness Using Distributional and WordNet-based Approaches , 2009, NAACL.

[61]  Rasmus Larsen,et al.  Shape Analysis Using the Auto Diffusion Function , 2009 .

[62]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[63]  R. Horaud,et al.  Surface feature detection and description with applications to mesh matching , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[64]  Daniel Cohen-Or,et al.  Contextual Part Analogies in 3D Objects , 2010, International Journal of Computer Vision.

[65]  Mohamed Daoudi,et al.  Partial 3D Shape Retrieval by Reeb Pattern Unfolding , 2009, Comput. Graph. Forum.

[66]  Marco Attene,et al.  Characterization of 3D shape parts for semantic annotation , 2009, Comput. Aided Des..

[67]  Bülent Sankur,et al.  Similarity Learning for 3D Object Retrieval Using Relevance Feedback and Risk Minimization , 2010, International Journal of Computer Vision.

[68]  George Pavlidis,et al.  3D Pottery content-based retrieval based on pose normalisation and segmentation , 2010 .

[69]  Xulei Wang,et al.  Global and local isometry-invariant descriptor for 3D shape comparison and partial matching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[70]  Silvia Biasotti,et al.  Shape comparison through mutual distances of real functions , 2010, 3DOR '10.

[71]  Iasonas Kokkinos,et al.  Scale-invariant heat kernel signatures for non-rigid shape recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[72]  Zheng Qin,et al.  A boosting method based on SVM for relevance feedback in content-based 3D model retrieval , 2010, The 2nd International Conference on Software Engineering and Data Mining.

[73]  Georges Quénot,et al.  TRECVID 2015 - An Overview of the Goals, Tasks, Data, Evaluation Mechanisms and Metrics , 2011, TRECVID.

[74]  Martin Kampel,et al.  Proposing features for the reconstruction of marble plates of ephesos , 2010, 2010 16th International Conference on Virtual Systems and Multimedia.

[75]  Tamal K. Dey,et al.  Persistent Heat Signature for Pose‐oblivious Matching of Incomplete Models , 2010, Comput. Graph. Forum.

[76]  Ghassan Hamarneh,et al.  A Survey on Shape Correspondence , 2011, Comput. Graph. Forum.

[77]  Hamid Laga.  Semantics-Driven Approach for Automatic Selection of Best Views of 3D Shapes , 2010, 3DOR@Eurographics.

[78]  William T. Freeman,et al.  A probabilistic image jigsaw puzzle solver , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[79]  Daniela Giorgi,et al.  3D relevance feedback via multilevel relevance judgements , 2010, The Visual Computer.

[80]  Patrick Reuter,et al.  Semi-Automatic Geometry-Driven Reassembly of Fractured Archeological Objects , 2010, VAST.

[81]  Prosenjit Bose,et al.  A survey of geodesic paths on 3D surfaces , 2011, Comput. Geom..

[82]  Marco Attene,et al.  Part-in-whole 3D shape matching and docking , 2011, The Visual Computer.

[83]  Leonidas J. Guibas,et al.  Shape google: Geometric words and expressions for invariant shape retrieval , 2011, TOGS.

[84]  Zeyun Yu,et al.  Surface feature based mesh segmentation , 2011, Comput. Graph..

[85]  Ohad Ben-Shahar,et al.  A fully automated greedy square jigsaw puzzle solver , 2011, CVPR 2011.

[86]  Pizzanu Kanongchaiyos,et al.  Reeb graph based partial shape retrieval for non-rigid 3D object , 2011, VRCAI.

[87]  Longin Jan Latecki,et al.  Particle filter with state permutations for solving image jigsaw puzzles , 2011, CVPR 2011.

[88]  Bo Li,et al.  3D model retrieval using hybrid features and class information , 2013, Multimedia Tools and Applications.

[89]  Ayellet Tal,et al.  Surface partial matching and application to archaeology , 2011, Comput. Graph..

[90]  Thomas A. Funkhouser,et al.  Algorithms to automatically quantify the geometric similarity of anatomical surfaces , 2011, Proceedings of the National Academy of Sciences.

[91]  Ko Nishino,et al.  Reassembling Thin Artifacts of Unknown Geometry , 2011, VAST.

[92]  C. Chamzas,et al.  3D pottery shape matching using depth map images , 2011 .

[93]  Tim Weyrich,et al.  Learning how to match fresco fragments , 2011, JOCCH.

[94]  Radu Horaud,et al.  Topologically-robust 3D shape matching based on diffusion geometry and seed growing , 2011, CVPR 2011.

[95]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[96]  Benjamin Bustos,et al.  On nonmetric similarity search problems in complex domains , 2011, CSUR.

[97]  Karthik Ramani,et al.  Temperature distribution descriptor for robust 3D shape retrieval , 2011, CVPR 2011 WORKSHOPS.

[98]  Andrew C. Gallagher.  Jigsaw puzzles with pieces of unknown orientation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[99]  Guillaume Lavoué,et al.  Combination of bag-of-words descriptors for robust partial shape retrieval , 2012, The Visual Computer.

[100]  M. Muzzupappa,et al.  A Complete Morphological Study of the Right Hand of Bronzo "A" DI Riace , 2012 .

[101]  Petros Daras,et al.  Investigating the Effects of Multiple Factors Towards More Accurate 3-D Object Retrieval , 2012, IEEE Transactions on Multimedia.

[102]  Ligang Liu,et al.  Co‐Segmentation of 3D Shapes via Subspace Clustering , 2012, Comput. Graph. Forum.

[103]  Luc Van Gool,et al.  Tools for Virtual Reassembly of Fresco Fragments , 2012 .

[104]  Wei Yu,et al.  Fragmented skull modeling using heat kernels , 2012, Graph. Model..

[105]  Leonidas J. Guibas,et al.  An optimization approach for extracting and encoding consistent maps in a shape collection , 2012, ACM Trans. Graph..

[106]  S. Prima,et al.  A new efficient EM-ICP algorithm for non-linear registration of 3D point sets , 2012 .

[107]  Dimitris Arabadjis,et al.  Efficient solution to the 3D problem of automatic wall paintings reassembly , 2012, Comput. Math. Appl..

[108]  Radu Horaud,et al.  Keypoints and Local Descriptors of Scalar Functions on 2D Manifolds , 2012, International Journal of Computer Vision.

[109]  Daniel Cohen-Or,et al.  Active co-analysis of a set of shapes , 2012, ACM Trans. Graph..

[110]  Marinos Ioannides.  Progress in Cultural Heritage Preservation : 4th International Conference, EuroMed 2012, Limassol, Cyprus, October 29 November 3, 2012. Proceedings , 2012 .

[111]  Ioannis Pratikakis,et al.  3D Object Retrieval via Range Image Queries based on SIFT descriptors on Panoramic Views , 2012, 3DOR@Eurographics.

[112]  Alexander M. Bronstein,et al.  Coupled quasi‐harmonic bases , 2012, Comput. Graph. Forum.

[113]  Mark Stevenson,et al.  Computing similarity between items in a digital library of cultural heritage , 2013, JOCCH.

[114]  Nathan S. Netanyahu,et al.  A Genetic Algorithm-Based Solver for Very Large Jigsaw Puzzles , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[115]  Ghassan Hamarneh,et al.  Bilateral Maps for Partial Matching , 2013, Comput. Graph. Forum.

[116]  Andrea Cerri,et al.  The Persistence Space in Multidimensional Persistent Homology , 2013, DGCI.

[117]  Marco Callieri,et al.  Innovative uses of 3D digital technologies to assist the restoration of a fragmented terracotta statue , 2013 .

[118]  Kun Zhou,et al.  A Survey on Partial Retrieval of 3D Shapes , 2013, Journal of Computer Science and Technology.

[119]  Gary K. L. Tam,et al.  Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid , 2013, IEEE Transactions on Visualization and Computer Graphics.

[120]  Daniela Giorgi,et al.  PHOG: Photometric and geometric functions for textured shape retrieval , 2013, SGP '13.

[121]  Giuseppe Patanè,et al.  Heat diffusion kernel and distance on surface meshes and point sets , 2013, Comput. Graph..

[122]  Vincent Barra,et al.  3D shape retrieval using Kernels on Extended Reeb Graphs , 2013, Pattern Recognit..

[123]  Ko Nishino,et al.  A flexible approach to reassembling thin artifacts of unknown geometry , 2013 .

[124]  Vincent Barra,et al.  Learning Kernels on Extended Reeb Graphs for 3D Shape Classification and Retrieval , 2013, 3DOR@Eurographics.

[125]  Olivier Colot,et al.  A parts-based approach for automatic 3D shape categorization using belief functions , 2013, TIST.

[126]  Thomas Mensink,et al.  Image Classification with the Fisher Vector: Theory and Practice , 2013, International Journal of Computer Vision.

[127]  Paolo Cignoni,et al.  A computer-assisted constraint-based system for assembling fragmented objects , 2013, 2013 Digital Heritage International Congress (DigitalHeritage).

[128]  Andrea Cerri,et al.  Similarity Assessment for the Analysis of 3D Artefacts , 2014, GCH.

[129]  Georgios Papaioannou,et al.  Facet Extraction and Classification for the Reassembly of Fractured 3D Objects , 2014, Eurographics.

[130]  Alexander M. Bronstein,et al.  Supervised learning of bag‐of‐features shape descriptors using sparse coding , 2014, Comput. Graph. Forum.

[131]  Michalis A. Savelonas,et al.  An overview of partial 3D object retrieval methodologies , 2015, Multimedia Tools and Applications.

[132]  Silvia Biasotti,et al.  Mathematical Tools for Shape Analysis and Description , 2014, Synthesis Lectures on Computer Graphics and Animation.

[133]  Hamid Laga,et al.  Reasoning About Shape in Complex Datasets: Geometry, Structure and Semantics , 2014, Eurographics.

[134]  David B. Cooper,et al.  Solving Square Jigsaw Puzzles with Loop Constraints , 2014, ECCV.

[135]  Leonidas J. Guibas,et al.  Functional map networks for analyzing and exploring large shape collections , 2014, ACM Trans. Graph..

[136]  Federico Tombari,et al.  SHOT: Unique signatures of histograms for surface and texture description , 2014, Comput. Vis. Image Underst..

[137]  Learning Spectral Descriptors for Deformable Shape Correspondence , 2014, IEEE Trans. Pattern Anal. Mach. Intell..

[138]  Ayellet Tal,et al.  3D Shape Analysis for Archaeology , 2014, 3D Research Challenges in Cultural Heritage.

[139]  R. Nedelcu,et al.  Scanning accuracy and precision in 4 intraoral scanners: an in vitro comparison based on 3-dimensional analysis. , 2014, The Journal of prosthetic dentistry.

[140]  Kang Zhang,et al.  A graph-based optimization algorithm for fragmented image reassembly , 2014, Graph. Model..

[141]  Michalis A. Savelonas,et al.  Fisher Encoding of Adaptive Fast Persistent Feature Histograms for Partial Retrieval of 3D Pottery Objects , 2014, 3DOR@Eurographics.

[142]  Georgios Papaioannou,et al.  Efficient Sparse ICP , 2015, Comput. Aided Geom. Des..

[143]  Georgios Papaioannou,et al.  Object Completion using k‐Sparse Optimization , 2015, Comput. Graph. Forum.

[144]  Pierre Vandergheynst,et al.  ShapeNet: Convolutional Neural Networks on Non-Euclidean Manifolds , 2015, ArXiv.

[145]  Michalis A. Savelonas,et al.  Partial 3D Object Retrieval combining Local Shape Descriptors with Global Fisher Vectors , 2015, 3DOR@Eurographics.

[146]  Mohammed Bennamoun,et al.  A Comprehensive Performance Evaluation of 3D Local Feature Descriptors , 2015, International Journal of Computer Vision.

[147]  Ayellet Tal,et al.  Solving multiple square jigsaw puzzles with missing pieces , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[148]  Pierre Vandergheynst,et al.  Learning class‐specific descriptors for deformable shapes using localized spectral convolutional networks , 2015, SGP '15.

[149]  Andrea Cerri,et al.  3D Artifacts Similarity Based on the Concurrent Evaluation of Heterogeneous Properties , 2015, JOCCH.

[150]  Giuseppe Patanè,et al.  Semantic annotation of 3D anatomical models to support diagnosis and follow-up analysis of musculoskeletal pathologies , 2016, International Journal of Computer Assisted Radiology and Surgery.

[151]  Alberto Del Bimbo,et al.  The Mesh-LBP: A Framework for Extracting Local Binary Patterns From Discrete Manifolds , 2015, IEEE Transactions on Image Processing.

[152]  S. Filin,et al.  Prehistoric bedrock features: recent advances in 3D characterization and geometrical analyses , 2015 .

[153]  Georgios Papaioannou,et al.  Fractured Object Reassembly via Robust Surface Registration , 2015, Eurographics.

[154]  Ayellet Tal,et al.  Surface Regions of Interest for Viewpoint Selection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[155]  Andrea Giachetti,et al.  Scale Space Graph Representation and Kernel Matching for Non Rigid and Textured 3D Shape Retrieval , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[156]  Tim Weyrich,et al.  A Survey of Geometric Analysis in Cultural Heritage , 2016, Comput. Graph. Forum.

[157]  Trimble,et al.  Fragments of the City: Stanfordʹs Digital Forma Urbis Romae Project , 2022 .