Analyzing the Decorative Style of 3D Heritage Collections Based on Shape Saliency

As technologies for 3D acquisition become widely available, it is expected that 3D content documenting heritage artifacts will become increasingly popular. Nevertheless, to provide access to and enable the creative use of this content, it is necessary to address the challenges to its access. These include the automatic enrichment of 3D content with suitable metadata so that content does not get lost. To address these challenges, this article presents research on developing technologies to support the organization and discoverability of 3D content in the Cultural Heritage (CH) domain. This research takes advantage of the fact that heritage artifacts have been designed throughout the centuries with distinctive design styles. Hence, the shape and the decoration of an artifact can provide significant information on the history of the artifact. The main contributions of this article include an ontology for documenting 3D representations of heritage artifacts decorated with ornaments such as architectural mouldings. In addition, the article presents a complementary shape retrieval method based on shape saliency to improve the automatic classification of the artifact’s semantic information based on its 3D shape. This method is tested on a collection of Regency ornament mouldings found in domestic interiors. This content provides a rich dataset on which to base the exploration of issues common to many CH artifacts, such as design styles and decorative ornament.

[1]  S. Hudson,et al.  The Art of Writing about Art , 2001 .

[2]  Karina Rodriguez-Echavarria,et al.  Studying shape semantics of an architectural moulding collection: Classifying style based on shape analysis methods , 2015, 2015 Digital Heritage.

[3]  Franz Sales Meyer,et al.  A handbook of ornament , 1957 .

[4]  Thomas A. Funkhouser,et al.  Schelling points on 3D surface meshes , 2012, ACM Trans. Graph..

[5]  Owen Jones,et al.  The Grammar of Ornament , 1988 .

[6]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[7]  Fabio Pittarello,et al.  ToBoA-3D: an architecture for managing top-down and bottom-up annotated 3D objects and spaces on the web , 2011, Web3D '11.

[8]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[9]  David Lo Buglio,et al.  Revealing shape semantics from morphological similarities of a collection of architectural elements: The case study of the columns of Saint-Michel de Cuxa , 2013, 2013 Digital Heritage International Congress (DigitalHeritage).

[10]  Jan Willem Drijvers,et al.  In Situ. Forma Urbis Romae. The Stanford Digital Forma Urbis Romae Project , 2014 .

[11]  Thomas A. Funkhouser,et al.  Distinctive regions of 3D surfaces , 2007, TOGS.

[12]  David B. Arnold,et al.  Web based presentation of semantically tagged 3D content for public sculptures and monuments in the UK , 2009, Web3D '09.

[13]  Daniel G. Aliaga,et al.  DECHO—a framework for the digital exploration of cultural heritage objects , 2011, JOCCH.

[14]  Karina Rodriguez-Echavarria,et al.  Web-based Exploration of Semantically Rich 3D Decorative Ornament , 2016, GCH.

[15]  Aaron Hertzmann,et al.  Learning 3D mesh segmentation and labeling , 2010, ACM Trans. Graph..

[16]  Daniel Cohen-Or,et al.  Contextual Part Analogies in 3D Objects , 2010, International Journal of Computer Vision.

[17]  Ralph R. Martin,et al.  Saliency-guided integration of multiple scans , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  A. E. Werner,et al.  THE INTERNATIONAL COUNCIL OF MUSEUMS , 1964 .

[19]  Martin Doerr,et al.  A Repository for 3D Model Production and Interpretation in Culture and Beyond , 2010, VAST.

[20]  Alexei A. Efros,et al.  What makes Paris look like Paris? , 2015, Commun. ACM.

[21]  Radu Horaud,et al.  SHREC '11: Robust Feature Detection and Description Benchmark , 2011, 3DOR@Eurographics.

[22]  Ayellet Tal,et al.  Surface Regions of Interest for Viewpoint Selection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Guillaume Lavoué,et al.  SHREC'12 Track: 3D Mesh Segmentation , 2012, 3DOR@Eurographics.

[24]  Umberto Castellani,et al.  Sparse points matching by combining 3D mesh saliency with statistical descriptors , 2008, Comput. Graph. Forum.

[25]  David W. Jacobs,et al.  Mesh saliency and human eye fixations , 2010, TAP.

[26]  Paul Barolsky.  The Art of Writing about Art , 2017, Source: Notes in the History of Art.

[27]  L. D. Luca.  3D Modelling and Semantic Enrichment in Cultural Heritage , 2013 .

[28]  Peter Phillips,et al.  Repeat Patterns: A Manual for Designers, Artists and Architects , 1992 .

[29]  Bjarki Valtysson.  EUROPEANA , 2012 .

[30]  Marco Attene,et al.  Semantic Annotation of 3D Surface Meshes Based on Feature Characterization , 2007, SAMT.

[31]  Leila De Floriani,et al.  Manual Segmentation and Semantic-based Hierarchical Tagging of 3D models , 2010, Eurographics Italian Chapter Conference.

[32]  Livio De Luca,et al.  A semantic-based platform for the digital analysis of architectural heritage , 2011, Comput. Graph..

[33]  Michael Garland,et al.  Surface simplification using quadric error metrics , 1997, SIGGRAPH.

[34]  Hong Qin,et al.  Admissible Diffusion Wavelets and Their Applications in Space-Frequency Processing , 2013, IEEE Transactions on Visualization and Computer Graphics.

[35]  David W. Jacobs,et al.  Mesh saliency , 2005, ACM Trans. Graph..

[36]  Jane Hunter,et al.  Harvesting community annotations on 3D models of museum artefacts to enhance knowledge, discovery and re-use , 2010 .

[37]  David B. Arnold,et al.  Semantically Rich 3D Documentation for the Preservation of Tangible Heritage , 2012, VAST.

[38]  Tamal K. Dey,et al.  Convergence, stability, and discrete approximation of Laplace spectra , 2010, SODA '10.

[39]  Aaron Hertzmann,et al.  Learning 3D mesh segmentation and labeling , 2010, SIGGRAPH 2010.

[40]  Martin Doerr,et al.  CRMdig: A Generic Digital Provenance Model for Scientific Observation , 2011, TaPP.

[41]  Antonio Torralba,et al.  SIFT Flow: Dense Correspondence across Scenes and Its Applications , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Alla Sheffer,et al.  Elements of style , 2015, ACM Trans. Graph..

[43]  Ariel Shamir,et al.  A survey on Mesh Segmentation Techniques , 2008, Comput. Graph. Forum.

[44]  Anthony Yezzi,et al.  A variational approach for viewpoint-based visibility maximization , 2008 .

[45]  Ralph R. Martin,et al.  Mesh saliency via spectral processing , 2014, ACM Trans. Graph..