Remote Diagnosis of Architectural Heritage Based on 5W1H Model-Based Metadata in Virtual Reality

We propose a framework based on the 5W1H model-based metadata for remote diagnosis in virtual reality (VR). For this purpose, we suggest unique metadata composed of Point of Interest (POI)-extended anchor (xAnchor)-content for a context-aware service in virtual and augmented reality. We define the attributes of the metadata based on the 5W1H context for information retrieval according to the context in a remote diagnosis. Second, we propose the ontology-based linker metadata that express the relations between AR scenes and that retrieve external information. Moreover, we suggest heritage building information metadata for information retrieval according to context. For evaluation, we created a geo-tagged content tool and a remote diagnosis VR application. We conducted focus-group interviews and heuristic evaluations for remote diagnosis in VR to verify the methodology of this study. As a result, we found that experts were most satisfied with the functions that provide the contextualized information. This study contributes to the geospatial metadata for a context-aware service in VR/AR as well as the remote diagnosis framework to overcome the time-consuming problem of the existing remote diagnosis.

[1]  Filiberto Chiabrando,et al.  HISTORICAL BUILDINGS MODELS AND THEIR HANDLING VIA 3D SURVEY: FROM POINTS CLOUDS TO USER-ORIENTED HBIM , 2016 .

[2]  Jongwook Lee,et al.  Context-aware risk management for architectural heritage using historic building information modeling and virtual reality , 2019, Journal of Cultural Heritage.

[3]  Francisco J. Perales López,et al.  New Trends in Using Augmented Reality Apps for Smart City Contexts , 2018, ISPRS Int. J. Geo Inf..

[4]  김혜진,et al.  CAMAR 2.0: User-driven Context-aware Mobile Augmented Reality , 2009 .

[5]  O P Forattini [Who, where, when, what and why?]. , 1996, Revista de saude publica.

[6]  Jan Boehm,et al.  Jeddah Historical Building Information Modelling "JHBIM" – Object Library , 2014 .

[7]  Fabio Bruno,et al.  From 3D reconstruction to virtual reality: A complete methodology for digital archaeological exhibition , 2010 .

[8]  Anna Osello,et al.  HBIM and Virtual Tools: A New Chance to Preserve Architectural Heritage , 2018 .

[9]  Martin Lechner ARML 2.0 in the context of existing AR data formats , 2013, 2013 6th Workshop on Software Engineering and Architectures for Realtime Interactive Systems (SEARIS).

[10]  Pieter Pauwels,et al.  Interpreting Metadata and Ontologies of Virtual Heritage Artefacts , 2014 .

[11]  Woontack Woo,et al.  Unified User-Centric Context: Who, Where, When, What, How and Why , 2005, ubiPCMM.

[12]  Nelson Alves,et al.  Heritage BIM integration with mixed reality for building preventive maintenance , 2017, 2017 24º Encontro Português de Computação Gráfica e Interação (EPCGI).

[13]  C. Battini,et al.  HBIM TO VR. SEMANTIC AWARENESS AND DATA ENRICHMENT INTEROPERABILITY FOR PARAMETRIC LIBRARIES OF HISTORICAL ARCHITECTURE , 2018 .

[14]  J. de la Fuente Prieto,et al.  AUGMENTED REALITY IN ARCHITECTURE: REBUILDING ARCHEOLOGICAL HERITAGE , 2017 .

[15]  Cettina Santagati,et al.  Cultural Heritage Documentation, Analysis and Management Using Building Information Modelling: State of the Art and Perspectives , 2018 .

[16]  Nikolaos D. Hasanagas,et al.  Metadata-based heritage sites modeling with e-learning functionality , 2009 .

[17]  Woontack Woo,et al.  Metadata schema for context-aware augmented reality applications in cultural heritage domain , 2015, 2015 Digital Heritage.

[18]  S. M. Zabed Ahmed A comparison of usability techniques for evaluating information retrieval system interfaces , 2008 .

[19]  Alexander Klippel,et al.  Immersive Technologies and Experiences for Archaeological Site Exploration and Analysis , 2017, COSIT.

[20]  Daniela Oreni,et al.  Survey, Hbim and Conservation Plan of a Monumental Building Damaged by Earthquake , 2017 .

[21]  Luigi Barazzetti,et al.  Historic BIM for Mobile VR/AR Applications , 2017, Mixed Reality and Gamification for Cultural Heritage.

[22]  Diane Kelly,et al.  Methods for Evaluating Interactive Information Retrieval Systems with Users , 2009, Found. Trends Inf. Retr..

[23]  Luigi Fregonese,et al.  Survey and modelling for the bim of Basilica of San Marco in Venice , 2017 .

[24]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[25]  Italo Spada,et al.  Lorusso_Conservation 15_CS5.indd , 2016 .