Narratology-Based Interaction Design of 3D Reconstructed Cultural Relics

Many museums have begun to pay attention to the application of the three-dimensional (3D) reconstruction technique for protecting and displaying the cultural heritage. This is because it can demonstrate the 3D shape of the relics with high precision and from multiple angles. However, a survey in China indicated that most museums only use this technique as an auxiliary display, and have not fully utilize interactive techniques to exert the benefits of digital 3D simulation. Based on the theory of narratology, this study proposed a narrative conceptual framework with 12 elements by analyzing the narratological features of 3D reconstructed cultural relics, and used this narratological framework to plan and complete a 3D interactive design. Thus narratology was used as a design thinking of interactive design, changing the technology-oriented thinking habitually used in digital design. And the narrative mode of 3D interaction was also enriched through this study.

[1]  Lawrence G. Roberts,et al.  Machine Perception of Three-Dimensional Solids , 1963, Outstanding Dissertations in the Computer Sciences.

[2]  R. Barthes Introduction à l'analyse structurale des récits , 1966 .

[3]  D Marr,et al.  A computational theory of human stereo vision. , 1979, Proceedings of the Royal Society of London. Series B, Biological sciences.

[4]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[5]  Ken-ichi Funahashi,et al.  On the approximate realization of continuous mappings by neural networks , 1989, Neural Networks.

[6]  Jonathan Steuer,et al.  Defining virtual reality: dimensions determining telepresence , 1992 .

[7]  Ralph R. Martin,et al.  Reverse engineering of geometric models - an introduction , 1997, Comput. Aided Des..

[8]  Marie-Laure Ryan,et al.  Narrative as Virtual Reality: Immersion and Interactivity in Literature and Electronic Media , 2000 .

[9]  H. Abbott The Cambridge Introduction to Narrative , 2020 .

[10]  Raúl Cid,et al.  Group Interaction and VR Storytelling in Museums , 2003, International Conference on Virtual Storytelling.

[11]  Don Carson Environmental Storytelling: Creating Immersive 3D Worlds Using Lessons Learned from the Theme Park industry , 2004 .

[12]  R. Aylett AND THEY BOTH LIVED HAPPILY EVER AFTER , 2005 .

[13]  Francesca Odone,et al.  An open system for 3D data acquisition from multiple sensor , 2005, Seventh International Workshop on Computer Architecture for Machine Perception (CAMP'05).

[14]  N. D. Blas,et al.  3D for Cultural Heritage and Education: Evaluating the Impact , 2006 .

[15]  Li De-ren The Application of Virtual Reality Technology to Cultural Heritage Protection , 2008 .

[16]  Massimo Bergamasco,et al.  Beyond virtual museums: experiencing immersive virtual reality in real museums , 2010 .

[17]  Matthew O'Toole,et al.  3D Shape and Indirect Appearance by Structured Light Transport , 2014, CVPR.