Quasi–Mixed Reality in Digital Cultural Heritage. Combining 3D Reconstructions with Real Structures on Location—The Case of Ancient Phalasarna

Traditional Mixed Reality as it is currently experienced on popular mobile devices has its obvious limitations in the context of Cultural Heritage. Neither the sensor fusion approach nor the pattern recognition solutions are precise or stable enough to provide a satisfactory visual match between the live video feed and the graphical layer of digital information. The fundamental incompatibility between 2D live video and dynamic 3D graphics also makes this a short–lived solution in a long–range perspective. While we are waiting for sustainable solutions for real time 3D capture and display on mobile and wearable devices it is pertinent to employ and evaluate transitional alternatives for effective use on location . In the research and development reported here we created a static 3D version of the current archaeological site based on photogrammetry. This is done in order to test how it may serve as an intermediate level of representation for increased precision when combining the real present with the reconstructed past. In this chapter we present and discuss the experiences we have gained exploring this type of Indirect Augmented Reality, which we have named ‘Quasi–Mixed Reality’, on location at the archaeological site of Ancient Phalasarna on western Crete.

[1]  Claus B. Madsen,et al.  An interactive visualization of the past using a situated simulation approach , 2013, 2013 Digital Heritage International Congress (DigitalHeritage).

[2]  Dimitris Samaras,et al.  EyeOpener: Editing Eyes in the Wild , 2017, ACM Trans. Graph..

[3]  Blair MacIntyre,et al.  Integrating 2-D Video Actors into 3-D Augmented-Reality Systems , 2002, Presence: Teleoperators & Virtual Environments.

[4]  Andrew Morrison,et al.  Views, alignment and incongruity in indirect augmented reality , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH).

[5]  Gunnar Liestøl,et al.  Along the Appian Way. Storytelling and Memory across Time and Space in Mobile Augmented Reality , 2014, EuroMed.

[6]  Gunnar Liestøl,et al.  Mobile innovation: designing and evaluating situated simulations , 2011, Digit. Creativity.

[7]  E. Hadjidaki Preliminary Report of Excavations at the Harbor of Phalasarna in West Crete , 1988, American Journal of Archaeology.

[8]  Stéphane Côté,et al.  Live mobile panoramic high accuracy augmented reality for engineering and construction , 2013 .

[9]  Yun-Ta Tsai,et al.  Indirect augmented reality , 2011, Comput. Graph..

[10]  Blair MacIntyre,et al.  Media studies, mobile augmented reality, and interaction design , 2013, INTR.

[11]  Matthias Nießner,et al.  BundleFusion , 2016, TOGS.

[12]  Blair MacIntyre,et al.  Ghosts in the Machine: Integrating 2D Video Actors into a 3D AR System , 2001 .