Immersive Display and Interactive Techniques for the Modeling and Rendering of Virtual Heritage Environments

In this paper we utilize some hybrid rendering techniques combining image-based, point-based and geometry-based technique for the modeling and display of immersive virtual heritage environments (VHEs). This paper also uses a generic computation method of indirect illumination based on Monte Carlo sampling and on the sequential analysis theory, which is faster and more automatic than classical methods.The resulting VHEs aim to realistically recreate archaeological site that can be displayed in a range of immersive VR systems using a high-quality, view-dependent algorithm, the observer can act just like the ancients by interacting with the objects of the scenes. The observers are able to participate to lumber or fish in VHEs. We implement a collaborative system platform based on multi-PC called Multipro, which provide a platform to display immersive application which can be extended to be used in the areas of urban planning/architecture and cultural heritage education. In order to display photo-realistic virtual environment we implement a prototype system which is implemented on the Multipro. In order to enhance realism of the virtual environment, we adopt a view-dependent texture mapping technique to rendering the heritage model, furthermore the interaction and animation also are included into Hemudu virtual scenes, finally the lighting , vegetation rendering and hybrid rendering are addressed for enhancing the sense of realism. Examples of the prototype system in use are described and demonstrated in this paper.

[1]  Marc Levoy,et al.  The Use of Points as a Display Primitive , 2000 .

[2]  Bernard Péroche,et al.  An Adaptive Method for Indirect Illumination Using Light Vectors , 2001, Comput. Graph. Forum.

[3]  David Salesin,et al.  Fast Rendering of Complex Environments Using a Spatial Hierarchy , 1996, Graphics Interface.

[4]  Craig Gotsman,et al.  Output‐SensitiveVisibility Algorithms for Dynamic Scenes with Applications to Virtual Reality , 1996, Comput. Graph. Forum.

[5]  Friedhelm Meyer auf der Heide,et al.  The randomized z-buffer algorithm: interactive rendering of highly complex scenes , 2001, SIGGRAPH.

[6]  S. Barab,et al.  Virtual solar system project: Building understanding through model building , 2000 .

[7]  Maria Roussou,et al.  XP: An Authoring System for Immersive Art Exhibitions , 1998 .

[8]  John R. Wilson,et al.  A front ended approach to the user-centred design of VEs , 2002, Proceedings IEEE Virtual Reality 2002.

[9]  Jens Herder,et al.  Optimization of Sound Spatialization Resource Management through Clustering , 1999 .

[10]  Yvonne Rogers,et al.  Designing for or designing with? Informant design for interactive learning environments , 1997, CHI.

[11]  Katja Bühler,et al.  Linear Interval Estimations for Parametric Objects Theory and Application , 2001, Comput. Graph. Forum.

[12]  David B. Shmoys,et al.  A Best Possible Heuristic for the k-Center Problem , 1985, Math. Oper. Res..

[13]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[14]  Yizhou Yu,et al.  Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping , 1998, Rendering Techniques.

[15]  Deborah Hix,et al.  User-Centered Design and Evaluation of Virtual Environments , 1999, IEEE Computer Graphics and Applications.

[16]  Lance Williams,et al.  Casting curved shadows on curved surfaces , 1978, SIGGRAPH.

[17]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[18]  Christina Vasilakis,et al.  Learning and Building Together in an Immersive Virtual World , 1999, Presence: Teleoperators & Virtual Environments.

[19]  Maria Roussou,et al.  Reviving the past: cultural heritage meets virtual reality , 2001, VAST '01.

[20]  B. Nardi.  Context and consciousness: activity theory and human-computer interaction , 1995 .

[21]  Daniel Västfjäll,et al.  Better Presence and Performance in Virtual Environments by Improved Binaural Sound Rendering , 2002 .

[22]  George Drettakis,et al.  Perceptual audio rendering of complex virtual environments , 2004, ACM Trans. Graph..

[23]  Peter Shirley,et al.  A practical analytic model for daylight , 1999, SIGGRAPH.

[24]  Thomas Funkhouser,et al.  Survey of Methods for Modeling Sound Propagation in Interactive Virtual Environment Systems , 2003 .

[25]  George Drettakis,et al.  Interactive Sampling and Rendering for Complex and Procedural Geometry , 2001, Rendering Techniques.

[26]  George Drettakis,et al.  Interactive visualization of complex plant ecosystems , 2002, IEEE Visualization, 2002. VIS 2002..

[27]  Nikos A. Vlassis,et al.  The global k-means clustering algorithm , 2003, Pattern Recognit..

[28]  Ronald R. Mourant,et al.  Human Factors Issues in Virtual Environments: A Review of the Literature , 1998, Presence.

[29]  George Drettakis,et al.  View-dependent layered projective texture maps , 2003, 11th Pacific Conference onComputer Graphics and Applications, 2003. Proceedings..

[30]  George Drettakis,et al.  Perspective shadow maps , 2002, ACM Trans. Graph..

[31]  Marc Levoy,et al.  QSplat: a multiresolution point rendering system for large meshes , 2000, SIGGRAPH.