Randomized psychoacoustic model for mobile, panoramic, heritage-viewing applications

In preservation of heritage, lately there has been a phenomenal growth in digital audio preservation. A well-preserved virtual heritage does not include only the visual images of the heritage sites, but should ideally include also the audio surroundings of the heritage site that are incorporated into the virtual heritage applications as a whole. An acoustical heritage comprises the audio elements which surround the heritage sites. Psychoacoustic heritage is the extra significant psychological audio characteristic that adds to the surroundings of the heritage sites. In this paper, a randomized psychoacoustic model is proposed in 360° panoramic view on mobile platform. User interaction using multi-gesture tap is vital in delivering the psychoacoustic effects to the user. The contribution and the novelty of this research is in proposing and deploying a new psychoacoustic model mainly for the environment of 360° panoramic view in virtual heritage. In the proposed model, audio interaction design includes the changes in acoustical characteristics such as amplitude, frequency as well as the velocity within the various balanced panorama's azimuthal zones. Simulations have been carried out on a model of the Town Hall, one of the UNESCO heritage sites in George Town, Penang, Malaysia. The experimental data sets are also collected and have been found to produce promising psychoacoustic effects in panoramic view.

[1]  Filipe Costa Luz,et al.  Robosonic: Randomness-Based Manipulation of Sounds Assisted by Robots , 2009, INTETAIN.

[2]  Abdullah Zawawi Talib,et al.  Low-Cost Methods for Generating Panoramic Views for a Mobile Virtual Heritage Application and its Application to the Heritage Zone of George Town Malaysia , 2011, Int. J. E Entrepreneurship Innov..

[3]  Ana Paiva,et al.  Mediating Action and Background Music , 2003, International Conference on Virtual Storytelling.

[4]  Mads Haahr,et al.  Design, implementation and evaluation of audio for a location aware augmented reality game , 2010, Fun and Games '10.

[5]  Nurgun Erdol,et al.  An Exploration of Sampling Phenomena Using the Iphone , 2009, 2009 IEEE 13th Digital Signal Processing Workshop and 5th IEEE Signal Processing Education Workshop.

[7]  E. Carillo,et al.  Making history alive and interactive: Designing an iPhone App to present the Summer War of Osaka byōbu , 2010, 2010 16th International Conference on Virtual Systems and Multimedia.

[8]  David J. M. Robinson,et al.  Psychoacoustic Models and Non-Linear Human Hearing , 2000 .

[9]  Nicolas Tsingos,et al.  Acoustic Rendering and Auditory–Visual Cross‐Modal Perception and Interaction , 2012, Comput. Graph. Forum.

[10]  Abdullah Zawawi Talib,et al.  A Low-Cost Method for Generating Panoramic Views for a Mobile Virtual Heritage Application , 2011, DEIS.

[11]  M. Ismail,et al.  Sounds from the Past the Acoustics of Sultan Hassan Mosque and Madrasa , 2007 .

[12]  Lamberto Tronchin,et al.  Advanced techniques for the determination of sound spatialization in italian opera theatres , 2008 .

[13]  Tekla Perry.  The iphone's music man , 2009, IEEE Spectrum.

[14]  Christophe Beaugeant,et al.  Audio-Enhanced Panoramic Image Capturing and Rendering on Mobile Devices , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[15]  Frans Mäyrä,et al.  Designing sound for a pervasive mobile game , 2005, ACE '05.

[16]  Maria Ebling,et al.  Family Connections , 2010, IEEE Pervasive Computing.

[17]  Nadia Magnenat-Thalmann,et al.  REAL-TIME RECREATED CEREMONIES IN VR RESTITUTED CULTURAL HERITAGE SITES , 2003 .

[18]  Abdullah Zawawi Talib,et al.  Acoustical heritage for virtual tourism on mobile platform , 2011, Proceeding of the International Conference on e-Education, Entertainment and e-Management.