Headphone and Head-Mounted Visual Displays for Virtual Environments

A realistic auditory environment can contribute to both the overall subjective sense of presence in a virtual display, and to a quantitative metric predicting human performance. Here, the role of audio in a virtual display and the importance of auditory-visual interaction are examined. Conjectures are proposed regarding the effectiveness of audio compared to visual information for creating a sensation of immersion, the frame of reference within a virtual display, and the compensation of visual fidelity by supplying auditory information. Future areas of research are outlined for improving simulations of virtual visual and acoustic spaces. This paper will describe some of the intersensory phenomena that arise during operator interaction within combined visual and auditory virtual environments. Conjectures regarding audio-visual interaction will be proposed.

[1]  Durand R. Begault,et al.  Octave-Band Thresholds for Modeled Reverberant Fields , 1998 .

[2]  J. Blauert.  Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[3]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[4]  Stephen R. Ellis,et al.  Presence of Mind:A Reaction to Thomas Sheridan's Further Musings on the Psychophysics of Presence , 1996, Presence: Teleoperators & Virtual Environments.

[5]  George E. Cooper,et al.  The use of pilot rating in the evaluation of aircraft handling qualities , 1969 .

[6]  Scott S. Fisher,et al.  A system for three-dimensional acoustic 'visualization' in a virtual environment workstation , 1990, Proceedings of the First IEEE Conference on Visualization: Visualization `90.

[7]  R. Welch.  Perceptual Modification: Adapting to Altered Sensory Environments , 1978 .

[8]  Bernard D. Adelstein,et al.  In Search of Equivalence Classes in Subjective Scales of Reality , 1997, HCI.

[9]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[10]  Durand R. Begault,et al.  Perceptual Effects of Synthetic Reverberation on Three-Dimensional Audio Systems , 1992 .

[11]  Heinrich Hertz,et al.  On the differences between localization and lateralization. , 1974, The Journal of the Acoustical Society of America.

[12]  E. Wenzel.  The relative contribution of interaural time and magnitude cues to dynamic sound localization , 1995, Proceedings of 1995 Workshop on Applications of Signal Processing to Audio and Accoustics.

[13]  William A. Yost,et al.  Spatial hearing: The psychophysics of human sound localization, revised edition , 1998 .

[14]  Cynthia H. Null,et al.  Effectiveness of Interaural Delays Alone as Cues During Dynamic Sound Localization , 1996 .

[15]  Durand R. Begault,et al.  Virtual Acoustics: Evaluation of Psychoacoustic Parameters , 1997 .

[16]  L. Vriens,et al.  The Difference Between , 2018 .