Determination and validation of mix parameters for modifying envelopment in object-based audio

Envelopment is an important attribute of listener preference for spatial audio reproduction. Object-based audio offers the possibility of altering the rendering of an audio scene in order to modify or maintain perceptual attributes - including envelopment - if the relationships between attributes and mix parameters are known. In a method of adjustment experiment, mixing engineers were asked to produce mixes of four program items at low, medium, and high levels of envelopment, in 2-channel, 5-channel, and 22-channel reproduction systems. The participants could vary a range of level, position, and equalization parameters that can be modified in object-based audio systems. The parameters could be varied separately for different semantic object categories. Nine parameters were found to have significant relationships with envelopment; parameters relating to the horizontal and vertical spread of sources were shown to be most important. A follow-on experiment demonstrated that these parameters can be adjusted to produce a range of envelopment levels in other program items.

[1]  Robert Oldfield,et al.  Automatic Mixing and Tracking of On-Pitch Football Action for Television Broadcasts , 2011 .

[2]  Frank Melchior,et al.  Object-Based Reverberation for Spatial Audio , 2017 .

[3]  David Griesinger.  OBJECTIVE MEASURES OF SPACIOUSNESS AND ENVELOPMENT , 1999 .

[4]  Tim Brookes,et al.  PERCEPTUAL EVALUATION OF SPATIAL AUDIO : WHERE NEXT ? , 2015 .

[5]  Ulli Scuda,et al.  Using Audio Objects and Spatial Audio in Sports Broadcasting , 2015 .

[6]  Graham Thomas,et al.  State‐of‐the‐Art and Challenges in Media Production, Broadcast and Delivery , 2014 .

[7]  Ulli Scuda,et al.  Producing Interactive Immersive Sound for MPEG-H: A Field Test for Sports Broadcasting , 2014 .

[8]  Tim Brookes,et al.  Evaluation of spatial audio reproduction methods (part 2) : analysis of listener preference , 2017 .

[9]  G. A. Soulodre,et al.  LISTENER ENVELOPMENT : AN ESSENTIAL PART OF GOOD CONCER HALL ACOUSTICS , 1996 .

[10]  Jonathan Hirst,et al.  Investigation into the Impact of 3D Surround Systems on Envelopment , 2014 .

[11]  John S. Bradley,et al.  The influence of late arriving energy on spatial impression , 1995 .

[12]  Jean-Marc Jot,et al.  Dialog Control and Enhancement in Object-Based Audio Systems , 2015 .

[13]  Martin Dewhirst,et al.  Modelling Perceived Spatial Attributes of Reproduced Sound , 2008 .

[14]  G. A. Soulodre,et al.  Objective measures of listener envelopment , 1995 .

[15]  Tim Brookes,et al.  Production and Reproduction of Program Material for a Variety of Spatial Audio Formats , 2015 .

[16]  Francis Rumsey,et al.  Envelopment: What is it? A definition for multichannel audio , 2007 .

[17]  Frank Melchior,et al.  Presenting the S3A object-based audio drama dataset , 2016 .

[18]  Frank Melchior,et al.  Object-Based 3D Audio Production for Virtual Reality Using the Audio Definition Model , 2016 .

[19]  John S. Bradley,et al.  Acoustics 1995: Listener envelopment: An essential part of good concert hall acoustics , 1996 .

[20]  Tim Brookes,et al.  Evaluation of Spatial Audio Reproduction Methods (Part 1): Elicitation of Perceptual Differences , 2017 .

[21]  Francis Rumsey,et al.  Development and Validation of an Unintrusive Model for Predicting the Sensation of Envelopment Arising from Surround Sound Recordings , 2011 .

[22]  Frank Melchior,et al.  Categorization of broadcast audio objects in complex auditory scenes , 2016 .

[23]  Kazuhiro Iida,et al.  A practical evaluation method of auditory source width in concert halls , 1995 .

[24]  Russell Mason.  Installation of a Flexible 3D Audio Reproduction System into a Standardized Listening Room , 2016 .

[25]  Frank Melchior,et al.  An Audio-Visual System for Object-Based Audio: From Recording to Listening , 2018, IEEE Transactions on Multimedia.

[26]  Jens Spille,et al.  Object-based audio for interactive football broadcast , 2013, Multimedia Tools and Applications.

[27]  Kazuhiro Iida,et al.  Effects of front/back energy ratios of early and late reflections on listener envelopment , 1998 .

[28]  Ville Pulkki,et al.  Virtual Sound Source Positioning Using Vector Base Amplitude Panning , 1997 .

[29]  David Griesinger,et al.  The Importance of the Direct to Reverberant Ratio in the Perception of Distance, Localization, Clarity, and Envelopment , 2009 .

[30]  Johannes Nowak,et al.  Perception and prediction of apparent source width and listener envelopment in binaural spherical microphone array auralizations. , 2017, The Journal of the Acoustical Society of America.

[31]  Robert Conetta,et al.  Towards the automatic assessment of spatial quality in the reproduced sound environment , 2011 .

[32]  L. Infante,et al.  Hierarchical Clustering , 2020, International Encyclopedia of Statistical Science.

[33]  Francis Rumsey,et al.  On the relative importance of spatial and timbral fidelities in judgments of degraded multichannel audio quality. , 2005, The Journal of the Acoustical Society of America.

[34]  Alexander Lindau,et al.  Deriving content-specific measures of room acoustic perception using a binaural, nonlinear auditory model. , 2013, The Journal of the Acoustical Society of America.

[35]  Francis Rumsey,et al.  Spatial quality evaluation for reproduced sound: terminology, meaning and a scene-based paradigm , 2002 .

[36]  J Blauert,et al.  Auditory spaciousness: some further psychoacoustic analyses. , 1986, The Journal of the Acoustical Society of America.

[37]  Ben. Supper.  An Onset-Guided Spatial Analyser For Binaural Audio. , 2005 .

[38]  Frank Melchior,et al.  Elicitation of Expert Knowledge to Inform Object-Based Audio Rendering to Different Systems , 2018 .