A Novel EEG Based Directed Transfer Function for Investigating Human Perception to Audio Noise

Audio quality greatly affects users evaluation of multimedia communication, especially when the communication signal is disturbed, the noise in audio and video will decrease the quality of user experience. Psychophysiological indicators have high time resolution and precision, which can be used as important quality of experience characteristics. In this paper, electroencephalography is used as a psychophysiological method to assess brain connectivity in response to perceive the noise under different scenario. Specifically, we first record the response of the subjects' brainwaves to the audio quality using a high resolution electroencephalogram. Then, directed transfer function is used to analyze the directional information flow intensity between channels in the frequency domain, and 10% directed transfer function value are selected to construct the edge set of the directed graph to obtain the brain connectivity graph. Finally, the human perception to audio noise is obtained by using the weighted degree clustering method. In addition, the effectiveness of above results is verified by the small-world network coefficients experiment.

[1]  Sebastian Möller,et al.  Analyzing Speech Quality Perception Using Electroencephalography , 2012, IEEE Journal of Selected Topics in Signal Processing.

[2]  Salil H. Patel,et al.  Characterization of N200 and P300: Selected Studies of the Event-Related Potential , 2005, International journal of medical sciences.

[3]  Qian Zhang,et al.  End-to-End QoS for Video Delivery Over Wireless Internet , 2005, Proc. IEEE.

[4]  Luiz A. Baccalá,et al.  Partial directed coherence: a new concept in neural structure determination , 2001, Biological Cybernetics.

[5]  Sebastian Bosse,et al.  Psychophysiology-Based QoE Assessment: A Survey , 2017, IEEE Journal of Selected Topics in Signal Processing.

[6]  Sitzungsberichte der Königlich Preußischen Akademie der Wissenschaften , 2005, Naturwissenschaften.

[7]  S. Billings,et al.  Time-varying model identification for time–frequency feature extraction from EEG data , 2011, Journal of Neuroscience Methods.

[8]  Gabriel Curio,et al.  Using ERPs for assessing the (sub) conscious perception of noise , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[9]  LiKe,et al.  A multiwavelet-based time-varying model identification approach for time-frequency analysis of EEG signals , 2016 .

[10]  Karl J. Friston.  Functional and Effective Connectivity: A Review , 2011, Brain Connect..

[11]  Sebastian Möller,et al.  Effects of delay on perceived quality, behavior and oscillatory brain activity in dyadic telephone conversations , 2018, 2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX).

[12]  J. Polich.  Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[13]  Sigit Haryadi,et al.  Perceptual evaluation of speech quality over the top call service , 2017, 2017 3rd International Conference on Wireless and Telematics (ICWT).

[14]  Andreas Daffertshofer,et al.  Comparing Brain Networks of Different Size and Connectivity Density Using Graph Theory , 2010, PloS one.

[15]  Camila Loiola Brito Maia,et al.  A study about psychophysiological measures in user experience monitoring and evaluation , 2016, IHC.

[16]  Katarzyna J. Blinowska,et al.  A new method of the description of the information flow in the brain structures , 1991, Biological Cybernetics.

[17]  Seong-Eun Moon,et al.  Implicit Analysis of Perceptual Multimedia Experience Based on Physiological Response: A Review , 2017, IEEE Transactions on Multimedia.

[18]  Dong Ming,et al.  EEG Complexity and Functional Connectivity During Precise Timing Prediction* , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[19]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[20]  H. Adeli,et al.  Analysis of EEG records in an epileptic patient using wavelet transform , 2003, Journal of Neuroscience Methods.

[21]  M. Molinari,et al.  Brain–computer interface boosts motor imagery practice during stroke recovery , 2015, Annals of neurology.

[22]  Lea Skorin-Kapov,et al.  A Survey of Emerging Concepts and Challenges for QoE Management of Multimedia Services , 2018, ACM Trans. Multim. Comput. Commun. Appl..

[23]  Seong-Eun Moon,et al.  EEG Connectivity Analysis in Perception of Tone-mapped High Dynamic Range Videos , 2015, ACM Multimedia.

[24]  Yafeng Zhan,et al.  An EEG-Based Study on Perception of Video Distortion Under Various Content Motion Conditions , 2020, IEEE Transactions on Multimedia.