论文信息 - An exploratory study of manifolds of emotional speech

An exploratory study of manifolds of emotional speech

This study explores manifold representations of emotionally modulated speech. The manifolds are derived in the articulatory space and two acoustic spaces (MFB and MFCC) using isometric feature mapping (Isomap) with data from an emotional speech corpus. Their effectiveness in representing emotional speech is tested based on the emotion classification accuracy. Results show that the effective manifold dimensions of the articulatory and MFB spaces are both about 5 while being greater in MFCC space. Also, the accuracies in the articulatory and MFB manifolds are close to those in the original spaces, but this is not the case for the MFCC. It is speculated that the manifold in the MFCC space is less structured, or more distorted, than others.

Shrikanth S. Narayanan | Sungbok Lee | Jangwon Kim | Jangwon Kim | Sungbok Lee

[1] Donna Erickson,et al. Some articulatory measurements of real sadness , 2004, INTERSPEECH.

[2] Aren Jansen,et al. Intrinsic Fourier Analysis on the Manifold of Speech Sounds , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[3] Zhigang Deng,et al. Emotion recognition based on phoneme classes , 2004, INTERSPEECH.

[4] Y. Attikiouzel,et al. Dimension and structure of the speech space , 1992 .

[5] Shrikanth S. Narayanan,et al. Analysis of emotional speech prosody in terms of part of speech tags , 2007, INTERSPEECH.

[6] Shrikanth S. Narayanan,et al. An articulatory study of emotional speech production , 2005, INTERSPEECH.

[7] Andrew Errity,et al. Manifold Learning-Based Feature Transformation for Phone Classification , 2007, NOLISP.

[8] Joshua B. Tenenbaum,et al. Global Versus Local Methods in Nonlinear Dimensionality Reduction , 2002, NIPS.

[9] J. Tenenbaum,et al. A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[10] X. Zhang,et al. Mining the structural knowledge of high-dimensional medical data using isomap , 2006, Medical and Biological Engineering and Computing.