On-line speaker adaptation based emotion recognition using incremental emotional information

This paper proposes a new Speech Emotion Recognition (SER) framework. Compared to the speaker-independent emotion models, speaker-adapted models constructed by using a speaker's emotional speech data can represent the speaker's emotional characteristics more precisely, thus improving SER accuracy. However, it is hard to collect a sufficient amount of personal emotional data at once. For this reason, we propose an MLLR-based online speaker adaptation technique using accumulated personal data. Compared to speech models, it is relatively difficult to construct reliable emotion models applicable to MLLR due to the domain-oriented characteristics. Thus, we modify the conventional MLLR procedure by using selective label refinement, which categorizes newly accumulated adaptation data into discriminative and non-discriminative data, and only refines the labels of the discriminative data. On SER experiments based on an LDC emotion corpus, our approach exhibited superior performance when compared to conventional adaptation techniques as well as the speaker-independent model framework.1