A Framework of a Speech Communication System with Emotion Processing

In this paper, We proposed the speech communication system with emotion processing. Our system speaks a given document emotionally based on emotion extracted from speech and text. The difference point between our system and a speech dialogue system is to process emotion. When this system speaks given documents, it uses rules made from speech techniques and the analysis result of professional acting. In order to select these rules, the system extracts emotion from a document and speech. To extract emotion from a document, it uses a word emotion dictionary which shows similarity between a word and a basic emotion word in a concept hierarchy. To extract emotion from speech, it uses a speech emotion database based on the analysis result of speech. This system connects speech synthesize technique with emotion estimation technique. Now we are developing this system. After developing them, we should evaluate the effectiveness of these modules by experiments.