Spoken dialog summarization system with HAPPINESS/SUFFERING factor recognition

This work presents a spoken dialog summarization system with HAPPINESS/SUFFERING factor recognition. The semantic content is compressed and classified by factor categories from spoken dialog. The transcription of automatic speech recognition is then processed through Chinese Knowledge and Information Processing segmentation system. The proposed system also adopts the part-of-speech tags to effectively select and rank the keywords. Finally, the HAPPINESS/SUFFERING factor recognition is done by the proposed point-wise mutual information. Compared with the original method, the performance is improved by applying the significant scores of keywords. The experimental results show that the average precision rate for factor recognition in outside test can reach 73.5% which demonstrates the possibility and potential of the proposed system.

[1]  Fei Liu,et al.  A Supervised Framework for Keyword Extraction From Meeting Transcripts , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[2]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[3]  Bin Wu,et al.  Automatic Keyword Extraction Using Linguistic Features , 2006, Sixth IEEE International Conference on Data Mining - Workshops (ICDMW'06).

[4]  J. Mikels,et al.  Characterization of the Affective Norms for English Words by discrete emotional categories , 2007, Behavior research methods.

[5]  Chung-Hsien Wu,et al.  Spoken document summarization using acoustic, prosodic and semantic information , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[6]  Fei Liu,et al.  Towards Abstractive Speech Summarization: Exploring Unsupervised and Supervised Approaches for Spoken Utterance Compression , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[7]  Chung-Hsien Wu,et al.  Spoken Document Retrieval Using Multilevel Knowledge and Semantic Verification , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[8]  Daniel J. Olsher.  Full spectrum opinion mining: integrating domain, syntactic and lexical knowledge , 2012, 2012 IEEE 12th International Conference on Data Mining Workshops.

[9]  Hui Jiao,et al.  Chinese Keyword Extraction Based on N-Gram and Word Co-occurrence , 2007, 2007 International Conference on Computational Intelligence and Security Workshops (CISW 2007).

[10]  Ashutosh Dixit,et al.  A novel statistical and linguistic features based technique for keyword extraction , 2014, 2014 International Conference on Information Systems and Computer Networks (ISCON).

[11]  Ying Qin.  Applying frequency and location information to keyword extraction in single document , 2012, 2012 IEEE 2nd International Conference on Cloud Computing and Intelligence Systems.

[12]  Shashidhar G. Koolagudi,et al.  Speech Emotion Recognition Using Segmental Level Prosodic Analysis , 2011, 2011 International Conference on Devices and Communications (ICDeCom).

[13]  Jhing-Fa Wang,et al.  Emotion-Aware Assistive System for Humanistic Care Based on the Orange Computing Concept , 2012, Appl. Comput. Intell. Soft Comput..

[14]  Chung-Hsien Wu,et al.  Emotion Recognition of Affective Speech Based on Multiple Classifiers Using Acoustic-Prosodic Information and Semantic Labels , 2015, IEEE Transactions on Affective Computing.

[15]  Francesco Piazza,et al.  Sentic Web: A New Paradigm for Managing Social Media Affective Information , 2011, Cognitive Computation.

[16]  Jeong-Sik Park,et al.  Multistage utterance verification for keyword recognition-based online spoken content retrieval , 2012, IEEE Transactions on Consumer Electronics.

[17]  Mohiuddin Ahmad,et al.  Human emotion modeling based on salient global features of EEG signal , 2013, 2013 2nd International Conference on Advances in Electrical Engineering (ICAEE).

[18]  Yu Huang,et al.  Spoken Knowledge Organization by Semantic Structuring and a Prototype Course Lecture System for Personalized Learning , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[19]  Jhing-Fa Wang,et al.  A real-time awareness system for happiness expression based on the multilayer histogram of oriented gradients , 2012, 4th International Conference on Awareness Science and Technology.

[20]  Rafael Dueire Lins,et al.  A Four Dimension Graph Model for Automatic Text Summarization , 2013, 2013 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT).

[21]  Yang Liu,et al.  Using N-Best Lists and Confusion Networks for Meeting Summarization , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[22]  Pranita Jain,et al.  Text summarization using enhanced MMR technique , 2014, 2014 International Conference on Computer Communication and Informatics.

[23]  Björn W. Schuller,et al.  New Avenues in Opinion Mining and Sentiment Analysis , 2013, IEEE Intelligent Systems.

[24]  Christian Wartena,et al.  Keyword Extraction Using Word Co-occurrence , 2010, 2010 Workshops on Database and Expert Systems Applications.

[25]  Sun-Yuan Kung,et al.  Support vector analysis of large-scale data based on kernels with iteratively increasing order , 2015, The Journal of Supercomputing.

[26]  Wen Ji,et al.  Intelligent Marketing in Smart Cities: Crowdsourced Data for Geo-Conquesting , 2016, IT Professional.

[27]  Bernard Mérialdo,et al.  Multi-video summarization based on Video-MMR , 2010, 11th International Workshop on Image Analysis for Multimedia Interactive Services WIAMIS 10.