Application of an Ontology-Based Platform for Developing Affective Interaction Systems

Computer systems need to have sufficient ability and intelligence to communicate with people. To this end, they have to be able to interpret or to manage certain types of information that people are used to perceiving in human communications, such as speech modulation, facial expression, and so on taking human emotions into account. The ontology-based platform proposed in this paper attempts to support the development of resources that need to take emotion transmission into account, especially in communication between users and interactive systems. To this end, the factors relevant to the transmission of affective states have been studied and included in an ontology. Based on this ontology, a platform was created to guide the development of emotional resources that provide users with more natural interfaces. Finally, an interactive multimodal system was created to validate the proposed ontology-based platform and to apply the study to real-life cases.

[1]  P. Ekman.  Expression and the Nature of Emotion , 1984 .

[2]  Rosa Gil,et al.  Towards an Ontology for Describing Emotions , 2008, WSKS.

[3]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[4]  Aurobinda Routray,et al.  A Multimodal System for Assessing Alertness Levels Due to Cognitive Loading , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  Ayse Göker,et al.  User Context and Personalisation , 2002, ECCBR Workshops.

[6]  Idoia Cearreta,et al.  Applying the Affinto Ontology to Develop a Text-Based Emotional Conversation System , 2011, INTERACT.

[7]  Asunción Gómez-Pérez,et al.  Ontological Engineering: With Examples from the Areas of Knowledge Management, e-Commerce and the Semantic Web , 2004, Advanced Information and Knowledge Processing.

[8]  P. Lang.  The emotion probe. Studies of motivation and attention. , 1995, The American psychologist.

[9]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[10]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[11]  Roland Göcke,et al.  A multimodal system to characterise melancholia: cascaded bag of words approach , 2017, ICMI.

[12]  H. Schlosberg.  Three dimensions of emotion. , 1954, Psychological review.

[13]  P. White.  Appraisal Theory , 2015 .

[14]  M. Bradley,et al.  Affective Normsfor English Words (ANEW): Stimuli, instruction manual and affective ratings (Tech Report C-1) , 1999 .

[15]  Idoia Cearreta,et al.  Toward Adapting Interactions by Considering User Emotions and Capabilities , 2011, HCI.

[16]  Tanya J. McGill,et al.  Affective Stack - A Model for Affective Computing Application Development , 2015, J. Softw..

[17]  Oudeyer Pierre-Yves,et al.  The production and recognition of emotions in speech: features and algorithms , 2003 .

[18]  Roddy Cowie,et al.  Acoustic correlates of emotion dimensions in view of speech synthesis , 2001, INTERSPEECH.

[19]  A. Tellegen.  Structures of Mood and Personality and Their Relevance to Assessing Anxiety, With an Emphasis on Self-Report , 2019, Anxiety and the Anxiety Disorders.

[20]  Anca Rarau,et al.  Ontology Based Affective Context Representation , 2007, EATIS '07.

[21]  Mansour Sheikhan,et al.  Speech emotion recognition using FCBF feature selection method and GA-optimized fuzzy ARTMAP neural network , 2011, Neural Computing and Applications.

[22]  W. Marsden.  I and J , 2012 .

[23]  C. Wickens.  Engineering psychology and human performance, 2nd ed. , 1992 .