HCI and Natural Progression of Context-Related Questions

The ability of humans to effectively interact socially relies heavily on their awareness of the context the interaction takes place. In order for computer systems to accordingly possess the same ability, it is crucial they are also context-aware in terms of a formalization of context based on the W5+ framework aspects of Who, What, Why, Where, What and How. Research work presented in this paper contributes towards this goal by bridging the conceptual gap and exploiting semantics and cognitive and affective information of non verbal behavior and investigating whether and how this information could be incorporated in automatic analysis of affective behavior. A semantic concept extraction methodology is proposed and its application to indicative examples from the SEMAINE corpus is presented that validates the proposed approach.

[1]  Christian D. Schunn,et al.  Integrating perceptual and cognitive modeling for adaptive and intelligent human-computer interaction , 2002, Proc. IEEE.

[2]  Jane Yung-jen Hsu,et al.  Building a Concept-Level Sentiment Dictionary Based on Commonsense Knowledge , 2013, IEEE Intelligent Systems.

[3]  Bing Liu,et al.  Sentiment Analysis and Opinion Mining , 2012, Synthesis Lectures on Human Language Technologies.

[4]  Rajendra Akerkar,et al.  Big Data Computing , 2013 .

[5]  Maja Pantic,et al.  Social signal processing: Survey of an emerging domain , 2009, Image Vis. Comput..

[6]  J. M. Carroll,et al.  Do facial expressions signal specific emotions? Judging emotion from the face in context. , 1996, Journal of personality and social psychology.

[7]  P. Wilson,et al.  The Nature of Emotions , 2012 .

[8]  Andrea Esuli,et al.  SENTIWORDNET: A Publicly Available Lexical Resource for Opinion Mining , 2006, LREC.

[9]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[10]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Caridakis,et al.  Body gesture and facial expression analysis for automatic affect recognition , 2010 .

[12]  J. Russell.  Affective space is bipolar. , 1979 .

[13]  Cynthia Whissell,et al.  THE DICTIONARY OF AFFECT IN LANGUAGE , 1989 .

[14]  Björn W. Schuller,et al.  Categorical and dimensional affect analysis in continuous input: Current trends and future directions , 2013, Image Vis. Comput..

[15]  Maja Pantic,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING , 2022 .

[16]  Harold Knudsen,et al.  The effects of verbal statements of context on facial expressions of emotion , 1983 .

[17]  M. Bradley,et al.  Affective Norms for English Words (ANEW): Instruction Manual and Affective Ratings , 1999 .

[18]  Simeon Keates,et al.  Temporal context and the recognition of emotion from facial expression , 2003 .

[19]  Stefanos D. Kollias,et al.  Investigating Context Awareness of Affective Computing Systems: A Critical Approach , 2014, IHCI.

[20]  Carlo Strapparava,et al.  WordNet Affect: an Affective Extension of WordNet , 2004, LREC.

[21]  Stefanos D. Kollias,et al.  Context in Affective Multiparty and Multimodal Interaction: Why, Which, How and Where? , 2014, UM3I '14.

[22]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[23]  R. Plutchik.  Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice , 2016 .

[24]  Erik Cambria,et al.  SenticSpace: Visualizing Opinions and Sentiments in a Multi-dimensional Vector Space , 2010, KES.

[25]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[26]  Peter J. Brown,et al.  Context-aware applications: from the laboratory to the marketplace , 1997, IEEE Wirel. Commun..

[27]  B. Mesquita,et al.  Placing the face in context: cultural differences in the perception of facial emotion. , 2008, Journal of personality and social psychology.

[28]  Klaus R. Scherer,et al.  Advocating a Componential Appraisal Model to Guide Emotion Recognition , 2012, Int. J. Synth. Emot..

[29]  Ingo Siegert,et al.  Annotation and Classification of Changes of Involvement in Group Conversation , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.