Social signals: from theory to applications

The Special Issue Editorial introduces the research milieu in which Social Signal Processing originates, by merging computer scientists and social scientists and giving rise to this field in parallel with Human–Computer Interaction, Affective Computing, and Embodied Conversational Agents, all similarly characterized by high interdisciplinarity, stress on multimodality of communication, and the continuous loop from theory to simulation and application. Some frameworks of the cognitive and social processes underlying social signals are identified as reference points (Theory of Mind and Intersubjectivity, mirror neurons, and the ontogenesis and phylogenesis of communication), while three dichotomies (automatic vs. controlled, individualistic vs. intersubjective, and meaning vs. influence) are singled out as leads to navigate within the theoretical and applicative studies presented in the Special Issue.

[1]  Klaus R. Scherer,et al.  A psycho-ethological approach to social signal processing , 2012, Cognitive Processing.

[2]  A. Luchins.  Forming impressions of personality; a critique. , 1948, Journal of abnormal psychology.

[3]  M. Iacoboni,et al.  Neural Basis of Self and Other Representation in Autism: An fMRI Study of Self-Face Recognition , 2008, PloS one.

[4]  A. Gopnik,et al.  Natural theories of mind: Evolution, development and simulation of everyday mindreading , 2015 .

[5]  D. McNeill.  Language and Gesture: Gesture in action , 2000 .

[6]  A. Pentland,et al.  Thin slices of negotiation: predicting outcomes from conversational dynamics within the first 5 minutes. , 2007, The Journal of applied psychology.

[7]  Khalil Sima'an,et al.  Wired for Speech: How Voice Activates and Advances the Human-Computer Relationship , 2006, Computational Linguistics.

[8]  Cornelia Müller,et al.  Redebegleitende Gesten : Kulturgeschichte, Theorie, Sprachvergleich , 1998 .

[9]  Maja Pantic,et al.  Social signal processing: Survey of an emerging domain , 2009, Image Vis. Comput..

[10]  A. Pentland.  Social Signal Processing [Exploratory DSP] , 2007, IEEE Signal Processing Magazine.

[11]  Ipke Wachsmuth,et al.  Embodied Communication in Humans and Machines , 2008, AI Mag..

[12]  Jens Allwood,et al.  Dimensions of embodied communication : towards a typology of embodied communication , 2008 .

[13]  Jordan Zlatev,et al.  The Shared Mind: Perspectives on Intersubjectivity , 2008 .

[14]  A. Meltzoff,et al.  What imitation tells us about social cognition: a rapprochement between developmental psychology and cognitive neuroscience. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[15]  Giovanna Leone.  Observing social signals in scaffolding interactions: how to detect when a helping intention risks falling short , 2011, Cognitive Processing.

[16]  Isabella Poggi,et al.  EMOTIONAL AND NON-EMOTIONAL PERSUASION , 2006, Appl. Artif. Intell..

[17]  Roberto Cipriani,et al.  Imagination and society: the role of visual sociology , 2012, Cognitive Processing.

[18]  Martha W. Alibali,et al.  How gesture use enables intersubjectivity in the classroom , 2011 .

[19]  E. Tory Higgins,et al.  Impression formation and role fulfillment: A “holistic reference” approach , 1976 .

[20]  Nicole Novielli,et al.  Analysing user’s reactions in advice-giving dialogues with a socially intelligent ECA , 2011, Cognitive Processing.

[21]  Oliviero Stock,et al.  Communication from an Artificial Intelligence Perspective , 1992, NATO ASI Series.

[22]  Isabella Poggi,et al.  The Embodied Morphemes of Gaze , 2009, Gesture Workshop.

[23]  D. McNeill.  Hand and Mind , 1995 .

[24]  Michael A. Arbib,et al.  Language within Our Grasp the Mirror System , 1998 .

[25]  R. Lazarus.  Thoughts on the relations between emotion and cognition. , 1982 .

[26]  Shelley E. Taylor,et al.  Social cognition, 2nd ed. , 1991 .

[27]  V. Gallese.  Intentional attunement: A neurophysiological perspective on social cognition and its disruption in autism , 2006, Brain Research.

[28]  Cristiano Castelfranchi,et al.  No More Cooperation, Please! In Search of the Social Structure of Verbal Interaction , 1992 .

[29]  Isabella Poggi,et al.  Social signals: a framework in terms of goals and beliefs , 2012, Cognitive Processing.

[30]  Ingar Brinck,et al.  Attention and the evolution of intentional communication , 2000 .

[31]  Alex Pentland,et al.  Honest Signals - How They Shape Our World , 2008 .

[32]  Cordula Vesper,et al.  A minimal architecture for joint action , 2010, Neural Networks.

[33]  J. P. Foley,et al.  Gesture and Environment , 1942 .

[34]  Dirk Heylen,et al.  Analyzing nonverbal listener responses using parallel recordings of multiple listeners , 2012, Cognitive Processing.

[35]  Charles F. Hockett,et al.  A mathematical theory of communication , 1948, MOCO.

[36]  Shelley E. Taylor,et al.  Social Cognition, from Brains to Culture , 1984 .

[37]  M. Iacoboni.  Neural mechanisms of imitation , 2005, Current Opinion in Neurobiology.

[38]  Dirk Heylen,et al.  Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing , 2012, IEEE Transactions on Affective Computing.

[39]  Roddy Cowie,et al.  Politeness and social signals , 2011, Cognitive Processing.

[40]  S. Baron-Cohen.  Mindblindness: An Essay on Autism and Theory of Mind , 1997 .

[41]  Radoslaw Niewiadomski,et al.  Smiling virtual agent in social context , 2012, Cognitive Processing.

[42]  Irwin Altman,et al.  Manwatching: A field guide to human behavior. , 1978 .

[43]  Vittorio Murino,et al.  Conversation analysis at work: detection of conflict in competitive discussions through semi-automatic turn-organization analysis , 2012, Cognitive Processing.

[44]  Nicolas Ruwet,et al.  Essais de linguistique générale , 1963 .

[45]  F. Bartlett,et al.  Remembering: A Study in Experimental and Social Psychology , 1932 .

[46]  S. Baron-Cohen.  Precursors to a theory of mind: Understanding attention in others. , 1991 .

[47]  E. D. Paolo,et al.  Can social interaction constitute social cognition? , 2010, Trends in Cognitive Sciences.

[48]  I. Poggi.  Mind, hands, face and body. A goal and belief view of multimodal communication , 2007 .

[49]  N. Sebanz,et al.  Evolving intentions for social interaction: from entrainment to joint action , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[50]  M. Tomasello.  Origins of human communication , 2008 .

[51]  Joseph P. McCleery,et al.  EEG evidence for mirror neuron dysfunction in autism spectrum disorders. , 2005, Brain research. Cognitive brain research.

[52]  Francesca Giardini,et al.  Deterrence and transmission as mechanisms ensuring reliability of gossip , 2011, Cognitive Processing.

[53]  R. Zajonc.  Feeling and thinking : Preferences need no inferences , 1980 .

[54]  A. Kendon.  Gesture: Visible Action as Utterance , 2004 .

[55]  S. Kita.  Pointing: Where language, culture, and cognition meet , 2003 .

[56]  N. Ambady,et al.  Half a minute: Predicting teacher evaluations from thin slices of nonverbal behavior and physical attractiveness. , 1993 .

[57]  R. Adolphs.  Social cognition and the human brain , 1999, Trends in Cognitive Sciences.

[58]  D. Perrett,et al.  Imitation, mirror neurons and autism , 2001, Neuroscience & Biobehavioral Reviews.