Body language without a body: nonverbal communication in technology mediated settings

Cognitive and psychological processes underlying social interaction are built around face-to-face interactions, the only possible and available communication setting during the long evolutionary process that has resulted into Homo Sapiens. As the fraction of interactions that take place in technology mediated settings keeps increasing, it is important to investigate how the cognitive and psychological processes mentioned above - ultimately grounded into neural structures - act in and react to the new interaction settings. In particular, it is important to investigate whether nonverbal communication - one of the main channels through which people convey socially and psychologically relevant information - still plays a role in settings where natural nonverbal cues (facial expressions, vocalisations, gestures, etc.) are no longer available. Addressing such an issue has important implications not only for what concerns the understanding of cognition and psychology, but also for what concerns the design of interaction technology and the analysis of phenomena like cyberbullyism and viral diffusion of content that play an important role in nowadays society.

[1]  J. Bowlby The making & breaking of affectional bonds , 1979 .

[2]  Maurizio Filippone,et al.  Looking Good With Flickr Faves: Gaussian Processes for Finding Difference Makers in Personality Impressions , 2016, ACM Multimedia.

[3]  Dirk Heylen,et al.  Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing , 2012, IEEE Transactions on Affective Computing.

[4]  Anna Esposito,et al.  When the Words are Not Everything: The Use of Laughter, Fillers, Back-Channel, Silence, and Overlapping Speech in Phone Calls , 2015, Front. ICT.

[5]  Sherry Turkle,et al.  Reclaiming Conversation: The Power of Talk in a Digital Age , 2015 .

[6]  Colin Pritchard Zero Degrees of Empathy: A New Theory of Human Cruelty , 2012 .

[7]  Alessandro Vinciarelli,et al.  New Social Signals in a New Interaction World: The Next Frontier for Social Signal Processing , 2015, IEEE Systems, Man, and Cybernetics Magazine.

[8]  Vittorio Murino,et al.  Conversationally-inspired stylometric features for authorship attribution in instant messaging , 2012, ACM Multimedia.

[9]  Robin I. M. Dunbar,et al.  Evolutionary psychology : a beginner's guide : human behaviour, evolution and the mind , 2007 .

[10]  Alessandro Perina,et al.  The Pictures We Like Are Our Image: Continuous Mapping of Favorite Pictures into Self-Assessed and Attributed Personality Traits , 2017, IEEE Transactions on Affective Computing.

[11]  K. Robertson The Making and Breaking of Affectional Bonds , 2009, BMJ : British Medical Journal.

[12]  M. Knapp,et al.  Nonverbal communication in human interaction , 1972 .

[13]  Maja Pantic,et al.  Social signal processing: Survey of an emerging domain , 2009, Image Vis. Comput..