Modeling Functional Roles Dynamics in Small Group Interactions

The paper addresses the automatic recognition of social and task-oriented functional roles in small-group meetings, focusing on several properties: a) the importance of non-linguistic behaviors, b) the relative time-consistency of the social roles played by a given person during the course of a meeting, and c) the interplays and mutual constraints among the roles enacted by the different participants in a social encounter. In particular, this paper proposes that the Influence Model framework can address these properties of functional roles, and compares the performance obtained by this framework to the performances of models that consider only property (a) (SVM), and to those that address both (a) and (b) (HMM). The results obtained confirm our expectations: the classification of social functional roles improves if models account for temporal dependencies among the roles played by the same subject, for the time properties of the roles played by each individual, and for the mutual constraints among the roles of different group members. The two versions of the Influence Model (IM and newIM), which encode all three properties together, outperform both the SVM and the HMM on most of the figures of merit used. Of particular interest is the capability of the Influence Model to obtain good or very good results on the less-populated classes-Orienteer and Seeker for the task area, and Attacker and Supporter for the socio-emotional area.

[1]  K. D. Benne,et al.  Functional Roles of Group Members , 2010 .

[2]  Dilek Z. Hakkani-Tür,et al.  Role recognition for meeting participants: an approach based on lexical information and social network analysis , 2008, ACM Multimedia.

[3]  V. Yngve.  On getting a word in edgewise , 1970 .

[4]  Sumit Basu,et al.  Learning Human Interactions w ith the Influence Model , 2001, NIPS 2001.

[5]  E.,et al.  GROUPS : INTERACTION AND PERFORMANCE , 2001 .

[6]  Daniel Gatica-Perez,et al.  Automatic nonverbal analysis of social interaction in small groups: A review , 2009, Image Vis. Comput..

[7]  Fabio Pianesi,et al.  A multimodal annotated corpus of consensus decision making meetings , 2007, Lang. Resour. Evaluation.

[8]  Alex Pentland,et al.  Using the influence model to recognize functional roles in meetings , 2007, ICMI '07.

[9]  Fabio Valente,et al.  Understanding social signals in multi-party conversations: Automatic recognition of socio-emotional roles in the AMI meeting corpus , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[10]  Wei-Ta Chu,et al.  Movie Analysis Based on Roles' Social Network , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[11]  Sumit Basu,et al.  Conversational scene analysis , 2002 .

[12]  James W. Davis.  Hierarchical motion history images for recognizing human motion , 2001, Proceedings IEEE Workshop on Detection and Recognition of Events in Video.

[13]  Julia Hirschberg,et al.  The Rules Behind Roles: Identifying Speaker Role in Radio Broadcasts , 2000, AAAI/IAAI.

[14]  Jean-Marc Odobez,et al.  Predicting two facets of social verticality in meetings from five-minute time slices and nonverbal cues , 2008, ICMI '08.

[15]  R. Bales.  Interaction process analysis; a method for the study of small groups. , 2013 .

[16]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[17]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[18]  W. Bennis,et al.  The Social Psychology of Organizations , 1966 .

[19]  Alessandro Vinciarelli,et al.  Automatic role recognition in multiparty recordings using social networks and probabilistic sequential models , 2009, ACM Multimedia.

[20]  Alexander I. Rudnicky,et al.  Using simple speech-based features to detect the state of a meeting and the roles of the meeting participants , 2004, INTERSPEECH.

[21]  Nadia Mana,et al.  Modeling the Personality of Participants During Group Interactions , 2009, UMAP.

[22]  A. Pentland,et al.  Thin slices of negotiation: predicting outcomes from conversational dynamics within the first 5 minutes. , 2007, The Journal of applied psychology.

[23]  Chuohao Yeo,et al.  Modeling Dominance in Group Conversations Using Nonverbal Activity Cues , 2009, IEEE Transactions on Audio, Speech, and Language Processing.

[24]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[25]  Nadia Mana,et al.  Automatic prediction of individual performance from "thin slices" of social behavior , 2009, ACM Multimedia.

[26]  D. Gática-Pérez,et al.  A Nonverbal Behavior Approach to Identify Emergent Leaders in Small Groups , 2012, IEEE Transactions on Multimedia.

[27]  Jordi Vitrià,et al.  You are fired! Nonverbal role analysis in competitive meetings , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[28]  Fabio Pianesi,et al.  Multimodal support to group dynamics , 2007, Personal and Ubiquitous Computing.

[29]  Theresa Wilson,et al.  Using linguistic and vocal expressiveness in social role recognition , 2011, IUI '11.

[30]  Alessandro Vinciarelli,et al.  Role recognition in multiparty recordings using social affiliation networks and discrete distributions , 2008, ICMI '08.

[31]  Sumit Basu,et al.  Modeling Conversational Dynamics as a Mixed-Memory Markov Process , 2004, NIPS.

[32]  Alessandro Vinciarelli,et al.  Role Recognition in Broadcast News using Bernoulli Distributions , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[33]  Michael Doyle,et al.  How to make meetings work: The new interaction method , 1976 .

[34]  Alex Pentland,et al.  Reality mining: sensing complex social systems , 2006, Personal and Ubiquitous Computing.

[35]  R. Kahn,et al.  The Social Psychology of Organizations , 1966 .

[36]  Alessandro Vinciarelli,et al.  Automatic role recognition based on conversational and prosodic behaviour , 2010, ACM Multimedia.

[37]  Alessandro Vinciarelli,et al.  Broadcast news story segmentation using social network analysis and hidden markov models , 2007, ACM Multimedia.

[38]  A. Hare,et al.  Types of Roles in Small Groups , 1994 .

[39]  Paul Chippendale,et al.  Towards Automatic Body Language Annotation , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[40]  E. Heerey,et al.  Interpersonal consequences of social anxiety. , 2007, Journal of abnormal psychology.

[41]  Julia Hirschberg,et al.  Automatic summarization of broadcast news using structural features , 2003, INTERSPEECH.

[42]  Fabio Pianesi,et al.  Automatic detection of group functional roles in face to face interactions , 2006, ICMI '06.

[43]  Andrei Popescu-Belis,et al.  Graphical representation of meetings on mobile devices , 2008, Mobile HCI.

[44]  Francis M. Sim,et al.  Role Theory: Expectations, Identities, and Behaviors. , 1982 .

[45]  Alex Pentland,et al.  A Network Analysis of Road Traffic with Vehicle Tracking Data , 2009, AAAI Spring Symposium: Human Behavior Modeling.

[46]  Wei Pan,et al.  Modeling Dynamical Influence in Human Interaction , 2011 .

[47]  Alessandro Vinciarelli.  Sociometry Based Multiparty Audio Recordings Summarization , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[48]  Nadia Mana,et al.  Multimodal recognition of personality traits in social interactions , 2008, ICMI '08.

[49]  Alex Pentland,et al.  Modeling Influence Between Experts , 2007, Artifical Intelligence for Human Computing.

[50]  Abran J. Salazar.  An Analysis of the Development and Evolution of Roles in the Small Group , 1996 .

[51]  J. Hardin,et al.  Generalized Estimating Equations , 2002 .

[52]  Subramanian Ramanathan,et al.  Employing social gaze and speaking activity for automatic determination of the Extraversion trait , 2010, ICMI-MLMI '10.