Computational modeling of face-to-face social interaction using nonverbal behavioral cues

On January 25, 2011 the author successfully defended his PhD thesis entitled Computational modeling of face-to-face social interaction using nonverbal behavioral cues.

[1]  Dilek Z. Hakkani-Tür,et al.  Role recognition for meeting participants: an approach based on lexical information and social network analysis , 2008, ACM Multimedia.

[2]  Shaogang Gong,et al.  Video Behavior Profiling for Anomaly Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  P. R. Laughlin,et al.  Demonstrability and social combination processes on mathematical intellective tasks. , 1986 .

[4]  Steve Renals,et al.  Automatic Meeting Segmentation Using Dynamic Bayesian Networks , 2007, IEEE Transactions on Multimedia.

[5]  Gary Bornstein,et al.  Intergroup Conflict: Individual, Group, and Collective Interests , 2003, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[6]  Phillip Bonacich,et al.  Eigenvector-like measures of centrality for asymmetric relations , 2001, Soc. Networks.

[7]  D. Meyer,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S6 References Evidence for a Collective Intelligence Factor in the Performance of Human Groups , 2022 .

[8]  Daniel Gatica-Perez,et al.  Detection and application of influence rankings in small group meetings , 2006, ICMI '06.

[9]  Jean Carletta,et al.  The AMI Meeting Corpus: A Pre-announcement , 2005, MLMI.

[10]  Jean-Marc Odobez,et al.  Predicting two facets of social verticality in meetings from five-minute time slices and nonverbal cues , 2008, ICMI '08.

[11]  J. Dovidio,et al.  Decoding visual dominance: Attributions of power based on relative percentages of looking while speaking and looking while listening. , 1982 .

[12]  Martin S. Remland.  Uses and Consequences of Nonverbal Communication in the Context of Organizational Life , 2006 .

[13]  R. Bales.  Interaction process analysis; a method for the study of small groups. , 2013 .

[14]  Juan Carlos Niebles,et al.  Unsupervised Learning of Human Action Categories , 2006 .

[15]  Jacques M. B. Terken,et al.  Real-Time Feedback on Nonverbal Behaviour to Enhance Social Dynamics in Small Group Meetings , 2005, MLMI.

[16]  C. Ridgeway,et al.  Nonverbal Behavior, Dominance, and the Basis of Status in Task Groups , 1987 .

[17]  Jacqueline M. C. Smith,et al.  The role of gaze in impression formation. , 1975, The British journal of social and clinical psychology.

[18]  A. Hare,et al.  Types of Roles in Small Groups , 1994 .

[19]  Daniel Gatica-Perez,et al.  Discovering group nonverbal conversational patterns with topics , 2009, ICMI-MLMI '09.

[20]  J. McGrath.  Groups: Interaction and Performance , 1984 .

[21]  David Sloan Wilson,et al.  Cognitive cooperation , 2004, Human nature.

[22]  Antonio Camurri,et al.  A System for Real-Time Multimodal Analysis of Nonverbal Affective Social Interaction in User-Centric Media , 2010, IEEE Transactions on Multimedia.

[23]  Judith A. Hall,et al.  Nonverbal behavior and the vertical dimension of social relations: a meta-analysis. , 2005, Psychological bulletin.

[24]  R. Bales,et al.  Personality and Interpersonal Behavior. , 1971 .

[25]  Fabio Pianesi,et al.  Multimodal support to group dynamics , 2007, Personal and Ubiquitous Computing.

[26]  Alex Pentland,et al.  Social Sensors for Automatic Data Collection , 2008, AMCIS.

[28]  Daniel Gatica-Perez,et al.  Identifying emergent leadership in small groups using nonverbal communicative cues , 2010, ICMI-MLMI '10.

[29]  Judith A. Hall,et al.  Status, Gender, and Nonverbal Behavior: A Study of Structured Interactions between Employees of a Company , 1999 .

[30]  Hiroshi Sawada,et al.  Automatic inference of cross-modal nonverbal interactions in multiparty conversations: "who responds to whom, when, and how?" from gaze, head gestures, and utterances , 2007, ICMI '07.

[31]  Samy Bengio,et al.  Detecting group interest-level in meetings , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[32]  Katayoun Farrahi,et al.  Probabilistic Mining of Socio-Geographic Routines From Mobile Phone Data , 2010, IEEE Journal of Selected Topics in Signal Processing.

[33]  Daniel Gatica-Perez,et al.  Mining Group Nonverbal Conversational Patterns Using Probabilistic Topic Models , 2010, IEEE Transactions on Multimedia.

[34]  Jean-Marc Odobez,et al.  Using audio and video features to classify the most dominant person in a group meeting , 2007, ACM Multimedia.

[35]  Ashish Kapoor,et al.  A real-time head nod and shake detector , 2001, PUI '01.

[36]  M. Knapp,et al.  Nonverbal communication in human interaction , 1972 .

[37]  Ronald Lippitt,et al.  Patterns of Aggressive Behavior in Experimentally Created “Social Climates” , 1939 .

[38]  Jean-Marc Odobez,et al.  Investigating automatic dominance estimation in groups from visual attention and speaking activity , 2008, ICMI '08.

[39]  Jonathan Grudin,et al.  Computer-supported cooperative work: history and focus , 1994, Computer.

[40]  Ran R. Hassin,et al.  The New Unconscious , 2006 .

[41]  D. McNeill.  Language and Gesture , 2000 .

[42]  Fabio Pianesi,et al.  Automatic detection of group functional roles in face to face interactions , 2006, ICMI '06.

[43]  Juan Carlos Niebles,et al.  Unsupervised Learning of Human Action Categories Using Spatial-Temporal Words , 2008, International Journal of Computer Vision.

[44]  Marshall Scott Poole,et al.  Interdisciplinary Perspectives on Small Groups , 2004 .

[45]  Bogdan Raducanu,et al.  Inferring competitive role patterns in reality TV show through nonverbal analysis , 2010, Multimedia Tools and Applications.

[46]  Fernando De la Torre,et al.  Facial Expression Analysis , 2011, Visual Analysis of Humans.

[47]  Norah E. Dunbar,et al.  NONVERBAL EXPRESSIONS OF DOMINANCE AND POWER IN HUMAN RELATIONSHIPS , 2006 .

[48]  J. S. Efran.  Looking for approval: effects on visual behavior of approbation from persons differing in importance. , 1968, Journal of personality and social psychology.

[49]  Daniel Gatica-Perez,et al.  Characterizing conversational group dynamics using nonverbal behaviour , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[50]  Dinesh Babu Jayagopi,et al.  Generalized adaptive IFIR filter bank structures , 2007, Signal Process..

[51]  Tanja Schultz,et al.  Modeling Vocal Interaction for Text-Independent Participant Characterization in Multi-Party Conversation , 2008, SIGDIAL Workshop.

[52]  Chuohao Yeo,et al.  Compressed domain video processing of meetings for activity estimation in dominance classification and slide transition detection , 2008 .

[53]  Alex Pentland,et al.  Meeting mediator: enhancing group collaboration with sociometric feedback , 2008, CHI Extended Abstracts.

[54]  Kazuhiro Otsuka,et al.  Conversation scene analysis based on dynamic Bayesian network and image-based gaze detection , 2010, ICMI-MLMI '10.

[55]  Hazel Kyrk.  : Resolving Social Conflicts: Selected Papers on Group Dynamics , 1948 .

[56]  Hiroshi Murase,et al.  Quantifying interpersonal influence in face-to-face conversations based on visual attention patterns , 2006, CHI Extended Abstracts.

[57]  Michael I. Jordan,et al.  Hierarchical Dirichlet Processes , 2006 .

[58]  Alex Pentland.  Socially Aware Computation and Communication , 2005, Computer.

[59]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  Stanley Wasserman,et al.  Social Network Analysis: Methods and Applications , 1994, Structural analysis in the social sciences.

[61]  Walter Bender,et al.  Using visualizations to review a group's interaction dynamics , 2006, CHI EA '06.

[62]  Shaogang Gong,et al.  Global Behaviour Inference using Probabilistic Latent Semantic Analysis , 2008, BMVC.

[63]  C. Darwin.  The Expression of the Emotions in Man and Animals , .

[64]  Jean-Marc Odobez,et al.  Multiperson Visual Focus of Attention from Head Pose and Meeting Contextual Cues , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[65]  Fabio Pianesi,et al.  A multimodal annotated corpus of consensus decision making meetings , 2007, Lang. Resour. Evaluation.

[66]  Alex Pentland,et al.  Using the influence model to recognize functional roles in meetings , 2007, ICMI '07.

[67]  Jean Ponce,et al.  Learning mid-level features for recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[68]  Daniel Olguín Olguín.  Assessing Group Performance from Collective Behavior , 2010 .

[69]  Junji Yamato,et al.  Recognizing communicative facial expressions for discovering interpersonal emotions in group meetings , 2009, ICMI-MLMI '09.

[70]  Walter Bender,et al.  Group Reactions to Visual Feedback Tools , 2007, PERSUASIVE.

[71]  Samy Bengio,et al.  Automatic analysis of multimodal group actions in meetings , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[72]  J. Dillard,et al.  The sounds of dominance: Vocal precursors of perceived dominance during interpersonal influence , 2000 .

[73]  Bruno Lepri,et al.  Multimodal Recognition of Social Behaviors and Personality Traits in Small Group Interaction , 2009 .

[74]  Allan Mazur,et al.  Incipient Status in Small Groups , 1979 .

[75]  Alex Pentland,et al.  Recognizing conversational context in group interaction using privacy-sensitive mobile sensors , 2010, MUM.

[76]  Shih-Fu Chang,et al.  Survey of compressed-domain features used in audio-visual indexing and analysis , 2003, J. Vis. Commun. Image Represent..

[77]  Tanzeem Choudhury,et al.  The Sociometer: A Wearable Device for Understanding Human Networks , 2002 .

[78]  Daniel Gatica-Perez,et al.  Predicting remote versus collocated group interactions using nonverbal cues , 2009, ICMI-MLMI '09.

[79]  Holly Arrow,et al.  Small Groups as Complex Systems: Formation, Coordination, Development, and Adaptation , 2000 .

[80]  Norah E. Dunbar,et al.  Perceptions of power and interactional dominance in interpersonal relationships , 2005 .

[81]  Chong Wang,et al.  Reading Tea Leaves: How Humans Interpret Topic Models , 2009, NIPS.

[82]  Alessandro Vinciarelli,et al.  Speakers Role Recognition in Multiparty Audio Recordings Using Social Network Analysis and Duration Distribution Modeling , 2007, IEEE Transactions on Multimedia.

[83]  Thomas L. Griffiths,et al.  The Author-Topic Model for Authors and Documents , 2004, UAI.

[84]  Alex Pentland,et al.  Honest Signals - How They Shape Our World , 2008 .

[85]  J. Levine,et al.  Progress in Small Group Research , 1990 .

[86]  M. Patterson,et al.  The SAGE Handbook of Nonverbal Communication , 2006 .

[87]  Bernt Schiele,et al.  Discovery of activity patterns using topic models , 2008 .

[88]  Mark Steyvers,et al.  Finding scientific topics , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[89]  Pierre Dillenbourg,et al.  An Interactive Table for Supporting Participation Balance in Face-to-Face Collaborative Learning , 2010, IEEE Transactions on Learning Technologies.

[90]  Daniel Gatica-Perez,et al.  What did you do today?: discovering daily routines from large-scale mobile data , 2008, ACM Multimedia.

[91]  Takeo Kanade,et al.  Facial Expression Analysis , 2011, AMFG.

[92]  Gerald Friedland,et al.  Estimating the dominant person in multi-party conversations using speaker diarization strategies , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[93]  Trevor Darrell,et al.  Contextual recognition of head gestures , 2005, ICMI '05.

[94]  Alessandro Vinciarelli,et al.  Automatic Role Recognition in Multiparty Recordings: Using Social Affiliation Networks for Feature Extraction , 2009, IEEE Transactions on Multimedia.

[95]  Gregor Heinrich.  Parameter estimation for text analysis , 2009 .

[96]  S. Srivastava,et al.  The Big Five Trait taxonomy: History, measurement, and theoretical perspectives. , 1999 .

[97]  L. Smith-Lovin,et al.  INTERRUPTIONS IN GROUP DISCUSSIONS: THE EFFECTS OF GENDER AND GROUP COMPOSITION* , 1989 .

[98]  Shaogang Gong,et al.  Modelling facial colour and identity with Gaussian mixtures , 1998, Pattern Recognit..

[99]  Paul Chippendale,et al.  Towards Automatic Body Language Annotation , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[100]  Anton Nijholt,et al.  Online and off-line visualization of meeting information and meeting support , 2006, The Visual Computer.

[101]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[102]  M. Davies,et al.  Approximating optical flow within the MPEG-2 compressed domain , 2005 .

[103]  Fabio Valente,et al.  Improving speech processing trough social signals: automatic speaker segmentation of political debates using role based turn-taking patterns , 2010, SSPW '10.

[104]  Daniel Gatica-Perez,et al.  Automatic nonverbal analysis of social interaction in small groups: A review , 2009, Image Vis. Comput..

[105]  Samy Bengio,et al.  Modeling individual and group actions in meetings with layered HMMs , 2006, IEEE Transactions on Multimedia.

[106]  J. Conaty,et al.  The Effects of Status Differentiation on Nonverbal Behavior , 1982 .

[107]  J. Rotter.  Generalized expectancies for internal versus external control of reinforcement. , 1966, Psychological monographs.

[108]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[109]  Nadia Mana,et al.  Multimodal recognition of personality traits in social interactions , 2008, ICMI '08.

[110]  Daniel Gatica-Perez,et al.  Fusing Audio-Visual Nonverbal Cues to Detect Dominant People in Group Conversations , 2010, 2010 20th International Conference on Pattern Recognition.

[111]  K. Scherer,et al.  The New Handbook of Methods in Nonverbal Behavior Research , 2008 .

[112]  Chuohao Yeo,et al.  Predicting the dominant clique in meetings through fusion of nonverbal cues , 2008, ACM Multimedia.

[113]  Elizabeth Shriberg,et al.  Spotting "hot spots" in meetings: human judgments and prosodic cues , 2003, INTERSPEECH.

[114]  Benjamin N. Waber,et al.  Recognizing Expertise , 2008 .

[115]  Nadia Mana,et al.  Automatic prediction of individual performance from "thin slices" of social behavior , 2009, ACM Multimedia.

[116]  Jean-Marc Odobez,et al.  Topic models for scene analysis and abnormality detection , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[117]  Sumit Basu,et al.  Conversational scene analysis , 2002 .

[118]  Rutger Rienks,et al.  Meetings in Smart Environments: Implications of Progressing Technology , 2010 .

[119]  Chuohao Yeo,et al.  Modeling Dominance in Group Conversations Using Nonverbal Activity Cues , 2009, IEEE Transactions on Audio, Speech, and Language Processing.

[120]  J. M. Rabbie,et al.  Intergroup Competition and Cooperation within Autocratic and Democratic Management Regimes , 1995 .

[121]  A Meta-Analysis,et al.  Dominance as Expressed and Inferred Through Speaking Time , 2002 .

[122]  Thomas L. Griffiths,et al.  Probabilistic Topic Models , 2007 .

[123]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[124]  Jordi Vitrià,et al.  You are fired! Nonverbal role analysis in competitive meetings , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[125]  Maja Pantic,et al.  Audiovisual discrimination between laughter and speech , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.