Identification of emergent leaders in a meeting scenario using multiple kernel learning

In this paper, an effective framework for detection of emergent leaders in small group is presented. In this scope, the combination of different types of nonverbal visual features; the visual focus of attention, head activity and body activity based features are utilized. Using them together ensued significant results. For the first time, multiple kernel learning (MKL) was applied for the identification of the most and the least emergent leaders. Taking the advantage of MKL's capability to use different kernels which corresponds to different feature subsets having different notions of similarity, significantly improved results compared to the state of the art methods were obtained. Additionally, high correlations between the majority of the features and the social psychology questionnaires which are designed to estimate the leadership or dominance were demonstrated.

[1]  Daniel Gatica-Perez,et al.  Emergent leaders through looking and speaking: from audio-visual data to multimodal recognition , 2012, Journal on Multimodal User Interfaces.

[2]  Jean-Marc Odobez,et al.  Investigating automatic dominance estimation in groups from visual attention and speaking activity , 2008, ICMI '08.

[3]  Lale Akarun,et al.  Vision based personality analysis using transfer learning methods , 2014, 2014 22nd Signal Processing and Communications Applications Conference (SIU).

[4]  Kalyan Moy Gupta,et al.  Cautious Collective Classification , 2009, J. Mach. Learn. Res..

[5]  M. Knapp,et al.  Nonverbal communication in human interaction , 1972 .

[6]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[7]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Chuohao Yeo,et al.  Modeling Dominance in Group Conversations Using Nonverbal Activity Cues , 2009, IEEE Transactions on Audio, Speech, and Language Processing.

[9]  Chih-Jen Lin,et al.  A Comparison of Methods for Multi-class Support Vector Machines , 2015 .

[10]  Ethem Alpaydin,et al.  Localized multiple kernel learning , 2008, ICML '08.

[11]  Samy Bengio,et al.  Detecting group interest-level in meetings , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[12]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[13]  Manik Varma,et al.  More generality in efficient multiple kernel learning , 2009, ICML '09.

[14]  D. Gática-Pérez,et al.  A Nonverbal Behavior Approach to Identify Emergent Leaders in Small Groups , 2012, IEEE Transactions on Multimedia.

[15]  Daniel Gatica-Perez,et al.  Fusing Audio-Visual Nonverbal Cues to Detect Dominant People in Group Conversations , 2010, 2010 20th International Conference on Pattern Recognition.

[16]  Daniel Gatica-Perez,et al.  Identifying emergent leadership in small groups using nonverbal communicative cues , 2010, ICMI-MLMI '10.

[17]  Vittorio Murino,et al.  Detecting emergent leader in a meeting environment using nonverbal visual features only , 2016, ICMI.

[18]  S. K. Lo,et al.  Reliability and Validity , 2020, International Encyclopedia of Human Geography.

[19]  Subramanian Ramanathan,et al.  Putting the pieces together: multimodal analysis of social attention in meetings , 2010, ACM Multimedia.

[20]  Dairazalia Sanchez-Cortes,et al.  Computational Methods for Audio-Visual Analysis of Emergent Leadership in Teams , 2013 .

[21]  Manik Varma,et al.  Learning The Discriminative Power-Invariance Trade-Off , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[22]  Ethem Alpaydin,et al.  Multiple Kernel Learning Algorithms , 2011, J. Mach. Learn. Res..

[23]  Daniel Gatica-Perez,et al.  Fusing Audio-Visual Nonverbal Cues to Detect Dominant People in Small Group Conversations , 2010 .

[24]  Daniel Gatica-Perez,et al.  One of a kind: inferring personality impressions in meetings , 2013, ICMI '13.

[25]  Roseanne J. Foti,et al.  A test of leadership categorization theory: Internal structure, information processing, and leadership perceptions , 1984 .

[26]  Timothy F. Cootes,et al.  Feature Detection and Tracking with Constrained Local Models , 2006, BMVC.

[27]  Simon Fong,et al.  An Application of Oversampling, Undersampling, Bagging and Boosting in Handling Imbalanced Datasets , 2013, DaEng.

[28]  E. Berscheid.  Joining Together: Group Theory and Group Skills , 1976 .

[29]  Frank J. Bernieri,et al.  Toward a histology of social behavior: Judgmental accuracy from thin slices of the behavioral stream , 2000 .

[30]  Fabio Roli,et al.  Cost-sensitive Learning in Support Vector Machines , 2002 .

[31]  Daniel Gatica-Perez,et al.  Hire me: Computational Inference of Hirability in Employment Interviews Based on Nonverbal Behavior , 2014, IEEE Transactions on Multimedia.

[32]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[33]  R. Bales,et al.  Symlog Case Study Kit: With Instructions for a Group Self Study , 1980 .