Predicting online lecture ratings based on gesturing and vocal behavior

Nonverbal behavior plays an important role in any human–human interaction. Teaching—an inherently social activity—is not an exception. So far, the effect of nonverbal behavioral cues accompanying lecture delivery was investigated in the case of traditional ex-cathedra lectures, where students and teachers are co-located. However, it is becoming increasingly more frequent to watch lectures online and, in this new type of setting, it is still unclear what the effect of nonverbal communication is. This article tries to address the problem and proposes experiments performed over the lectures of a popular web repository (“Videolectures”). The results show that automatically extracted nonverbal behavioral cues (prosody, voice quality and gesturing activity) predict the ratings that “Videolectures” users assign to the presentations.

[1]  Ce Liu,et al.  Exploring new representations and applications for motion analysis , 2009 .

[2]  Mary K. Tallent-Runnels,et al.  Teaching Courses Online: A Review of the Research , 2006 .

[3]  Fabio Pianesi,et al.  Multimodal support to group dynamics , 2007, Personal and Ubiquitous Computing.

[4]  W. Lewis Johnson,et al.  Steve: an animated pedagogical agent for procedural training in virtual environments , 1997, SGAR.

[5]  Vittorio Murino,et al.  Learning how to teach from “Videolectures”: automatic prediction of lecture ratings based on teacher's nonverbal behavior , 2012, 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom).

[6]  Alessandro Vinciarelli,et al.  Automatic Role Recognition in Multiparty Conversations: An Approach Based on Turn Organization, Prosody, and Conditional Random Fields , 2012, IEEE Transactions on Multimedia.

[7]  G. Bente,et al.  Personalizing e-Learning. The Social Effects of Pedagogical Agents , 2010 .

[8]  Douglas M. Brooks,et al.  Chapter 5: Nonverbal Communication in Teaching , 1983 .

[9]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[10]  Vittorio Murino,et al.  Conversation analysis at work: detection of conflict in competitive discussions through semi-automatic turn-organization analysis , 2012, Cognitive Processing.

[11]  C. Soto,et al.  Five-Factor Model of Personality , 2013 .

[12]  A. Pentland,et al.  Thin slices of negotiation: predicting outcomes from conversational dynamics within the first 5 minutes. , 2007, The Journal of applied psychology.

[13]  Junji Yamato,et al.  A probabilistic inference of multiparty-conversation structure based on Markov-switching models of gaze patterns, head directions, and utterances , 2005, ICMI '05.

[14]  Dirk Heylen,et al.  Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing , 2012, IEEE Transactions on Affective Computing.

[15]  Marilyn A. Walker,et al.  Using Linguistic Cues for the Automatic Recognition of Personality in Conversation and Text , 2007, J. Artif. Intell. Res..

[16]  Ludmila I. Kuncheva,et al.  A Theoretical Study on Six Classifier Fusion Strategies , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Daniel Gatica-Perez,et al.  Detection and application of influence rankings in small group meetings , 2006, ICMI '06.

[18]  J. Seaman,et al.  Teaching, Learning, and Sharing: How Today's Higher Education Faculty Use Social Media. , 2011 .

[19]  Yi Yang,et al.  Articulated pose estimation with flexible mixtures-of-parts , 2011, CVPR 2011.

[20]  M. Knapp,et al.  Nonverbal communication in human interaction , 1972 .

[21]  Patricia Kearney,et al.  Clarifying the relationship between teacher nonverbal immediacy and student cognitive learning: Affective learning as the central causal mediator , 1996 .

[22]  Ronald E. Riggio,et al.  Applications of nonverbal communication , 2005 .

[23]  Howard A. Smith,et al.  Nonverbal Communication in Teaching , 1979 .

[24]  Mohamed Chetouani,et al.  Interpersonal Synchrony: A Survey of Evaluation Methods across Disciplines , 2012, IEEE Transactions on Affective Computing.

[25]  Frank J. Bernieri,et al.  Students as Judges of Teachers’ Verbal and Nonverbal Behavior , 1991 .

[26]  W. Lewis Johnson,et al.  Pedagogical agents on the Web , 1999, AGENTS '99.

[27]  Carlo Drioli,et al.  Generative modeling and classification of dialogs by a low-level turn-taking feature , 2011, Pattern Recognit..

[28]  Fred G. Martin,et al.  Will massive open online courses change how we teach? , 2012, CACM.

[29]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[30]  Daniel Thalmann,et al.  Virtual humans: back to the future , 2012, Graphics Interface.

[31]  Antonio Fini,et al.  The Technological Dimension of a Massive Open Online Course: The Case of the CCK08 Course Tools , 2009 .

[32]  Dirk Heylen,et al.  Dominance Detection in Meetings Using Easily Obtainable Features , 2005, MLMI.

[33]  Douglas M. Brooks,et al.  Nonverbal Communication in Teaching , 1983 .

[34]  Louis-Philippe Morency,et al.  Modeling Human Communication Dynamics [Social Sciences] , 2010, IEEE Signal Processing Magazine.

[35]  Rita Kop,et al.  The Challenges to Connectivist Learning on Open Online Networks: Learning Experiences during a Massive Open Online Course , 2011 .

[36]  R. Bollet,et al.  Personalizing E-Learning , 2002 .

[37]  J. Mccroskey,et al.  Nonverbal Behavior in Interpersonal Relations , 1987 .

[38]  Chuohao Yeo,et al.  Modeling Dominance in Group Conversations Using Nonverbal Activity Cues , 2009, IEEE Transactions on Audio, Speech, and Language Processing.

[39]  Helene Fournier,et al.  A pedagogy of abundance or a pedagogy to support human beings? Participant support on massive open online courses , 2011 .

[40]  Louis-Philippe Morency,et al.  Modeling Human Communication Dynamics , 2010 .

[41]  Vittorio Murino,et al.  Towards Computational Proxemics: Inferring Social Relations from Interpersonal Distances , 2011, 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing.

[42]  Vittorio Murino,et al.  Look at Who's Talking: Voice Activity Detection by Automated Gesture Analysis , 2011, AmI Workshops.

[43]  Vittorio Murino,et al.  Socially intelligent surveillance and monitoring: Analysing social dimensions of physical space , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[44]  Francesco Cutugno,et al.  A syllable segmentation algorithm for English and italian , 2003, INTERSPEECH.

[45]  N. Ambady,et al.  Half a minute: Predicting teacher evaluations from thin slices of nonverbal behavior and physical attractiveness. , 1993 .

[46]  Vittorio Murino,et al.  Social interactions by visual focus of attention in a three‐dimensional environment , 2013, Expert Syst. J. Knowl. Eng..

[47]  P. H. Lodhi,et al.  The Five-Factor Model of Personality , 2002 .

[48]  Alessandro Vinciarelli,et al.  Automatic personality perception: Prediction of trait attribution based on prosodic features extended abstract , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).

[49]  Richard T. Watson,et al.  An information strategy for environmental sustainability , 2012, Commun. ACM.

[50]  N. Ambady,et al.  Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis. , 1992 .

[51]  M. Chetouani,et al.  What studies of family home movies can teach us about autistic infants: A literature review , 2010 .

[52]  Khalil Sima'an,et al.  Wired for Speech: How Voice Activates and Advances the Human-Computer Relationship , 2006, Computational Linguistics.