Crowd Emotion Detection Using Dynamic Probabilistic Models

Detecting emotions of a crowd to control the situation is an area of emerging interest. The purpose of this paper is to present a novel idea to detect the emotions of the crowd. Emotions are defined as evolving quantities arising from the reaction to contextual situations in a set of dynamic pattern of events. These events depend on internal and external interaction states in an already mapped space. The emotions of multiple people constituting a crowd in any surveillance environment are estimated by their social and collective behaviors using sensor signals e.g., a camera, which captures and tracks their motion. The feature space is constructed based on local features to model the contextual situations and the different interactions corresponding to different emergent behaviors are modeled using bio-inspired dynamic model. The changes in emotions correspond to behavioral changes which are produced to regulate behaviors under different encountered situations. Proposed algorithm involves the probabilistic signal processing modelling techniques for analysis of different types of collective behaviors based on interactions among people and classification models to estimate emotions as positive or negative. The evaluations are performed on simulated data show the proposed algorithm effectively recognizes the emotions of the crowd under specific situations.

[1]  Carlo S. Regazzoni,et al.  Interaction Analysis with a Bayesian Trajectory Model , 2010, IEEE Intelligent Systems.

[2]  E. S. Pearson,et al.  On the Problem of the Most Efficient Tests of Statistical Hypotheses , 1933 .

[3]  Carlo S. Regazzoni,et al.  A bio-inspired system model for interactive surveillance applications , 2011, J. Ambient Intell. Smart Environ..

[4]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[5]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[6]  K. Scherer,et al.  Emotion recognition from expressions in face, voice, and body: the Multimodal Emotion Recognition Test (MERT). , 2009, Emotion.

[7]  Klaus R. Scherer,et al.  Vocal communication of emotion: A review of research paradigms , 2003, Speech Commun..

[8]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[9]  A. Damasio The Feeling of What Happens: Body and Emotion in the Making of Consciousness , 1999 .

[10]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[11]  K. Scherer,et al.  The New Handbook of Methods in Nonverbal Behavior Research , 2008 .

[12]  Philip R. Cohen,et al.  Emotional influences in memory and thinking: Data and theory , 1982 .

[13]  E. Lehmann Introduction to Neyman and Pearson (1933) On the Problem of the Most Efficient Tests of Statistical Hypotheses , 1992 .

[14]  Carlo S. Regazzoni,et al.  Event Based Switched Dynamic Bayesian Networks for Autonomous Cognitive Crowd Monitoring , 2014 .

[15]  Christine L. Lisetti,et al.  A User-Modeling Approach to Build User's Psycho-Physiological Maps of Emotions using Bio-Sensors , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[16]  Vijayan K. Asari Wide Area Surveillance , 2014 .

[17]  P. Ekman Expression and the Nature of Emotion , 1984 .

[18]  J. Russell,et al.  A cross-cultural study of a circumplex model of affect. , 1989 .

[19]  K. Scherer,et al.  Vocal expression of affect , 2005 .

[20]  Helge J. Ritter,et al.  An instantaneous topological mapping model for correlated stimuli , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[21]  Álvaro Herrero,et al.  International Joint Conference - CISIS'15 and ICEUTE'15, 8th International Conference on Computational Intelligence in Security for Information Systems / 6th International Conference on EUropean Transnational Education, Burgos, Spain, 15-17 June, 2015 , 2015, CISIS-ICEUTE.

[22]  Teuvo Kohonen,et al.  Self-Organizing Maps, Third Edition , 2001, Springer Series in Information Sciences.

[23]  Rosalind W. Picard,et al.  Automated Posture Analysis for Detecting Learner's Interest Level , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[24]  Andrea F. Cattoni,et al.  Interaction Modeling and Prediction in Smart Spaces: A Bio-Inspired Approach Based on Autobiographical Memory , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[25]  Matthias Rauterberg,et al.  Realistic Modeling of Agents in Crowd Simulations , 2014, 2014 5th International Conference on Intelligent Systems, Modelling and Simulation.

[26]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .