How much do you perceive this? An analysis on perceptions of geometric features, personalities and emotions in virtual humans (Extended Version)

This work aims to evaluate people’s perception regarding geometric features, personalities and emotions characteristics in virtual humans. For this, we use as a basis, a dataset containing the tracking files of pedestrians captured from spontaneous videos and visualized them as identical virtual humans. The goal is to focus on their behavior and not being distracted by other features. In addition to tracking files containing their positions, the dataset also contains pedestrian emotions and personalities detected using Computer Vision and Pattern Recognition techniques. We proceed with our analysis in order to answer the question if subjects can perceive geometric features as distances/speeds as well as emotions and personalities in video sequences when pedestrians are represented by virtual humans. Regarding the participants, an amount of 73 people volunteered for the experiment. The analysis was divided in two parts: i) evaluation on perception of geometric characteristics, such as density, angular variation, distances and speeds, and ii) evaluation on personality and emotion perceptions. Results indicate that, even without explaining to the participants the concepts of each personality or emotion and how they were calculated (considering geometric characteristics), in most of the cases, participants perceived the personality and emotion expressed by the virtual agents, in accordance with the available ground truth.

[1]  Ali Borji,et al.  Egocentric Meets Top-View , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  W. B. Arndt Theories of personality , 1974 .

[3]  Fei Wang,et al.  PEARL: An interactive visual analytic tool for understanding personal emotion style derived from social media , 2014, 2014 IEEE Conference on Visual Analytics Science and Technology (VAST).

[4]  Nicu Sebe,et al.  Multimodal behavior analysis in the wild: An introduction , 2019, Multimodal Behavior Analysis in the Wild.

[5]  Soraia Raupp Musse,et al.  Using Big Five Personality Model to Detect Cultural Aspects in Crowds , 2017, 2017 30th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI).

[6]  Partha Chakroborty,et al.  Comparison of Pedestrian Fundamental Diagram across Cultures , 2009, Adv. Complex Syst..

[7]  Sutasinee Thovutikul,et al.  Towards a virtual environment for capturing behavior in cultural crowds , 2011, 2011 Sixth International Conference on Digital Information Management.

[8]  Norman I. Badler,et al.  Psychological Parameters for Crowd Simulation: From Audiences to Mobs , 2016, IEEE Transactions on Visualization and Computer Graphics.

[9]  Liang Gou Visualizing Personality Traits Derived from Social Media , 2015 .

[10]  Soraia Raupp Musse,et al.  Visualization of Interactions in Crowd Simulation and Video Sequences , 2018, 2018 17th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames).

[11]  Gholamreza Anbarjafari,et al.  Automated Screening of Job Candidate Based on Multimodal Video Processing , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[12]  Soraia Raupp Musse,et al.  Detecting Crowd Features in Video Sequences , 2016, 2016 29th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI).

[13]  Fangkai Yang,et al.  Do you see groups?: The impact of crowd density and viewpoint on the perception of groups , 2018, IVA.

[14]  Robert R. McCrae,et al.  Bibliography for the Revised NEO Personality Inventory (NEO PI-R ™ ) and NEO Five-Factor Inventory (NEO-FFI ™ ) , 2003 .

[15]  G. Hofstede Dimensionalizing cultures: The Hofstede model in context , 2011 .

[16]  O. John The "Big Five" factor taxonomy: Dimensions of personality in the natural language and in questionnaires. , 1990 .

[17]  Soraia Raupp Musse,et al.  Detecting personality and emotion traits in crowds from video sequences , 2018, Machine Vision and Applications.

[18]  R. Bhagat Culture's Consequences: Comparing Values, Behaviors, Institutions, and Organizations Across Nations , 2002 .

[19]  Soraia Raupp Musse,et al.  Using group behaviors to detect Hofstede cultural dimensions , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[20]  R. Alexander,et al.  A model of bipedal locomotion on compliant legs. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[21]  Soraia Raupp Musse,et al.  Crowd Analysis Using Computer Vision Techniques , 2010, IEEE Signal Processing Magazine.

[22]  J. M. Digman PERSONALITY STRUCTURE: EMERGENCE OF THE FIVE-FACTOR MODEL , 1990 .

[23]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[24]  Farid Nouioua,et al.  An approach for emotions and behavior modeling in a crowd in the presence of rare events , 2016, Adapt. Behav..

[25]  Ben Shneiderman,et al.  LifeLines: visualizing personal histories , 1996, CHI.