Animated 3D Human Models for Use in Person Recognition Experiments

The development of increasingly realistic experimental stimuli and task environments is important for understanding behavior outside the laboratory. We report a process for generating 3D human model stimuli that combines commonly used graphics software and enables the flexible generation of animated human models while providing parametric control over individualized identity features. Our approach creates novel head models using FaceGen Modeller, attaches them to commercially-purchased 3D avatar bodies in 3D Studio Max, and generates Cal3D human models that are compatible with many virtual 3D environments. Stimuli produced by this method can be embedded as animated 3D avatars in interactive simulations or presented as 2D images embedded in scenes for use in traditional laboratory experiments. The inherent flexibility in this method makes the stimuli applicable to a broad range of basic and applied research questions in the domain of person perception. We describe the steps of the stimulus generation process, provide an example of their use in a recognition memory paradigm, and highlight the adaptability of the method for related avenues of research.

[1]  Jean M. Vettel,et al.  Mission-Based Scenario Research: Experimental Design and Analysis , 2012 .

[2]  Ulrich Neumann,et al.  Real-time procedural textures , 1992, I3D '92.

[3]  A. Rizzo,et al.  Virtual Reality and Neuropsychology: Upgrading the Current Tools , 2002, The Journal of head trauma rehabilitation.

[4]  T. Flash,et al.  Neuronal encoding of human kinematic invariants during action observation. , 2010, Cerebral cortex.

[5]  S. Campanella,et al.  Integrating face and voice in person perception , 2007, Trends in Cognitive Sciences.

[6]  G. Yovel,et al.  A unified coding strategy for processing faces and voices , 2013, Trends in Cognitive Sciences.

[7]  W. Bainbridge The Scientific Research Potential of Virtual Worlds , 2007, Science.

[8]  Emily S. Cross,et al.  Adaptation studies suggest interactive feedback shapes responses in occipitotemporal regions , 2011, Cognitive neuroscience.

[9]  Scott E. Kerick,et al.  Brain–Computer Interface Technologies in the Coming Decades , 2012, Proceedings of the IEEE.

[10]  M. Candidi,et al.  Visual body recognition in a prosopagnosic patient , 2012, Neuropsychologia.

[11]  Jason M. Gold,et al.  The response of face-selective cortex with single face parts and part combinations , 2012, Neuropsychologia.

[12]  Chris I Baker,et al.  Differential contributions of occipitotemporal regions to person perception , 2011, Cognitive neuroscience.

[13]  Alexandru Iosup,et al.  Procedural content generation for games: A survey , 2013, TOMCCAP.

[14]  A computer-generated face database with ratings on realism, masculinity, race, and stereotypy , 2011, Behavior research methods.

[15]  Swann Pichon,et al.  Perceiving fear in dynamic body expressions , 2007, NeuroImage.

[16]  Aaron J Newman,et al.  Communicative and noncommunicative point-light actions featuring high-resolution representation of the hands and fingers , 2013, Behavior research methods.

[17]  Jeremy J. Tree,et al.  Motion as a cue to face recognition: Evidence from congenital prosopagnosia , 2013, Neuropsychologia.

[18]  K. Scherer,et al.  FACSGen: A Tool to Synthesize Emotional Facial Expressions Through Systematic Manipulation of Facial Action Units , 2011 .

[19]  Olivier Corneille,et al.  Applying the attractor field model to social cognition: Perceptual discrimination is facilitated, but memory is impaired for faces displaying evaluatively congruent expressions. , 2007, Journal of personality and social psychology.

[20]  Brent Lance,et al.  A bag-of-words model for task-load prediction from EEG in complex environments , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[21]  J. Stekelenburg,et al.  The neural correlates of perceiving human bodies: an ERP study on the body-inversion effect , 2004, Neuroreport.

[22]  I. Biederman,et al.  Is Pigmentation Important for Face Recognition? Evidence from Contrast Negation , 2006, Perception.

[23]  H. Bülthoff,et al.  Face recognition under varying poses: The role of texture and shape , 1996, Vision Research.

[24]  Faces and bodies in the brain , 2011, Cognitive neuroscience.

[25]  K. Mathiak,et al.  Toward brain correlates of natural behavior: fMRI during violent video games , 2006, Human brain mapping.

[26]  F. Fang,et al.  Face adaptation improves gender discrimination , 2011, Vision Research.

[27]  D. Wolpert,et al.  Naturalistic approaches to sensorimotor control. , 2011, Progress in brain research.

[28]  Wayne D. Gray Simulated task environments: The role of high-fidelity simulations, scaled worlds, synthetic environments, and laboratory tasks in basic and applied cognitive research. , 2002 .

[29]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[30]  S. Shimojo,et al.  Gaze bias both reflects and influences preference , 2003, Nature Neuroscience.

[31]  Anthony J. Ries,et al.  A Novel Method for Single-Trial Classification in the Face of Temporal Variability , 2013, HCI.

[32]  F. Fang,et al.  Perceptual consequences of face viewpoint adaptation: face viewpoint aftereffect, changes of differential sensitivity to face view, and their relationship. , 2010, Journal of vision.

[33]  Christoph Scheepers,et al.  Face, body, and center of gravity mediate person detection in natural scenes. , 2010, Journal of experimental psychology. Human perception and performance.

[34]  William A. Cunningham,et al.  Continuous Cognitive Dynamics of the Evaluation of Trustworthiness in Williams Syndrome , 2012, Front. Psychology.

[35]  Anthony J. Ries,et al.  A Translational Approach to Neurotechnology Development , 2013, HCI.

[36]  Tzyy-Ping Jung,et al.  A Real-World Neuroimaging System to Evaluate Stress , 2013, HCI.

[37]  Nikolaus Kriegeskorte,et al.  Face-identity change activation outside the face system: "release from adaptation" may not always indicate neuronal selectivity. , 2010, Cerebral cortex.

[38]  Kelvin S. Oie,et al.  Cognition in action: imaging brain/body dynamics in mobile humans , 2011, Reviews in the neurosciences.

[39]  F. Fang,et al.  Transfer of the face viewpoint aftereffect from adaptation to different and inverted faces. , 2007, Journal of vision.

[40]  Alexander Todorov,et al.  Differential neural responses to faces physically similar to the self as a function of their valence , 2010, NeuroImage.

[41]  Y. Trope,et al.  Body Cues, Not Facial Expressions, Discriminate Between Intense Positive and Negative Emotions , 2012, Science.

[42]  Skyler T. Hawk,et al.  Presentation and validation of the Radboud Faces Database , 2010 .

[43]  Scott T Grafton,et al.  Individual differences in shifting decision criterion: A recognition memory study , 2012, Memory & cognition.

[44]  James W. Tanaka,et al.  Exploring the perceptual spaces of faces, cars, and birds in children and adults , 2010 .

[45]  Y. Trope,et al.  Holistic person processing: faces with bodies tell the whole story. , 2012, Journal of personality and social psychology.

[46]  A. Todorov,et al.  The functional basis of face evaluation , 2008, Proceedings of the National Academy of Sciences.

[47]  Max Coltheart,et al.  The effects of inversion and familiarity on face versus body cues to person recognition. , 2012, Journal of experimental psychology. Human perception and performance.

[48]  M. Tarr,et al.  Virtual reality in behavioral neuroscience and beyond , 2002, Nature Neuroscience.

[49]  Julie Grèzes,et al.  Specific and common brain regions involved in the perception of faces and bodies and the representation of their emotional expressions , 2009, Social neuroscience.

[50]  M. Tarr,et al.  Internal representations for face detection: An application of noise‐based image classification to BOLD responses , 2013, Human brain mapping.

[51]  Denise A. Minnebusch,et al.  Neuropsychological mechanisms of visual face and body perception , 2009, Neuroscience & Biobehavioral Reviews.

[52]  Ubbo Visser TopLeague and Bundesliga Manager: New Generation Online Soccer Games , 2010, RoboCup.

[53]  C. Thomaz,et al.  A new ranking method for principal components analysis and its application to face image analysis , 2010, Image Vis. Comput..

[54]  Stephen D. Goldinger,et al.  A multidimensional scaling analysis of own- and cross-race face spaces , 2010, Cognition.

[55]  Scott E. Kerick,et al.  Understanding Brain, Cognition, and Behavior in Complex Dynamic Environments , 2009, HCI.

[56]  S. Itakura,et al.  Similarities and Differences in Chinese and Caucasian Adults' Use of Facial Cues for Trustworthiness Judgments , 2012, PloS one.

[57]  Jean M. Vettel,et al.  The Mission-based Scenario: Rationale and Concepts to Enhance S&T Research Design , 2011 .

[58]  Mark Weiss,et al.  Social, Behavioral and Economic Research in the Federal Context , 2009 .

[59]  Kaleb McDowell,et al.  Neurocognitive engineering for systems development , 2011 .

[60]  Hyeonjoon Moon,et al.  The FERET evaluation methodology for face-recognition algorithms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[61]  Cristina Becchio,et al.  Inferring intentions from biological motion: A stimulus set of point-light communicative interactions , 2010, Behavior research methods.

[62]  B. de Gelder,et al.  Rapid influence of emotional scenes on encoding of facial expressions: an ERP study. , 2008, Social cognitive and affective neuroscience.

[63]  Alexander Todorov,et al.  Evaluating face trustworthiness: a model based approach. , 2008, Social cognitive and affective neuroscience.

[64]  Sophie Jörg,et al.  Investigating the role of body shape on the perception of emotion , 2009, TAP.

[65]  Andrew Olney,et al.  Building Rapport with a 3D Conversational Agent , 2011, ACII.

[66]  Brent Lance,et al.  Classifying High-Noise EEG in Complex Environments for Brain-Computer Interaction Technologies , 2011, ACII.

[67]  Tzyy-Ping Jung,et al.  Real-World Neuroimaging Technologies , 2013, IEEE Access.