Eye-catching crowds: saliency based selective variation

Populated virtual environments need to be simulated with as much variety as possible. By identifying the most salient parts of the scene and characters, available resources can be concentrated where they are needed most. In this paper, we investigate which body parts of virtual characters are most looked at in scenes containing duplicate characters or clones. Using an eye-tracking device, we recorded fixations on body parts while participants were asked to indicate whether clones were present or not. We found that the head and upper torso attract the majority of first fixations in a scene and are attended to most. This is true regardless of the orientation, presence or absence of motion, sex, age, size, and clothing style of the character. We developed a selective variation method to exploit this knowledge and perceptually validated our method. We found that selective colour variation is as effective at generating the illusion of variety as full colour variation. We then evaluated the effectiveness of four variation methods that varied only salient parts of the characters. We found that head accessories, top texture and face texture variation are all equally effective at creating variety, whereas facial geometry alterations are less so. Performance implications and guidelines are presented.

[1]  Daniel Thalmann,et al.  Real-time Shader Rendering for Crowds in Virtual Heritage , 2005, VAST.

[2]  J. Cutting,et al.  Recognizing friends by their walk: Gait perception without familiarity cues , 1977 .

[3]  M. Farah Is an Object an Object an Object? Cognitive and Neuropsychological Investigations of Domain Specificity in Visual Object Recognition , 1992 .

[4]  A. L. I︠A︡rbus Eye Movements and Vision , 1967 .

[5]  Pedro V. Sander,et al.  Drawing a Crowd , 2004 .

[6]  Andrew Hollingworth,et al.  Eye Movements During Scene Viewing: An Overview , 1998 .

[7]  Carol O'Sullivan,et al.  Clone attack! Perception of crowd variety , 2008, SIGGRAPH 2008.

[8]  Shaul Hochstein,et al.  Rapid vision is holistic , 2004 .

[9]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[10]  Pawan Sinha,et al.  Face Recognition by Humans: Nineteen Results All Computer Vision Researchers Should Know About , 2006, Proceedings of the IEEE.

[11]  L. Stark,et al.  Scanpaths in Eye Movements during Pattern Perception , 1971, Science.

[12]  Scott Daly,et al.  Engineering observations from spatiovelocity and spatiotemporal visual models , 1998, Electronic Imaging.

[13]  Alan Chalmers,et al.  Detail to Attention: Exploiting Visual Tasks for Selective Rendering , 2003, Rendering Techniques.

[14]  Jonathan Maïm,et al.  Reviving the Roman Odeon of Aphrodisias: Dynamic Animation and Variety Control of Crowds in Virtual Heritage , 2005 .

[15]  T. Beardsworth,et al.  The ability to recognize oneself from a video recording of one’s movements without seeing one’s body , 1981 .

[16]  David W. Jacobs,et al.  Mesh saliency , 2005, SIGGRAPH 2005.

[17]  Timo Saari,et al.  Using eye tracking and psychophysiological methods to study spatial presence , 2003 .

[18]  Daniel Thalmann,et al.  Populating virtual environments with crowds , 2006, VRCIA '06.

[19]  H. Nothdurft Faces and Facial Expressions do not Pop Out , 1993, Perception.

[20]  J. Henderson Object identification in context: the visual processing of natural scenes. , 1992, Canadian journal of psychology.

[21]  Laurent Itti,et al.  Computational mechanisms for gaze direction in interactive visual environments , 2006, ETRA.

[22]  Carol O'Sullivan,et al.  Predicting and Evaluating Saliency for Simplified Polygonal Models , 2005, TAP.

[23]  Luc Van Gool,et al.  Populating Ancient Pompeii with Crowds of Virtual Romans , 2007, VAST.

[24]  Kerri L. Johnson,et al.  Perceiving Sex Directly and Indirectly , 2005, Psychological science.

[25]  Donald P. Greenberg,et al.  Spatiotemporal sensitivity and visual attention for efficient rendering of dynamic environments , 2005, TOGS.

[26]  Céline Loscos,et al.  Visualizing Crowds in Real‐Time , 2002, Comput. Graph. Forum.