Crowd motion capture

In this paper a new and original technique to animate a crowd of human beings is presented. Following the success of data-driven animation models (such as motion capture) in the context of articulated figures control, we propose to derivate a similar type of approach for crowd motions. In our framework, the motion of the crowds are represented as a time series of velocity fields estimated from a video of a real crowd. This time series is used as an input of a simple animation model that ‘advect’ people along this time-varying flow. We demonstrate the power of our technique on both synthetic and real examples of crowd videos. We also introduce the notions of crowd motion editing and present possible extensions to our work. Copyright © 2007 John Wiley & Sons, Ltd.

[1]  Demetri Terzopoulos,et al.  Animating autonomous pedestrians , 2005, SIGGRAPH '05.

[2]  Marie-Paule Cani,et al.  Animal gaits from video , 2004, SCA '04.

[3]  Patrick Pérez,et al.  Dense estimation and object-based segmentation of the optical flow with robust techniques , 1998, IEEE Trans. Image Process..

[4]  Dan Crisan,et al.  Particle Filters - A Theoretical Perspective , 2001, Sequential Monte Carlo Methods in Practice.

[5]  Michael J. Black.  Recursive Non-Linear Estimation of Discontinuous Flow Fields , 1994, ECCV.

[6]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[7]  Jessica K. Hodgins,et al.  Flow-based video synthesis and editing , 2004, SIGGRAPH 2004.

[8]  Ramakant Nevatia,et al.  Tracking multiple humans in crowded environment , 2004, CVPR 2004.

[9]  Neill W. Campbell,et al.  Capture and synthesis of insect motion , 2005, SCA '05.

[10]  Nicolas Courty,et al.  Simulation of Large Crowds Including Gaseous Phenomena , 2005 .

[11]  Daniel Thalmann,et al.  Hierarchical Model for Real Time Simulation of Virtual Human Crowds , 2001, IEEE Trans. Vis. Comput. Graph..

[12]  Patrick Pérez,et al.  Dense Estimation of Fluid Flows , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Soraia Raupp Musse,et al.  Modeling individual behaviors in crowd simulation , 2003, Proceedings 11th IEEE International Workshop on Program Comprehension.

[14]  F. L. Dimet,et al.  Variational algorithms for analysis and assimilation of meteorological observations: theoretical aspects , 1986 .

[15]  Takeshi Sakuma,et al.  Psychological model for animating crowded pedestrians , 2005, Comput. Animat. Virtual Worlds.

[16]  Stephen Chenney,et al.  Flow tiles , 2004, SCA '04.

[17]  Robert B. Fisher,et al.  Modelling Crowd Scenes for Event Detection , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[18]  Eric Bouvier,et al.  From crowd simulation to airbag deployment: particle systems, a new paradigm of simulation , 1997, J. Electronic Imaging.

[19]  R. Hughes.  The flow of human crowds , 2003 .

[20]  Jing Xiao,et al.  Vision-based control of 3D facial animation , 2003, SCA '03.

[21]  David C. Brogan,et al.  Realistic human walking paths , 2003, Proceedings 11th IEEE International Workshop on Program Comprehension.

[22]  Michael Gleicher,et al.  Scalable behaviors for crowd simulation , 2004, Comput. Graph. Forum.

[23]  Richard Szeliski,et al.  Video textures , 2000, SIGGRAPH.

[24]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH Classes.

[25]  Victor J. Blue,et al.  Cellular automata microsimulation for modeling bi-directional pedestrian walkways , 2001 .

[26]  Peter J. Huber,et al.  Robust Statistics , 2005, Wiley Series in Probability and Statistics.

[27]  Patrick Bouthemy,et al.  Computation and analysis of image motion: A synopsis of current problems and methods , 1996, International Journal of Computer Vision.

[28]  Dirk Helbing,et al.  Simulating dynamical features of escape panic , 2000, Nature.

[29]  Arunachalam Somasundaram,et al.  Inserting synthetic characters into live-action scenes of multiple people , 2003, Proceedings 11th IEEE International Workshop on Program Comprehension.

[30]  Adrien Treuille,et al.  Continuum crowds , 2006, SIGGRAPH 2006.

[31]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[32]  Julien Diener,et al.  Hierarchical retargetting of 2D motion fields to the animation of 3D plant models , 2006, SCA '06.