A system for the capture and synthesis of insect motion

We present an integrated system that enables the capture and synthesis of 3D motions of small scale dynamic creatures, typically insects and arachnids, in order to drive computer generated models. The system consists of a number of stages, initially, the acquisition of a multi-view calibration scene and synchronised video footage of a subject performing some action is carried out. A user guided labelling process, that can be semi-automated using tracking techniques and a 3D point generating algorithm, then enables a full metric calibration and captures the motions of specific points on the subject. The 3D motions extracted, which often come from a limited number of frames of the original footage, are then extended to generate potentially infinitely long, characteristic motion sequences for multiple similar subjects. Finally a novel path following algorithm is used to find optimal path along with coherent motion for synthetic subjects.

[1]  Craig W. Reynolds Steering Behaviors For Autonomous Characters , 1999 .

[2]  Venkataramanan Balakrishnan,et al.  System identification: theory for the user (second edition): Lennart Ljung; Prentice-Hall, Englewood Cliffs, NJ, 1999, ISBN 0-13-656695-2 , 2002, Autom..

[3]  Richard J. Martin A metric for ARMA processes , 2000, IEEE Trans. Signal Process..

[4]  Pascal Fua,et al.  Style‐Based Motion Synthesis † , 2004, Comput. Graph. Forum.

[5]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[6]  Richard Szeliski,et al.  Video textures , 2000, SIGGRAPH.

[7]  David A. Forsyth,et al.  Motion synthesis from annotations , 2003, ACM Trans. Graph..

[8]  Ankur Agarwal,et al.  Tracking Articulated Motion Using a Mixture of Autoregressive Models , 2004, ECCV.

[9]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[11]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[12]  M. Cummins,et al.  The Art of 3-D Computer Animation and Effects, Third Edition , 2003 .

[13]  Neill W. Campbell,et al.  Combining sampling and autoregression for motion synthesis , 2004, Proceedings Computer Graphics International, 2004..

[14]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[15]  Dima Damen,et al.  Recognizing linked events: Searching the space of feasible explanations , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[17]  Stefan Carlsson,et al.  Monocular 3D Reconstruction of Human Motion in Long Action Sequences , 2004, ECCV.

[18]  Neill W. Campbell,et al.  Capture and synthesis of insect motion , 2005, SCA '05.

[19]  Lucas Kovar,et al.  Motion Graphs , 2002, ACM Trans. Graph..

[20]  Harry Shum,et al.  Motion texture: a two-level statistical model for character motion synthesis , 2002, ACM Trans. Graph..

[21]  Michael I. Jordan Graphical Models , 2003 .

[22]  Isaac Kerlow,et al.  The Art of 3D Computer Animation and Effects , 2008 .

[23]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[24]  Edward H. Adelson,et al.  PYRAMID METHODS IN IMAGE PROCESSING. , 1984 .

[25]  P. B. Coaker,et al.  Applied Dynamic Programming , 1964 .

[26]  David A. Forsyth,et al.  Finding and tracking people from the bottom up , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..