Computer-Assisted 3D Kinematic Analysis of All Leg Joints in Walking Insects

High-speed video can provide fine-scaled analysis of animal behavior. However, extracting behavioral data from video sequences is a time-consuming, tedious, subjective task. These issues are exacerbated where accurate behavioral descriptions require analysis of multiple points in three dimensions. We describe a new computer program written to assist a user in simultaneously extracting three-dimensional kinematics of multiple points on each of an insect's six legs. Digital video of a walking cockroach was collected in grayscale at 500 fps from two synchronized, calibrated cameras. We improved the legs' visibility by painting white dots on the joints, similar to techniques used for digitizing human motion. Compared to manual digitization of 26 points on the legs over a single, 8-second bout of walking (or 106,496 individual 3D points), our software achieved approximately 90% of the accuracy with 10% of the labor. Our experimental design reduced the complexity of the tracking problem by tethering the insect and allowing it to walk in place on a lightly oiled glass surface, but in principle, the algorithms implemented are extensible to free walking. Our software is free and open-source, written in the free language Python and including a graphical user interface for configuration and control. We encourage collaborative enhancements to make this tool both better and widely utilized.

[1]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  F. Delcomyn The Locomotion of the Cockroach Periplaneta Americana , 1971 .

[3]  G. M. Hughes The Co-Ordination of Insect Movements , 1958 .

[4]  C. Spirito,et al.  Interlimb Coordination During Slow Walking in the Cockroach: I. Effects of Substrate Alterations , 1979 .

[5]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[6]  R. Full,et al.  Mechanics of six-legged runners. , 1990, The Journal of experimental biology.

[7]  K. Pearson,et al.  Coxal depressor muscles of the cockroach and the role of peripheral inhibition. , 1971, The Journal of experimental biology.

[8]  R. Ritzmann,et al.  Kinematics and motor activity during tethered walking and turning in the cockroach, Blaberus discoidalis , 2005, Journal of Comparative Physiology A.

[9]  J. Pringle Proprioception In Insects: II. The Action Of The Campaniform Sensilla On The Legs , 1938 .

[10]  K. Pearson,et al.  Innervation of coxal depressor muscles in the cockroach, Periplaneta americana. , 1971, The Journal of experimental biology.

[11]  D. Graham,et al.  Behaviour and Motor Output of Stick Insects Walking on a Slippery Surface: I. Forward Walking , 1983 .

[12]  C. S. Carbonell The thoracic muscles of the cockroach Periplaneta americana (L.) , 1947 .

[13]  B Hedwig,et al.  Front leg movements and tibial motoneurons underlying auditory steering in the cricket (Gryllus bimaculatus deGeer) , 2008, Journal of Experimental Biology.

[14]  J. Pringle,et al.  Proprioception In Insects , 1938 .

[15]  F. Delcomyn,et al.  Motor Activity During Walking in the Cockroach Periplaneta Americana : II. Tethered Walking , 1973 .

[16]  R E Ritzmann,et al.  Characterization of obstacle negotiation behaviors in the cockroach, Blaberus discoidalis , 2009, Journal of Experimental Biology.

[17]  S. N. Fry,et al.  Context-dependent stimulus presentation to freely moving animals in 3D , 2004, Journal of Neuroscience Methods.

[18]  R. Snodgrass,et al.  The Insect cranium and the "epicranial suture." , 1947 .

[19]  G. M. Hughes The Co-Ordination of Insect Movements I The Walking Movements of Insects , 1952 .

[20]  K. Pearson,et al.  Nervous Mechanisms Underlying Intersegmental Co-Ordination of Leg Movements During Walking in the Cockroach , 1973 .

[21]  Roy E. Ritzmann,et al.  Control of obstacle climbing in the cockroach, Blaberus discoidalis. I. Kinematics , 2002, Journal of Comparative Physiology A.

[22]  L. Frantsevich,et al.  Gimbals in the insect leg. , 2009, Arthropod structure & development.

[23]  M. Dickinson,et al.  Visually Mediated Motor Planning in the Escape Response of Drosophila , 2008, Current Biology.

[24]  H. Cruse,et al.  COORDINATED WALKING OF STICK INSECTS ON A MERCURY SURFACE , 1981 .

[25]  Stefan Schuster,et al.  Fruit-Catching Fish Tune Their Fast Starts to Compensate for Drift , 2008, Current Biology.

[26]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[27]  A. Büschges Sensory control and organization of neural networks mediating coordination of multisegmental organs for locomotion. , 2005, Journal of neurophysiology.

[28]  R. Full,et al.  Three-dimensional kinematics and limb kinetic energy of running cockroaches. , 1997, The Journal of experimental biology.

[29]  J. T. Watson,et al.  Leg kinematics and muscle activity during treadmill running in the cockroach, Blaberus discoidalis : I. Slow running , 1997, Journal of Comparative Physiology A.

[30]  A K Tryba,et al.  Multi-joint coordination during walking and foothold searching in the Blaberus cockroach. II. Extensor motor neuron pattern. , 2000, Journal of neurophysiology.

[31]  A. Büschges,et al.  Tethered stick insect walking: A modified slippery surface setup with optomotor stimulation and electrical monitoring of tarsal contact , 2006, Journal of Neuroscience Methods.

[32]  G. Laurent,et al.  THE ORGANIZATION AND ROLE DURING LOCOMOTION OF THE PROXIMAL MUSCULATURE OF THE CRICKET FORELEG , 1986 .

[33]  Volker Dürr,et al.  A posture optimization algorithm for model-based motion capture of movement sequences , 2004, Journal of Neuroscience Methods.

[34]  A K Tryba,et al.  Multi-joint coordination during walking and foothold searching in the Blaberus cockroach. I. Kinematics and electromyograms. , 2000, Journal of neurophysiology.

[35]  Barbara Webb,et al.  A dynamic model of thoracic differentiation for the control of turning in the stick insect , 2007, Biological Cybernetics.

[36]  K. Pearson,et al.  Discharge patterns of coxal levator and depressor motoneurones of the cockroach, Periplaneta americana. , 1970, The Journal of experimental biology.

[37]  S. N. Fry,et al.  The aerodynamics of hovering flight in Drosophila , 2005, Journal of Experimental Biology.

[38]  R. Ritzmann,et al.  Motion analysis of leg joints associated with escape turns of the cockroach, Periplaneta americana , 1992, Journal of Comparative Physiology A.