Catadioptric stereo-vision system for the real-time monitoring of 3D behavior in aquatic animals

Fish species have been used as vertebrate model systems for numerous human diseases. However, a comprehensive monitoring system for continuously tracking the positions of aquatic animals is still lacking. Manual or simple automatic methods usually lead to false or incomplete behavioral parameters. In this paper, a video-based 3D system is proposed for monitoring aquatic animals. This system is comprised of a novel catadioptric stereo-vision setup and methods for robust tracking of 3D motion-related behavior. The system has many advantages over 2D monitoring methods, such as being able to completely monitor the animals' behavior in 3D space with high spatial and temporal resolution, track multiple animals simultaneously without any physical marker, and accurately reconstruct 3D motion trajectories despite the potential problems of water refraction and reflection. Alterations in swimming behavior following exposure to acute ethanol were studied in goldfish (Carassius auratus) using the 3D behavior monitoring system. In analyzing the experimental data, a systematic comparison was made between the 3D goldfish behavioral parameters and their dimensionally reduced 2D forms. It was found that the 3D monitoring method was able to generate more accurate behavioral parameters than the conventional 2D methods. Compared to the results from 3D method, the hypothesis test conclusions based on 2D methods are more prone to error. It is expected that the 3D behavior monitoring system can significantly improve the efficiency, accuracy, and cost-effectiveness of behavioral studies and of model development in aquatic animals; potential applications include pre-clinical drug development, in-vivo compound screening, and bio-sensing.

[1]  D. W. Goodwin,et al.  Biphasic and Reversible Adaptation of Goldfish to Alcohol , 1971, Nature.

[2]  Ming Ouhyoung,et al.  Extracting Realistic 3D Facial Animation Parameters from Multiview Video Clips , 2002, IEEE Computer Graphics and Applications.

[3]  H. Pollard,et al.  The Goldfish as a Drug Discovery Vehicle for Parkinson's Disease and Other Neurodegenerative Disorders , 1993, Annals of the New York Academy of Sciences.

[4]  R. Ryback,et al.  A method to study Short-Term Memory (STM) in the goldfish , 1976, Pharmacology Biochemistry and Behavior.

[5]  A. J Spink,et al.  The EthoVision video tracking system—A tool for behavioral phenotyping of transgenic mice , 2001, Physiology & Behavior.

[6]  Jian Yang,et al.  Dominant Feature Vectors Based Audio Similarity Measure , 2004, PCM.

[7]  Ivan Krekule,et al.  An automatic 3D tracking system with a PC and a single TV camera , 1999, Journal of Neuroscience Methods.

[8]  R. M. Krol,et al.  Use of the Japanese Medaka (Oryzias latipes) and Guppy (Poecilia reticulata) in Carcinogenesis Testing Under National Toxicology Program Protocols , 2003, Toxicologic pathology.

[9]  M. Haasch,et al.  Japanese medaka (Oryzias latipes): developmental model for the study of alcohol teratology. , 2006, Birth defects research. Part B, Developmental and reproductive toxicology.

[10]  John C. Crabbe,et al.  Tolerance and withdrawal in goldfish exposed to ethanol , 2006, Physiology & Behavior.

[11]  Colin Hunter,et al.  A video-based movement analysis system to quantify behavioral stress responses of fish. , 2004, Water research.

[12]  R S Ryback,et al.  The use of fish, especially goldfish, in alcohol research. , 1970, Quarterly journal of studies on alcohol.

[13]  Tetsu Nemoto,et al.  A computer image processing system for quantification of zebrafish behavior , 2004, Journal of Neuroscience Methods.

[14]  Richard A Rabin,et al.  Ethanol effects on three strains of zebrafish: model system for genetic investigations , 2003, Pharmacology Biochemistry and Behavior.

[15]  Yoshimasa Kawata,et al.  3-D measurement of objects in a cylindrical glass water tank with a laser range finder , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[16]  A. Rubinstein,et al.  Zebrafish: from disease modeling to drug discovery. , 2003, Current opinion in drug discovery & development.

[17]  John E. Dowling,et al.  Behavioral screening for cocaine sensitivity in mutagenized zebrafish , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Jeng-Sheng Yeh.  Extracting 3D facial animation parameters from multiview video clips - Computer Graphics and Applications, IEEE , 2001 .

[19]  R. Gerlai,et al.  Drinks like a fish: zebra fish (Danio rerio) as a behavior genetic model to study alcohol effects , 2000, Pharmacology Biochemistry and Behavior.

[20]  Pamela C Yelick,et al.  High-throughput behavioral screening method for detecting auditory response defects in zebrafish , 2002, Journal of Neuroscience Methods.