Skeleton-Based 3D Tracking of Multiple Fish From Two Orthogonal Views

This paper proposes a skeleton-based method for tracking multiple fish in 3D space. First, skeleton analysis is performed to simplify object into feature point representation according to shape characteristics of fish. Next, based on the obtained feature points, object association and matching are achieved to acquire the motion trajectories of fish in 3D space. This process relies on top-view tracking that is supplemented by side-view detection. While fully exploiting the shape and motion information of fish, the proposed method is able to solve the problems of frequent occlusions that occur during the tracking process and has good tracking performance.

[1]  Pierre R Martineau,et al.  Tracking zebrafish larvae in group--status and perspectives. , 2013, Methods.

[2]  Alexandru Telea,et al.  An Augmented Fast Marching Method for Computing Skeletons and Centerlines , 2002, VisSym.

[3]  A. Pérez-Escudero,et al.  idTracker: tracking individuals in a group by automatic identification of unmarked animals , 2014, Nature Methods.

[4]  Masahiro Nakagawa,et al.  Effect of sodium hypochlorite on zebrafish swimming behavior estimated by fractal dimension analysis. , 2008, Journal of bioscience and bioengineering.

[5]  Sachit Butail,et al.  Three-dimensional reconstruction of the fast-start swimming kinematics of densely schooling fish , 2012, Journal of The Royal Society Interface.

[6]  H. Maaswinkel,et al.  Using an Automated 3D-tracking System to Record Individual and Shoals of Adult Zebrafish , 2013, Journal of Visualized Experiments.

[7]  Pietro Perona,et al.  Automated image-based tracking and its application in ecology. , 2014, Trends in ecology & evolution.

[8]  Xi En Cheng,et al.  An effective and robust method for tracking multiple fish in video image based on fish head detection , 2016, BMC Bioinformatics.

[9]  Cees J. Voesenek,et al.  Automated Reconstruction of Three-Dimensional Fish Motion, Forces, and Torques , 2016, PloS one.

[10]  Ye Liu,et al.  3D tracking swimming fish school using a master view tracking first strategy , 2016, 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[11]  Pascal Poncin,et al.  Video multitracking of fish behaviour: a synthesis and future perspectives , 2013 .

[12]  Wei Weng,et al.  Catadioptric stereo-vision system for the real-time monitoring of 3D behavior in aquatic animals , 2007, Physiology & Behavior.