Appearance-based multiple fish tracking for collective motion analysis

We propose a visual tracking method for dense fish schools in which occlusions occur frequently. Although much progress has been made for tracking multiple objects in video images, it is challenging to track individuals in highly dense groups. For occluded fishes, estimation of their positions and directions is difficult. However, if we know the number of fishes in a local area, we can accurately estimate their states by matching all of the combinations of possible parameters on the basis of our appearance model. We apply the idea to track multiple fishes in a school. Experimental results show that multiple fishes are practically tracked with our method compared to a well-known tracking method, and the average difference is less than 4%b of the mean body length of the school.

[1]  Mubarak Shah,et al.  Floor Fields for Tracking in High Density Crowd Scenes , 2008, ECCV.

[2]  T. Vicsek,et al.  Collective Motion , 1999, physics/9902023.

[3]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[4]  C. Hemelrijk,et al.  The increased efficiency of fish swimming in a school , 2013, 1307.7282.

[5]  Pascal Poncin,et al.  A video multitracking system for quantification of individual behavior in a large fish shoal: Advantages and limits , 2009, Behavior research methods.

[6]  Kei Terayama,et al.  A Measurement Method for Speed Distribution of Collective Motion with Optical Flow and its Application to Estimation of Rotation Curve , 2014, 2014 IEEE International Symposium on Multimedia.

[7]  Xi En Cheng,et al.  Automatically Detect and Track Multiple Fish Swimming in Shallow Water with Frequent Occlusion , 2014, PloS one.

[8]  David Lentink,et al.  Automated visual tracking for studying the ontogeny of zebrafish swimming , 2008, Journal of Experimental Biology.

[9]  J. Steffensen,et al.  Aerobic capacity influences the spatial position of individuals within fish schools , 2012, Proceedings of the Royal Society B: Biological Sciences.

[10]  Robert T. Collins,et al.  Belief Propagation in a 3D Spatio-temporal MRF for Moving Object Detection , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[12]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[13]  Colin R. Twomey,et al.  Visual sensory networks and effective information transfer in animal groups , 2013, Current Biology.

[14]  Yanxi Liu,et al.  Multi-target tracking of time-varying spatial patterns , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Tetsu Nemoto,et al.  A computer image processing system for quantification of zebrafish behavior , 2004, Journal of Neuroscience Methods.

[16]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[17]  Sachit Butail,et al.  Three-dimensional reconstruction of the fast-start swimming kinematics of densely schooling fish , 2012, Journal of The Royal Society Interface.