Multiple fish tracking via Viterbi data association for low-frame-rate underwater camera systems

Non-extractive fish abundance estimation with the aid of visual analysis has drawn increasing attention. Low frame rate and variable illumination in the underwater environment, however, makes conventional tracking methods unreliable. In this paper, a robust multiple fish tracking system for low-frame-rate underwater stereo cameras is proposed. With the result of fish segmentation, a computationally efficient block-matching method is applied to perform successful stereo matching. A multiple-feature matching cost function is utilized to give a simple but effective metric for finding the temporal match of each target. Built upon reliable stereo matching, a multiple-target tracking algorithm via the Viterbi data association is developed to overcome the poor motion continuity of targets. Experimental results show that an accurate underwater live fish tracking result with stereo cameras is achieved.

[1]  Jenq-Neng Hwang,et al.  Automatic fish segmentation via double local thresholding for trawl-based underwater camera systems , 2011, 2011 18th IEEE International Conference on Image Processing.

[2]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[3]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[4]  Sachit Butail,et al.  3D reconstruction of fish schooling kinematics from underwater video , 2010, 2010 IEEE International Conference on Robotics and Automation.

[5]  Graham W. Pulford,et al.  Multi-Target Viterbi Data Association , 2006, 2006 9th International Conference on Information Fusion.

[6]  Emanuele Trucco,et al.  Computer and Robot Vision , 1995 .

[7]  James J. Little,et al.  A Linear Programming Approach for Multiple Object Tracking , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  David G. Hankin,et al.  Estimating Total Fish Abundance and Total Habitat Area in Small Streams Based on Visual Estimation Methods , 1988 .

[9]  Christof Koch,et al.  Detection and tracking of objects in underwater video , 2004, CVPR 2004.

[10]  Olivier Aycard,et al.  Multiple pedestrian tracking using Viterbi data association , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[11]  Jr. G. Forney,et al.  Viterbi Algorithm , 1973, Encyclopedia of Machine Learning.