Fish identification from videos captured in uncontrolled underwater environments

There is an urgent need for the development of sampling techniques which can provide accurate and precise count, size, and biomass data for fish. This information is essential to support the decision-making processes of fisheries and marine conservation managers and scientists. Digital video technology is rapidly improving, and it is now possible to record long periods of high resolution digital imagery cost effectively, making single or stereo-video systems one of the primary sampling tools. However, manual species identification, counting, and measuring of fish in stereo-video images is labour intensive and is the major disincentive against the uptake of this technology. Automating species identification using technologies developed by researchers in computer vision and machine learning would transform marine science. In this article, a new paradigm of image set classification is presented that can be used to achieve improved recognition rates for a number of fish species. State-of-the-art image set construction, modelling, and matching algorithms from computer vision literature are discussed with an analysis of their application for automatic fish species identification. It is demonstrated that these algorithms have the potential of solving the automatic fish species identification problem in underwater videos captured within unconstrained environments.

[1]  Hannah M Murphy,et al.  Observational methods used in marine spatial monitoring of fishes and associated habitats: a review , 2010 .

[2]  Norval J. C. Strachan,et al.  Automated measurement of species and length of fish by computer vision , 2006 .

[3]  Riwal Lefort,et al.  Classifying fish schools and estimating their species proportions in fishery-acoustic surveys , 2009 .

[4]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[5]  Narendra Ahuja,et al.  Robust Visual Tracking via Structured Multi-Task Sparse Learning , 2012, International Journal of Computer Vision.

[6]  Aboul Ella Hassanien,et al.  Applications of Computational Intelligence in Biology: Current Trends and Open Problems , 2008, Applications of Computational Intelligence in Biology.

[7]  Ajmal S. Mian,et al.  Face Recognition Using Sparse Approximated Nearest Points between Image Sets , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[9]  Robert B. Fisher,et al.  Detecting, Tracking and Counting Fish in Low Quality Unconstrained Underwater Videos , 2008, VISAPP.

[10]  Victor Alchanatis,et al.  Real-time underwater sorting of edible fish species , 2007 .

[11]  Simone Calderara,et al.  Visual Tracking: An Experimental Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Shortis,et al.  A System for Stereo-Video Measurement of Sub-Tidal Organisms: Implications for assessments of reef fish stocks , 1995 .

[13]  Robert B. Fisher,et al.  Automatic fish classification for underwater species behavior understanding , 2010, ARTEMIS '10.

[14]  Ajmal Mian,et al.  A review of techniques for the identification and measurement of fish in underwater stereo-video image sequences , 2013, Optical Metrology.

[15]  Michael C. Fairhurst,et al.  A New Method for the Synthesis of Signature Data With Natural Variability , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  H. Abdi,et al.  Principal component analysis , 2010 .

[17]  Christof Koch,et al.  Detection and tracking of objects in underwater video , 2004, CVPR 2004.

[18]  Rasmus Larsen,et al.  Shape and Texture Based Classification of Fish Species , 2009, SCIA.

[19]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[20]  Phil Culverhouse,et al.  Time to automate identification , 2010, Nature.

[21]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[22]  N. J. C. Strachan,et al.  Recognition of fish species by colour and shape , 1993, Image Vis. Comput..

[23]  Boaz Zion,et al.  Sorting fish by computer vision , 1999 .

[24]  Arif Mahmood,et al.  Correlation-Coefficient-Based Fast Template Matching Through Partial Elimination , 2012, IEEE Transactions on Image Processing.

[25]  Narendra Ahuja,et al.  Robust Visual Tracking Via Consistent Low-Rank Sparse Learning , 2014, International Journal of Computer Vision.

[26]  Frank Storbeck,et al.  Fish species recognition using computer vision and a neural network , 2001 .

[27]  Robert B. Fisher,et al.  A flexible system for automated composition of intelligent video analysis , 2011, 2011 7th International Symposium on Image and Signal Processing and Analysis (ISPA).

[28]  Andrew Rova,et al.  One Fish, Two Fish, Butterfish, Trumpeter: Recognizing Fish in Underwater Video , 2007, MVA.

[29]  Paul G. Fernandes,et al.  Classification trees for species identification of fish-school echotraces , 2009 .

[30]  Alastair R. Allen,et al.  Fish species recognition by shape analysis of images , 1990, Pattern Recognit..

[31]  Chaur-Chin Chen,et al.  Real-world underwater fish recognition and identification, using sparse representation , 2014, Ecol. Informatics.

[32]  Dah-Jye Lee,et al.  Contour Matching for Fish Species Recognition and Migration Monitoring , 2008, Applications of Computational Intelligence in Biology.

[33]  Boaz Zion,et al.  In-vivo fish sorting by computer vision , 2000 .

[34]  Laurence T. Kell,et al.  A potential method for the differentiation between haddock fish stocks by computer vision using canonical discriminant analysis , 1995 .

[35]  Euan S. Harvey,et al.  Potential of video techniques to monitor diversity, abundance and size of fish in studies of Marine Protected Areas , 2003 .

[36]  J. A. Marchant,et al.  Fish sizing and monitoring using a stereo image analysis system applied to fish farming , 1995 .

[37]  Dominique Pelletier,et al.  Underwater video techniques for observing coastal marine biodiversity: A review of sixty years of publications (1952–2012) , 2014 .

[38]  Frédéric Precioso,et al.  Fish Species Recognition from Video using SVM Classifier , 2014, MAED '14.

[39]  Robert B. Fisher,et al.  Hierarchical classification with reject option for live fish recognition , 2014, Machine Vision and Applications.