On the Use of Nominal and Ordinal Classifiers for the Discrimination of States of Development in Fish Oocytes

The analysis of microscopic images of fish gonad cells (oocytes) is a useful tool to estimate parameters of fish reproductive ecology and to analyze fish population dynamics. The study of oocyte dynamics is needed to understand ovary development and reproductive cycle of fish. Oocytes go through different developmental states in a continuum temporal sequence providing an interesting example of ordinal classification, which is not exploited by the current oocyte analysis software. This promising paradigm of machine learning known as ordinal classification or ordinal regression focus on classification problems where there exist a natural order between the classes, thus requiring specific methods and evaluation metrics. In this paper we compare 11 ordinal and 15 nominal state-of-the-art classifiers using oocytes of three fish species (Merluccius merluccius, Trisopterus luscus and Reinhardtius hippoglossoides). The best results are achieved by SVMOD, an ordinal decomposition method of the labelling space based on the Support Vector Machine, varying strongly with the number of states for each specie (about 95 and 80 % of accuracy with three and six states respectively). The classifiers designed specially for ordinal classification are able to capture the underlying nature of the state ordering much better than common nominal classifiers. This is demonstrated by several metrics specially designed to measure misclassification errors associated to states far in the ranking scale.

[1]  Willem Waegeman,et al.  An ensemble of Weighted Support Vector Machines for Ordinal Regression , 2007 .

[2]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[3]  P. McCullagh,et al.  Monograph on Statistics and Applied Probability , 1989 .

[4]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[5]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Y. Freund,et al.  Discussion of the Paper \additive Logistic Regression: a Statistical View of Boosting" By , 2000 .

[7]  Pedro Antonio Gutiérrez,et al.  Projection-Based Ensemble Learning for Ordinal Regression , 2014, IEEE Transactions on Cybernetics.

[8]  Xiaoming Zhang,et al.  Kernel Discriminant Learning for Ordinal Regression , 2010, IEEE Transactions on Knowledge and Data Engineering.

[9]  C. Spearman The proof and measurement of association between two things. , 2015, International journal of epidemiology.

[10]  Yoshua Bengio,et al.  Pattern Recognition and Neural Networks , 1995 .

[11]  M. C. Sainza-Sousa,et al.  Time scale ovarian maturation in Greenland halibut , 2001 .

[12]  Eibe Frank,et al.  A Simple Approach to Ordinal Classification , 2001, ECML.

[13]  Manuel Fernández Delgado,et al.  Exhaustive comparison of colour texture features and classification methods to discriminate cells categories in histological images of fish ovary , 2013, Pattern Recognit..

[14]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[15]  Hunter,et al.  Fecundity, Spawning, and Maturity of Female Dover Sole, Microstomus Pacificus, with an Evaluation of Assumptions and Precision , 2013 .

[16]  R. Rideout,et al.  Oogenesis and the spawning pattern in Greenland halibut from the North-west Atlantic , 1999 .

[17]  Senén Barro,et al.  Do we need hundreds of classifiers to solve real world classification problems? , 2014, J. Mach. Learn. Res..

[18]  Agnes C. Gundersen,et al.  Greenland halibut (Reinhardtius hippoglossoides) spawn annually but successive cohorts of oocytes develop over 2 years, complicating correct assessment of maturity , 2011 .

[19]  Susan A. Murphy,et al.  Monographs on statistics and applied probability , 1990 .

[20]  Meng Joo Er,et al.  Generalized Single-Hidden Layer Feedforward Networks for Regression Problems , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Jaime S. Cardoso,et al.  Learning to Classify Ordinal Data: The Data Replication Method , 2007, J. Mach. Learn. Res..

[22]  E Román,et al.  Time scale of ovarian maturation in Greenland halibut (Reinhardtius hippoglossoides, Walbaum) , 2003 .

[23]  Esteban Alfaro Cortés,et al.  Multiclass Corporate Failure Prediction by Adaboost.M1 , 2007 .

[24]  Qinghua Zheng,et al.  Ordinal extreme learning machine , 2010, Neurocomputing.

[25]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Wei Chu,et al.  Support Vector Ordinal Regression , 2007, Neural Computation.

[27]  M. Kendall A NEW MEASURE OF RANK CORRELATION , 1938 .

[28]  María Pérez-Ortiz,et al.  An Experimental Study of Different Ordinal Regression Methods and Measures , 2012, HAIS.

[29]  Ling Li,et al.  Large-Margin Thresholded Ensembles for Ordinal Regression: Theory and Practice , 2006, ALT.

[30]  K. Hanagaki,et al.  V % Table of Contents , 1988 .

[31]  Ling Li,et al.  Ordinal Regression by Extended Binary Classification , 2006, NIPS.

[32]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[33]  M. Morgan,et al.  Temporal and geographic variation in maturity at length and age of Greenland halibut (Reinhardtius hippoglossoides) from the Canadian north-west Atlantic with implications for fisheries management , 1997 .

[34]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[35]  Jean Carletta,et al.  Assessing Agreement on Classification Tasks: The Kappa Statistic , 1996, CL.

[36]  P. McCullagh,et al.  Generalized Linear Models , 1984 .

[37]  S. Cessie,et al.  Ridge Estimators in Logistic Regression , 1992 .

[38]  ZhangRui,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012 .

[39]  Max F. Meyer,et al.  The Proof and Measurement of Association between Two Things. , 1904 .

[40]  Pedro Antonio Gutiérrez,et al.  Metrics to guide a multi-objective evolutionary algorithm for ordinal classification , 2014, Neurocomputing.

[41]  Philip M. Long,et al.  Algorithmic Learning Theory, 17th International Conference, ALT 2006, Barcelona, Spain, October 7-10, 2006, Proceedings , 2006, ALT.