EBOC: Ensemble-Based Ordinal Classification in Transportation

Learning the latent patterns of historical data in an efficient way to model the behaviour of a system is a major need for making right decisions. For this purpose, machine learning solution has already begun its promising marks in transportation as well as in many areas such as marketing, finance, education, and health. However, many classification algorithms in the literature assume that the target attribute values in the datasets are unordered, so they lose inherent order between the class values. To overcome the problem, this study proposes a novel ensemble-based ordinal classification (EBOC) approach which suggests bagging and boosting (AdaBoost algorithm) methods as a solution for ordinal classification problem in transportation sector. This article also compares the proposed EBOC approach with ordinal class classifier and traditional tree-based classification algorithms (i.e., C4.5 decision tree, RandomTree, and REPTree) in terms of accuracy. The results indicate that the proposed EBOC approach achieves better classification performance than the conventional solutions.

[1]  Jason D. M. Rennie,et al.  Loss Functions for Preference Levels: Regression with Discrete Ordered Labels , 2005 .

[2]  Jaime S. Cardoso,et al.  Learning to Classify Ordinal Data: The Data Replication Method , 2007, J. Mach. Learn. Res..

[3]  Brian Keith.  Barycentric coordinates for ordinal sentiment classification , 2017 .

[4]  Manohar Das,et al.  Driver Classification for Optimization of Energy Usage in a Vehicle , 2012, CSER.

[5]  Jun Ni,et al.  An Improved Ensemble Learning Method for Classifying High-Dimensional and Imbalanced Biomedicine Data , 2014, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[6]  P. Warner.  Ordinal logistic regression , 2008, Journal of Family Planning and Reproductive Health Care.

[7]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[8]  Fei-Yue Wang,et al.  Traffic Flow Prediction With Big Data: A Deep Learning Approach , 2015, IEEE Transactions on Intelligent Transportation Systems.

[9]  Sébastien Destercke,et al.  Cautious Ordinal Classification by Binary Decomposition , 2014, ECML/PKDD.

[10]  Serkan Balli,et al.  Diagnosis of transportation modes on mobile phone using logistic regression classification , 2017, IET Softw..

[11]  Eduardo Fernández,et al.  ELECTRE TRI-nB: A new multiple criteria ordinal classification method , 2017, Eur. J. Oper. Res..

[12]  Khaled Rasheed,et al.  Decision tree and ensemble learning algorithms with their applications in bioinformatics. , 2011, Advances in experimental medicine and biology.

[13]  Eibe Frank,et al.  A Simple Approach to Ordinal Classification , 2001, ECML.

[14]  Klaus Hechenbichler,et al.  Weighted k-Nearest-Neighbor Techniques and Ordinal Classification , 2004 .

[15]  Bart Baesens,et al.  RULEM: A novel heuristic rule learning approach for ordinal classification with monotonicity constraints , 2017, Appl. Soft Comput..

[16]  Hoang Nguyen,et al.  Automatic classification of traffic incident's severity using machine learning approaches , 2017 .

[17]  Ling Shao,et al.  A rapid learning algorithm for vehicle classification , 2015, Inf. Sci..

[18]  Wojciech Kotlowski,et al.  Ensemble of Decision Rules for Ordinal Classification with Monotonicity Constraints , 2008, RSKT.

[19]  Vadim V. Strijov,et al.  Ordinal classification using Pareto fronts , 2015, Expert Syst. Appl..

[20]  Ling Li,et al.  Ordinal Regression by Extended Binary Classification , 2006, NIPS.

[21]  Hsuan-Tien Lin,et al.  From ordinal ranking to binary classification , 2008 .

[22]  Derya Birant,et al.  Improving prediction performance using ensemble neural networks in textile sector , 2017, 2017 International Conference on Computer Science and Engineering (UBMK).

[23]  Wojciech Kotlowski,et al.  Ordinal Classification with Decision Rules , 2007, MCD.

[24]  Willem Waegeman,et al.  An ensemble of Weighted Support Vector Machines for Ordinal Regression , 2007 .

[25]  Raj Kumar,et al.  Classification Algorithms for Data Mining: a Survey , 2022 .

[26]  V. V. Sajith Variyar,et al.  Obstacle classification and detection for vision based navigation for autonomous driving , 2017, 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI).