A cascading scheme for speeding up multiple classifier systems

Abstract The accuracy of multi-class classification problems is improving at a good pace. However, improving the accuracy often leads to slowing down the processing speed. Since employing a large number of classifiers or a combination of them is a time-consuming process, the sluggish behavior is more evident in multiple classifier systems. In this paper, a practical cascading scheme is proposed for boosting the speed of a multiple binary classifier system with no noticeable reduction in recognition rate. The proposed cascading scheme sets a sequence of binary classifiers and applies one classifier at a time to the input. Some effective criteria for a practical ordering of classifiers are introduced, and a fusion of them is verified to be the best. A vehicle make and model recognition (VMMR) system with multiple individual classifiers is presented briefly as a use case for a multi-class classification problem. The experiments done on this VMMR system using two completely different datasets confirm the effectiveness of our scheme. One of the configurations of the proposed scheme results in up to 30% speedup in comparison with the baseline VMMR system with analogous recognition rate. Another configuration of the proposed cascading scheme achieves up to 80% speedup with just a minor drop in accuracy.

[1]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Qiuxia Wu,et al.  Real-time vehicle detection with foreground-based cascade classifier , 2016, IET Image Process..

[3]  A. Techmer,et al.  Real-time detection of traffic signs on a multi-core processor , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[4]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[5]  Alan L. Yuille,et al.  A Time-Efficient Cascade for Real-Time Object Detection: With applications for the visually impaired , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[6]  Xiaoou Tang,et al.  A large-scale car dataset for fine-grained categorization and verification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Venu Govindaraju,et al.  Review of Classifier Combination Methods , 2008, Machine Learning in Document Analysis and Recognition.

[9]  Jonathan Brandt,et al.  Robust object detection via soft cascade , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Matt J. Kusner,et al.  Classifier cascades and trees for minimizing feature evaluation cost , 2014, J. Mach. Learn. Res..

[11]  Anelia Angelova,et al.  Real-Time Pedestrian Detection with Deep Network Cascades , 2015, BMVC.

[12]  Hamid Hassanpour,et al.  Part-based recognition of vehicle make and model , 2017, IET Image Process..

[13]  Zhaowei Cai,et al.  A real-time cascade pedestrian detection based on heterogeneous features , 2015, 2015 International SoC Design Conference (ISOCC).

[14]  Jiri Matas,et al.  WaldBoost - learning for time constrained sequential detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  David A. McAllester,et al.  Cascade object detection with deformable part models , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Xiaogang Wang,et al.  Learning Chained Deep Features and Classifiers for Cascade in Object Detection , 2017, ArXiv.