Real-time Animal Detection System for Intelligent Vehicles

Animal and Vehicle Collisions (AVCs) have been a growing concern in North America since the abundant wildlife resources and increases of automobiles. Such problems cause hundreds of people deaths, thousands of human injuries, billions of dollars in property damage and countless of wildlife deaths every year. To address these challenges, smart cars have to be equipped with Advanced Driver Assistance Systems (ADAS) able to detect dangerous animals (e.g., moose, elk and cow), which cross the road, and warn the driver about the imminent accident. In this thesis, we explore the performance of different image features and classification algorithms in animal detection application, and design a real-time animal detection system following three criteria: detection accuracy, detection time and system energy consumption. In order to pursue high detection rate but low time and energy consumption, a double-stage detection system is proposed. In the first stage, we use the LBP adopting AdaBoost algorithm which provides the next stage by a set of region of interests containing target animals and other false positive targets. Afterward, the second stage rejects the false positive ROIs by two HOG-SVM based sub-classifiers. To build and evaluate the animal detector, we create our own database, which will be updated by adding new samples. Through an extensive set of evaluations, we note that the double-stage system is able to detect about 85% of target animals.

[1]  Tomaso A. Poggio,et al.  Example-Based Learning for View-Based Human Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[3]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Alejandro F. Frangi,et al.  Haar-like features with optimally weighted rectangles for rapid object detection , 2010, Pattern Recognition.

[5]  Christopher Nowakowski,et al.  Evaluation of an Animal Warning System Effectiveness Phase Two , 2012 .

[6]  A. Seiler Predicting locations of moose–vehicle collisions in Sweden , 2005 .

[7]  Ahmed F. Zobaa,et al.  Neural Network Applications in Electrical Engineering , 2007, Neurocomputing.

[8]  David A. Forsyth,et al.  Building models of animals from video , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Weiwei Zhang,et al.  From Tiger to Panda: Animal Head Detection , 2011, IEEE Transactions on Image Processing.

[10]  Hirofumi Nishimura,et al.  Local Binary Pattern features for pedestrian detection at night/dark environment , 2011, 2011 18th IEEE International Conference on Image Processing.

[11]  P. Garrett OVERVIEW OF ANIMAL DETECTION AND ANIMAL WARNING SYSTEMS IN NORTH AMERICA AND EUROPE , 2016 .

[12]  Topi Mäenpää,et al.  The local binary pattern approach to texture analysis - extensions and applications , 2003 .

[13]  Aleksandar Milenkovic,et al.  Smartphones for smart wheelchairs , 2013, 2013 IEEE International Conference on Body Sensor Networks.

[14]  Hong Wei,et al.  Face Verification Using GaborWavelets and AdaBoost , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[15]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[16]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[17]  Debao Zhou Infrared Thermal Camera-Based Real-Time Identification and Tracking of Large Animals to Prevent Animal-Vehicle Collisions (AVCs) on Roadways , 2012 .

[18]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[19]  Johannes Stallkamp,et al.  Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition , 2012, Neural Networks.

[20]  Manjiri Pathak,et al.  Smart Home System using Android Application , 2015 .

[21]  Francisco Suárez,et al.  Can we mitigate animal–vehicle accidents using predictive models? , 2004 .

[22]  Mark S. Nixon,et al.  Feature Extraction and Image Processing , 2002 .

[23]  Lars Petersson,et al.  Large scale sign detection using HOG feature variants , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[24]  Azzedine Boukerche,et al.  An efficient animal detection system for smart cars using cascaded classifiers , 2014, 2014 IEEE International Conference on Communications (ICC).

[25]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[27]  R. Nowak,et al.  Walker's mammals of the world , 1968 .

[28]  A. Broggi,et al.  Pedestrian Detection using Infrared images and Histograms of Oriented Gradients , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[29]  Tomaso A. Poggio,et al.  A general framework for object detection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[30]  Matthias Zeppelzauer Automated detection of elephants in wildlife video , 2013, EURASIP J. Image Video Process..

[31]  Xiaohui Liu,et al.  Real-time traffic sign recognition from video by class-specific discriminative features , 2010, Pattern Recognit..

[32]  Xin Yi,et al.  DEER-VEHICLE CRASH COUNTERMEASURE TOOLBOX: A DECISION AND CHOICE RESOURCE , 2004 .

[33]  Peijiang Chen Moving Object Detection Based on Background Extraction , 2009, 2009 International Symposium on Computer Network and Multimedia Technology.

[34]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[35]  C. Bahlmann,et al.  Real-time recognition of U.S. speed signs , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[36]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[37]  Thomas S. Huang,et al.  Image processing , 1971 .

[38]  Patrick Tracy McGowen,et al.  The Comparison of Animal Detection Systems in a Test-Bed: A Quantitative Comparison of System Reliability and Experiences with Operation and Maintenance Final report , 2009 .

[39]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[40]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[42]  Tony Jebara,et al.  Machine Learning: Discriminative and Generative (Kluwer International Series in Engineering and Computer Science) , 2003 .

[43]  Mary Gray Advances in Wildlife Crossing Technologies , 2009 .

[44]  Johannes Stallkamp,et al.  The German Traffic Sign Recognition Benchmark: A multi-class classification competition , 2011, The 2011 International Joint Conference on Neural Networks.

[45]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[46]  Thomas Williams,et al.  Thermal Imaging Cameras: Characteristics and Performance , 2009 .

[47]  Patrick Tracy McGowen,et al.  Wildlife-Vehicle Collision Reduction Study: Report to Congress , 2007 .

[48]  Shengcai Liao,et al.  Face Detection Based on Multi-Block LBP Representation , 2007, ICB.

[49]  Narendra Ahuja,et al.  A SNoW-Based Face Detector , 1999, NIPS.

[50]  Thomas Huang,et al.  Multiple Animal Species Detection Using Robust Principal Component Analysis and Large Displacement Optical Flow , 2012 .

[51]  T. Burghardt,et al.  Real-time Face Detection and Tracking of Animals , 2006, 2006 8th Seminar on Neural Network Applications in Electrical Engineering.