Fast object detection in pastoral landscapes using a Colour Feature Extreme Learning Machine

Abstract Object detection is an essential function of robotics based agricultural systems and many algorithms exist for this purpose. Colour although an important characteristic is often avoided in place of faster grey-scale implementations or is only used in an rudimentary arrangement. This study presents the Colour Feature Extreme Learning Machine (CF-ELM), which is an implementation of the extreme learning machine (ELM), with a partially connected hidden layer and a fully connected output layer, taking three colour inputs instead of the standard grey-scale input. The CF-ELM was tested with three different colour systems including HSV, RGB and Y’UV and compared for time and accuracy against the standard grey-scale ELM. The four implementations were tested on three different datasets including weed detection, vehicle detection and stock detection. It was found that the colour implementation performed better overall for all three datasets and the Y’UV was best performing colour system on all tested datasets. With the Y’UV delivering the highest accuracy in weed detection at 84%, 96% in vehicle detection and 86% in stock detection. Along side the CF-ELM, an algorithm is introduced for desktop based classification of objects within a pastoral landscape, with individual speeds between 0.06 s and 0.18 s for a single image, tested within each colour space. The algorithm is designed for use in a scenario that provides difficult and unpredictable terrain, making it ideal for use in an agricultural or pastoral landscape.

[1]  Chunyan Miao,et al.  Comparing the learning effectiveness of BP, ELM, I-ELM, and SVM for corporate credit ratings , 2014, Neurocomputing.

[2]  Ömer Faruk Ertuğrul,et al.  A Detailed Analysis on Extreme Learning Machine and Novel Approaches Based on ELM , 2015 .

[3]  R. Whalley,et al.  Managing saffron thistle in pastures with strategic grazing , 2002 .

[4]  Yaonan Wang,et al.  Bidirectional Extreme Learning Machine for Regression Problem and Its Learning Effectiveness , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Peeyush Soni,et al.  Development of an automatic grading machine for oil palm fresh fruits bunches (FFBs) based on machine vision , 2013 .

[6]  Tony E Grift,et al.  Variable field-of-view machine vision based row guidance of an agricultural robot , 2012 .

[7]  Shamik Sural,et al.  Segmentation and histogram generation using the HSV color space for image retrieval , 2002, Proceedings. International Conference on Image Processing.

[8]  J. Netland,et al.  Towards machine vision based site-specific weed management in cereals , 2012 .

[9]  Qi Ke,et al.  Real-time moving detection algorithm based on YUV color space , 2015 .

[10]  Amaury Lendasse,et al.  OP-ELM: Optimally Pruned Extreme Learning Machine , 2010, IEEE Transactions on Neural Networks.

[12]  David Zhang,et al.  SVM and ELM: Who Wins? Object Recognition with Deep Convolutional Features from ImageNet , 2015, ArXiv.

[13]  Jörn Ostermann,et al.  A Crop/Weed Field Image Dataset for the Evaluation of Computer Vision Based Precision Agriculture Tasks , 2014, ECCV Workshops.

[14]  R. Erb,et al.  Introduction to Backpropagation Neural Network Computation , 1993, Pharmaceutical Research.

[15]  Adam Wood,et al.  Quad bike injuries in Waikato, New Zealand: an institutional review from 2007–2011 , 2013, ANZ journal of surgery.

[16]  Hongming Zhou,et al.  Extreme Learning Machines [Trends & Controversies] , 2013 .

[17]  Hongming Zhou,et al.  Extreme Learning Machine based fast object recognition , 2012, 2012 15th International Conference on Information Fusion.

[18]  Aleksandra Kawala-Janik,et al.  YUV vs RGB-Choosing a Color Space for Human-Machine Interaction , 2014, FedCSIS.

[19]  José Blasco,et al.  In-line sorting of irregular potatoes by using automated computer-based machine vision system , 2012 .

[20]  M. Iqbal Saripan,et al.  Skin Segmentation Using YUV and RGB Color Spaces , 2014, J. Inf. Process. Syst..

[21]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[22]  S. Mohamed,et al.  Statistical Normalization and Back Propagation for Classification , 2022 .

[23]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[24]  Guang-Bin Huang,et al.  Trends in extreme learning machines: A review , 2015, Neural Networks.

[25]  Marius Otesteanu,et al.  Neural network based object recognition using color block matching , 2007 .

[26]  Armando J. Pinho,et al.  Color-spaces and color segmentation for real-time object recognition in robotic applications , 2007 .

[27]  R. Pranesh Krishnan,et al.  Color Recognition Algorithm using a Neural Network Model in Determining the Ripeness of a Banana , 2009 .

[28]  Teresa B. Ludermir,et al.  Comparison of new activation functions in neural network for forecasting financial time series , 2011, Neural Computing and Applications.

[29]  Zhiping Lin,et al.  Self-Adaptive Evolutionary Extreme Learning Machine , 2012, Neural Processing Letters.

[30]  André van Schaik,et al.  Explicit Computation of Input Weights in Extreme Learning Machines , 2014, ArXiv.

[31]  Yiqiang Chen,et al.  Weighted extreme learning machine for imbalance learning , 2013, Neurocomputing.

[32]  Prabhpreet Kaur,et al.  A Review : Color Models in Image Processing , 2014 .

[33]  Victor C. M. Leung,et al.  Extreme Learning Machines [Trends & Controversies] , 2013, IEEE Intelligent Systems.

[34]  Mark D. McDonnell,et al.  Fast, Simple and Accurate Handwritten Digit Classification by Training Shallow Neural Network Classifiers with the ‘Extreme Learning Machine’ Algorithm , 2015, PloS one.

[35]  Sébastien Chabrier,et al.  Hue and Saturation in the RGB Color Space , 2014, ICISP.