Varietal classification of barley by convolutional neural networks

Assuring high quality of beer is a key issue in the brewing industry. This can be achieved by controlling the brewing process and the quality of the ingredients. The currently employed visual inspection of malting barley requires expert knowledge and is time-consuming as well as expensive. It has been demonstrated that computer vision algorithms can replace human expertise in the detection of defective grains or in recognition of barley varieties. However, varietal classification based on colour, texture and morphological attributes returned accuracy of less than 75%. In this paper, nine implementations of convolutional neural networks are examined in their application to varietal classification. The comparison covers deep learning models and transfer learning models with regard to learning and classification times, computational requirements and classification accuracy. The use of convolutional neural networks enables barley classification with accuracy exceeding 93%.

[1]  Piotr Zapotoczny,et al.  Computer vision algorithm for barley kernel identification, orientation estimation and surface structure assessment , 2012 .

[2]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Samy Bengio,et al.  Torch: a modular machine learning software library , 2002 .

[4]  Noel D.G. White,et al.  Identification of insect-damaged wheat kernels using short-wave near-infrared hyperspectral and digital colour imaging , 2010 .

[5]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Jacek Reiner,et al.  Barley Variety Recognition with Viewpoint-Aware Double-Stream Convolutional Neural Networks , 2018, 2018 Federated Conference on Computer Science and Information Systems (FedCSIS).

[7]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[8]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[9]  J. Russ,et al.  Image Analysis of Foods. , 2015, Journal of food science.

[10]  Artur Klepaczko,et al.  Barley defects identification , 2017, Proceedings of the 10th International Symposium on Image and Signal Processing and Analysis.

[11]  H. Feichtinger,et al.  A Banach space of test functions for Gabor analysis , 1998 .

[12]  Ken-ichi Funahashi,et al.  On the approximate realization of continuous mappings by neural networks , 1989, Neural Networks.

[13]  Marcin Gabryel,et al.  Comparing Images Based on Histograms of Local Interest Points , 2013, PPAM.

[14]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[15]  J. Paliwal,et al.  Classification of cereal grains using a flatbed scanner , 2004 .

[16]  Piotr Zapotoczny,et al.  Application of image analysis for the varietal classification of barley:: Morphological features , 2008 .

[17]  Digvir S. Jayas,et al.  Classification of cereal grains using machine vision: I. Morphology models. , 2000 .

[18]  Makoto Ogawa,et al.  Food Detection and Recognition Using Convolutional Neural Network , 2014, ACM Multimedia.

[19]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[20]  Anil K. Jain,et al.  Texture classification and segmentation using multiresolution simultaneous autoregressive models , 1992, Pattern Recognit..

[21]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Artur Klepaczko,et al.  Identifying barley varieties by computer vision , 2015, Comput. Electron. Agric..

[23]  Katiganere Siddaramappa Hareesha,et al.  Quality Inspection and Grading of Agricultural and Food Products by Computer Vision- A Review , 2010 .

[24]  Thomas Brox,et al.  Descriptor Matching with Convolutional Neural Networks: a Comparison to SIFT , 2014, ArXiv.

[25]  José Blasco,et al.  Development of a machine for the automatic sorting of pomegranate (Punica granatum) arils based on computer vision , 2009 .

[26]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[27]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[28]  D. E. Briggs,et al.  Malts and Malting , 1998 .

[29]  Wei Liu,et al.  Potential of multispectral imaging for real-time determination of colour change and moisture distribution in carrot slices during hot air dehydration. , 2016, Food Chemistry.

[30]  Yihong Gong,et al.  Human Tracking Using Convolutional Neural Networks , 2010, IEEE Transactions on Neural Networks.

[31]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[32]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Da-Wen Sun,et al.  Inspection and grading of agricultural and food products by computer vision systems—a review , 2002 .

[34]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[35]  Razvan Pascanu,et al.  Theano: Deep Learning on GPUs with Python , 2012 .

[36]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[37]  R.M. Haralick,et al.  Statistical and structural approaches to texture , 1979, Proceedings of the IEEE.

[38]  Martin Thoma,et al.  Analysis and Optimization of Convolutional Neural Network Architectures , 2017, ArXiv.

[39]  H. K. Mebatsion,et al.  Automatic classification of non-touching cereal grains in digital images using limited morphological and color features , 2013 .

[40]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[41]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.