Visual quality assessment of malting barley using color, shape and texture descriptors

Abstract An essential part of the commercialization process of malting barley is the assessment of crop quality. While a traditional indicator of quality is the moisture content, visual inspection is normally carried out as well by an expert. Some indicators of sub-par crops are broken grains, contamination by foreign objects or other agricultural products, discoloration or abnormal pigmentation. We present a complete pipeline of vision and machine learning algorithms aimed at assessing the quality of malting barley grain. Previous solutions based on computer vision have solved this problem to varying degrees, and often require the grains under inspection to be clearly separated. We compare several feature vectors, combined with a nonlinear classifier. Our results show that the Local Phase Quantization descriptor, combined with color and shape features, provides the best results even against improved local descriptors like the Median Ternary Pattern or Median Robust Extended Local Binary Pattern. Our approach is fast, tolerates touching grains and provides an assessment that complies with local industry regulations.

[1]  J. Flusser,et al.  Moments and Moment Invariants in Pattern Recognition , 2009 .

[2]  Harpreet Kaur,et al.  Classification and Grading Rice Using Multi-Class SVM , 2013 .

[3]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[4]  Kaveh Mollazade,et al.  Toward an automatic wheat purity measuring device: A machine vision-based neural networks-assisted imperialist competitive algorithm approach , 2014 .

[5]  Daniel Cozzolino,et al.  Classification and Authentication of Barley (Hordeum vulgare) Malt Varieties: Combining Attenuated Total Reflectance Mid-infrared Spectroscopy with Chemometrics , 2017, Food Analytical Methods.

[6]  Jaime Gomez-Gil,et al.  A machine vision system for classification of wheat and barley grain kernels , 2011 .

[7]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Kamal Alameh,et al.  Effective plant discrimination based on the combination of local binary pattern operators and multiclass support vector machine methods , 2019, Information Processing in Agriculture.

[9]  Shutao Li,et al.  Face recognition using Weber local descriptors , 2013, Neurocomputing.

[10]  Piotr Zapotoczny,et al.  Computer vision algorithm for barley kernel identification, orientation estimation and surface structure assessment , 2012 .

[11]  S. Sergyan,et al.  Color histogram features based image classification in content-based image retrieval systems , 2008, 2008 6th International Symposium on Applied Machine Intelligence and Informatics.

[12]  A. Shyna,et al.  Machine vision based real time cashew grading and sorting system using SVM and back propagation neural network , 2017, 2017 International Conference on Circuit ,Power and Computing Technologies (ICCPCT).

[13]  Artur Klepaczko,et al.  Identifying barley varieties by computer vision , 2015, Comput. Electron. Agric..

[14]  Kadir Sabanci,et al.  Grain classifier with computer vision using adaptive neuro-fuzzy inference system. , 2017, Journal of the science of food and agriculture.

[15]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[16]  Kin-Man Lam,et al.  Histogram-based local descriptors for facial expression recognition (FER): A comprehensive study , 2018, J. Vis. Commun. Image Represent..

[17]  Matti Pietikäinen,et al.  Median Robust Extended Local Binary Pattern for Texture Classification , 2016, IEEE Trans. Image Process..

[18]  Saeid Minaei,et al.  Qualitative classification of milled rice grains using computer vision and metaheuristic techniques , 2015, Journal of Food Science and Technology.

[19]  P. Vithu,et al.  Machine vision system for food grain quality evaluation: A review , 2016 .

[20]  Vojislav Kecman,et al.  Support Vector Machines – An Introduction , 2005 .

[21]  Bruno H.G. Barbosa,et al.  A computer vision system for coffee beans classification based on computational intelligence techniques , 2016 .

[22]  Rafael Rieder,et al.  Computer vision and artificial intelligence in precision agriculture for grain crops: A systematic review , 2018, Comput. Electron. Agric..

[23]  Markus Neuhäuser,et al.  Wilcoxon Signed Rank Test , 2006 .