Computer vision based food grain classification: A comprehensive survey

This manuscript presents a comprehensive survey on recent computer vision based food grain classification techniques. It includes state-of-the-art approaches intended for different grain varieties. The approaches proposed in the literature are analyzed according to the processing stages considered in the classification pipeline, making it easier to identify common techniques and comparisons. Additionally, the type of images considered by each approach (i.e., images from the: visible, infrared, multispectral, hyperspectral bands) together with the strategy used to generate ground truth data (i.e., real and synthetic images) are reviewed. Finally, conclusions highlighting future needs and challenges are presented.

[1]  X. Ni,et al.  Classifying maize kernels naturally infected by fungi using near-infrared hyperspectral imaging , 2020 .

[2]  B. Pattanasiri,et al.  Colour measurements of pigmented rice grain using flatbed scanning and image analysis , 2017 .

[3]  Sukhvir Kaur,et al.  Geometric Feature Extraction of Selected Rice Grains using Image Processing Techniques , 2015 .

[4]  B. Osborne,et al.  Classification of Sound and Stained Wheat Grains Using Visible and near Infrared Hyperspectral Image Analysis , 2007 .

[5]  A V Vlasov,et al.  A machine learning approach for grain crop’s seed classification in purifying separation , 2017 .

[6]  J. Araus,et al.  Wheat ear counting in-field conditions: high throughput and low-cost approach using RGB images , 2018, Plant Methods.

[7]  Sheng Huang,et al.  Research on Classification Method of Maize Seed Defect Based on Machine Vision , 2019, J. Sensors.

[8]  R. Birla,et al.  An Efficient Method for Quality Analysis of Rice Using Machine Vision System , 2015 .

[9]  Biprodip Pal,et al.  A Deep Convolutional Neural Network Approach to Rice Grain Purity Analysis , 2020 .

[10]  Paul J. Williams,et al.  Classification of white maize defects with multispectral imaging. , 2018, Food chemistry.

[11]  Ali Douik,et al.  Cereal Grain Classification by Optimal Features and Intelligent Classifiers , 2010, Int. J. Comput. Commun. Control.

[12]  H. K. Mebatsion,et al.  Automatic classification of non-touching cereal grains in digital images using limited morphological and color features , 2013 .

[13]  Angel D. Sappa,et al.  Deep Learning based Corn Kernel Classification , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[14]  F. Ma,et al.  Online Variety Discrimination of Rice Seeds Using Multispectral Imaging and Chemometric Methods , 2016 .

[15]  Nguyen Thai-Nghe,et al.  Deep Learning for Rice Quality Classification , 2019, 2019 International Conference on Advanced Computing and Applications (ACOMP).

[16]  Henry Arguello,et al.  Non-Destructive Method for Classification of Cocoa Beans from Spectral Information , 2019, 2019 XXII Symposium on Image, Signal Processing and Artificial Vision (STSIVA).

[17]  Edwin R. Arboleda,et al.  An image processing technique for coffee black beans identification , 2018, 2018 IEEE International Conference on Innovative Research and Development (ICIRD).

[18]  Paul J. Williams,et al.  Near Infrared Hyperspectral Imaging for White Maize Classification According to Grading Regulations , 2019, Food Analytical Methods.

[19]  Michał Kozłowski,et al.  Varietal classification of barley by convolutional neural networks , 2019, Biosystems Engineering.

[20]  Yong He,et al.  Hyperspectral Image-Based Variety Classification of Waxy Maize Seeds by the t-SNE Model and Procrustes Analysis , 2018, Sensors.

[21]  Yunhong Liu,et al.  Detection Potential of Multi-Features Representation of E-Nose Data in Classification of Moldy Maize Samples , 2017, Food and Bioprocess Technology.

[22]  Zafer Cömert,et al.  Identification of haploid and diploid maize seeds using convolutional neural networks and a transfer learning approach , 2019, Comput. Electron. Agric..

[23]  Hoyos,et al.  Quality and Defect Inspection of Green Coffee Beans Using a Computer Vision System , 2019, Applied Sciences.

[24]  Huang Min,et al.  Maize Seed Variety Classification Using the Integration of Spectral and Image Features Combined with Feature Transformation Based on Hyperspectral Imaging , 2016 .

[25]  Megha R. Siddagangappa,et al.  Classification and Quality Analysis of Food Grains , 2014 .

[26]  K. Wen,et al.  Computer vision technology determines optimal physical parameters for sorting JinDan 73 maize seeds , 2015 .

[27]  Hamit Köksel,et al.  A classification system for beans using computer vision system and artificial neural networks , 2007 .

[28]  Saeid Minaei,et al.  A hybrid intelligent approach based on computer vision and fuzzy logic for quality measurement of milled rice , 2015 .

[29]  Fumio Okura,et al.  Training instance segmentation neural network with synthetic datasets for crop seed phenotyping , 2020, Communications Biology.

[30]  Min Jiang,et al.  Evaluation and analysis the chalkiness of connected rice kernels based on image processing technology and support vector machine , 2014 .

[31]  Amit Yerpude,et al.  Classification of Basmati Rice Grain Variety using Image Processing and Principal Component Analysis , 2014, ArXiv.

[32]  Lokesh R. Boregowda,et al.  Annotation-free Quality Estimation of Food Grains using Deep Neural Network , 2019, BMVC.

[33]  Yong He,et al.  A Deep Convolutional Neural Network Architecture for Boosting Image Discrimination Accuracy of Rice Species , 2018, Food and Bioprocess Technology.

[34]  Young-Mi Kang,et al.  A two-camera machine vision approach to separating and identifying laboratory sprouted wheat kernels , 2016 .

[35]  Laijun Sun,et al.  Classification of wheat grains in different quality categories by near infrared spectroscopy and support vector machine , 2016, 2016 2nd International Conference on Cloud Computing and Internet of Things (CCIOT).

[36]  Mie Mie Tin,et al.  Myanmar Rice Grain Classification Using Image Processing Techniques , 2018, Advances in Intelligent Systems and Computing.

[37]  Kadir Sabanci,et al.  Computer vision-based method for classification of wheat grains using artificial neural network. , 2017, Journal of the science of food and agriculture.

[38]  Saurabh Chaudhury,et al.  Efficient technique for rice grain classification using back-propagation neural network and wavelet decomposition , 2016, IET Comput. Vis..

[39]  Piotr Zapotoczny,et al.  Application of image analysis for the varietal classification of barley:: Morphological features , 2008 .

[40]  J. Koenderink.  Q… , 2014, Les noms officiels des communes de Wallonie, de Bruxelles-Capitale et de la communaute germanophone.

[41]  Zhenwei Shi,et al.  MugNet: Deep learning for hyperspectral image classification using limited samples , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[42]  C. S. Silva,et al.  Classification of Rice Grains Using Neural Networks , 2013 .

[43]  Jianhua Wang,et al.  Application of Computer Vision Technology on Seed Conditioning and Parameter Determination of Zhengdan958 Corn Variety (Zea Mays L.) , 2018, DEStech Transactions on Computer Science and Engineering.

[44]  Saurabh Chaudhury,et al.  A cascade network for the classification of rice grain based on single rice kernel , 2020, Complex & Intelligent Systems.

[45]  Wei Liu,et al.  Nondestructive determination of transgenic Bacillus thuringiensis rice seeds (Oryza sativa L.) using multispectral imaging and chemometric methods. , 2014, Food chemistry.

[46]  Thae Nu Wah,et al.  Analysis on Feature Extraction and Classification of Rice Kernels for Myanmar Rice Using Image Processing Techniques , 2018, International Journal of Scientific and Research Publications (IJSRP).

[47]  Mikhail Genaev,et al.  Evaluation of the SeedCounter, A Mobile Application for Grain Phenotyping , 2017, Front. Plant Sci..

[48]  Worapan Kusakunniran,et al.  Localization and Classification of Rice-grain Images Using Region Proposals-based Convolutional Neural Network , 2020, Int. J. Autom. Comput..

[49]  Nen-Fu Huang,et al.  Real-Time Classification of Green Coffee Beans by Using a Convolutional Neural Network , 2019, 2019 3rd International Conference on Imaging, Signal Processing and Communication (ICISPC).

[50]  Jaime Gomez-Gil,et al.  A machine vision system for classification of wheat and barley grain kernels , 2011 .

[51]  Sahin Isik,et al.  Wheat grain classification by using dense SIFT features with SVM classifier , 2016, Comput. Electron. Agric..

[52]  V. S. Malemath,et al.  Color and Texture Based Identification and Classification of food Grains using different Color Models and Haralick features , 2011 .

[53]  N. S. Visen,et al.  Cereal Grain and Dockage Identification using Machine Vision , 2003 .

[54]  Artur Klepaczko,et al.  Identifying barley varieties by computer vision , 2015, Comput. Electron. Agric..

[55]  D. Jayas,et al.  Classification of cereal grains using wavelet, morphological, colour, and textural features of non-touching kernel images , 2008 .

[56]  Harish S. Gujjar,et al.  A Method for Identification of Basmati Rice grain of India and Its Quality Using Pattern Classification , 2012 .

[57]  Harpreet Kaur,et al.  Classification and Grading Rice Using Multi-Class SVM , 2013 .

[58]  S. J. Mousavirad,et al.  Design of an Expert System for Rice Kernel Identification using Optimal Morphological Features and Back Propagation Neural Network , 2012 .

[59]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[60]  Min Huang,et al.  Maize seed classification using hyperspectral image coupled with multi-linear discriminant analysis , 2019 .

[61]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[62]  Chu Zhang,et al.  Variety Identification of Single Rice Seed Using Hyperspectral Imaging Combined with Convolutional Neural Network , 2018 .