Recognition of Mould Colony on Unhulled Paddy Based on Computer Vision using Conventional Machine-learning and Deep Learning Techniques

To investigate the potential of conventional and deep learning techniques to recognize the species and distribution of mould in unhulled paddy, samples were inoculated and cultivated with five species of mould, and sample images were captured. The mould recognition methods were built using support vector machine (SVM), back-propagation neural network (BPNN), convolutional neural network (CNN), and deep belief network (DBN) models. An accuracy rate of 100% was achieved by using the DBN model to identify the mould species in the sample images based on selected colour-histogram parameters, followed by the SVM and BPNN models. A pitch segmentation recognition method combined with different classification models was developed to recognize the mould colony areas in the image. The accuracy rates of the SVM and CNN models for pitch classification were approximately 90% and were higher than those of the BPNN and DBN models. The CNN and DBN models showed quicker calculation speeds for recognizing all of the pitches segmented from a single sample image. Finally, an efficient uniform CNN pitch classification model for all five types of sample images was built. This work compares multiple classification models and provides feasible recognition methods for mouldy unhulled paddy recognition.

[1]  Roberto Kawakami Harrop Galvão,et al.  A method for calibration and validation subset partitioning. , 2005, Talanta.

[2]  Jürgen Schmidhuber,et al.  Multi-column deep neural network for traffic sign classification , 2012, Neural Networks.

[3]  Dan Liu,et al.  Applications of Computer Vision for Assessing Quality of Agri-food Products: A Review of Recent Research Advances , 2016, Critical reviews in food science and nutrition.

[4]  Zhang Qiang,et al.  Rapid Non-destructive Detection for Molds Colony of Paddy Rice Based on Near Infrared Spectroscopy , 2014 .

[5]  Elisabeth Fredlund,et al.  Moulds and mycotoxins in rice from the Swedish retail market , 2009, Food additives & contaminants. Part A, Chemistry, analysis, control, exposure & risk assessment.

[6]  Baohua Zhang,et al.  Principles, developments and applications of computer vision for external quality inspection of fruits and vegetables: A review , 2014 .

[7]  K. C. Williams,et al.  Effective Use in Livestock Feeds of Mouldy and Weather-damaged Grain Containing Mycotoxins-Case Histories and Economic Assessments Pertaining to Pig and Poultry Industries of Queensland , 1991 .

[8]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[9]  Chenchen Huang,et al.  A Research of Speech Emotion Recognition Based on Deep Belief Network and SVM , 2014 .

[10]  Tahir Mehmood,et al.  The diversity in the applications of partial least squares: an overview , 2016 .

[11]  Li Yanxiao,et al.  Rapid detecting total acid content and classifying different types of vinegar based on near infrared spectroscopy and least-squares support vector machine. , 2013, Food chemistry.

[12]  Christophe Garcia,et al.  Convolutional face finder: a neural architecture for fast and robust face detection , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Rommel M. Barbosa,et al.  Recognition of organic rice samples based on trace elements and support vector machines , 2016 .

[14]  M. C. U. Araújo,et al.  The successive projections algorithm for variable selection in spectroscopic multicomponent analysis , 2001 .

[15]  Andrea Cavallaro,et al.  Sensor Capability and Atmospheric Correction in Ocean Colour Remote Sensing , 2015, Remote. Sens..

[16]  Amy Loutfi,et al.  Classification and Segmentation of Satellite Orthoimagery Using Convolutional Neural Networks , 2016, Remote. Sens..

[17]  R. Brereton,et al.  Support vector machines for classification and regression. , 2010, The Analyst.

[18]  Jonathan Tompson,et al.  Efficient object localization using Convolutional Networks , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  A. Pohland.  Mycotoxins in review. , 1993, Food additives and contaminants.

[20]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[21]  Yan-Fu Kuo,et al.  Detecting Bakanae disease in rice seedlings by machine vision , 2016, Comput. Electron. Agric..

[22]  E. Verbrugghe,et al.  Influence of Mycotoxins and a Mycotoxin Adsorbing Agent on the Oral Bioavailability of Commonly Used Antibiotics in Pigs , 2012, Toxins.

[23]  Y. Makino,et al.  Monitoring fungal growth on brown rice grains using rapid and non-destructive hyperspectral imaging. , 2015, International journal of food microbiology.

[24]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[25]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.

[26]  Jungho Im,et al.  Support vector machines in remote sensing: A review , 2011 .

[27]  Anant Madabhushi,et al.  A Deep Convolutional Neural Network for segmenting and classifying epithelial and stromal regions in histopathological images , 2016, Neurocomputing.

[28]  Guo Kangquan,et al.  Classification of ripening stages of bananas based on support vector machine , 2015 .

[29]  Lenan Wu,et al.  Comment on ‘Principles, developments and applications of computer vision for external quality inspection of fruits and vegetables: A review (Food Research International; 2014, 62: 326–343)’ , 2015 .

[30]  Roberto Kawakami Harrop Galvão,et al.  A variable elimination method to improve the parsimony of MLR models using the successive projections algorithm , 2008 .

[31]  I. Elishakoff,et al.  Antioptimization of earthquake exitation and response , 1998 .

[32]  Saeid Minaei,et al.  Potential Applications of Computer Vision in Quality Inspection of Rice: A Review , 2015, Food Engineering Reviews.

[33]  S. Vieira.  Nutritional implications of mould development in feedstuffs and alternatives to reduce the mycotoxin problem in poultry feeds , 2003 .