Real-time grain impurity sensing for rice combine harvesters using image processing and decision-tree algorithm

Abstract The cleaning of rice on a combine harvester is a complex process, which leads to differences in impurity ratio of harvested grain, and the impurity ratio is one of the key criteria for the assessment of performance of a combine harvester. Combine operators usually optimize parameter settings only once for harvesting each crop because of time pressure, and therefore differences in site- and temporal-specific conditions are neglected. In this paper, to offer combine operators the opportunity to make better management decision, a machine vision method for grain impurity monitoring of a rice combine harvester in real time was proposed, and the classification of kernel and impurity particles using decision tree algorithm was presented. To obtain images of high quality during harvesting, the structure of the sampling device depending on the working properties in grain bin was designed, the illumination and installation of the light source were optimized, and finally lateral lighting system was constructed. To monitor and recognize grains and impurities, the morphological features of the particles extracted from the images were acquired. The selected 6 features (A1-A6), including area, perimeter, maximal feret diameter, elongation factor, compactness factor and Heywood circularity factor, were fed to the decision tree algorithm for classification. Output of the algorithm, a visualized tree, was used to classify the particles labeled in the binary image. The decision tree provided a classification accuracy of about 76% for the given training data set extracted from the captured images. From the experimental results, it is suggested that the method of monitoring the impurity ratio of harvested grains based on decision tree algorithm using image processing can be recommended as the basis of parameter optimization of combine harvesters.

[1]  Yubin Lan,et al.  Development of an airborne remote sensing system for crop pest management: system integration and verification. , 2009 .

[2]  Zhong Tang,et al.  Optimum design of an array structure for the grain loss sensor to upgrade its resolution for harvesting rice in a combine harvester , 2017 .

[3]  Adi Pamungkas,et al.  Beef Quality Identification Using Thresholding Method and Decision Tree Classification Based on Android Smartphone , 2017 .

[4]  Xiaodong Liu,et al.  A Pearson's correlation coefficient based decision tree and its parallel implementation , 2018, Inf. Sci..

[5]  Miroslav Pikl,et al.  Spectral monitoring of wheat canopy under uncontrolled conditions for decision making purposes , 2016, Comput. Electron. Agric..

[6]  Shangbo Zhou,et al.  Range Limited Peak-Separate Fuzzy Histogram Equalization for image contrast enhancement , 2014, Multimedia Tools and Applications.

[7]  Chunjiang Zhao,et al.  Fast detection and visualization of early decay in citrus using Vis-NIR hyperspectral imaging , 2016, Comput. Electron. Agric..

[8]  Yankun Peng,et al.  High-Throughput Raman Chemical Imaging for Rapid Evaluation of Food Safety and Quality , 2014 .

[9]  S. Narendranath,et al.  Fault Diagnosis of Face Milling Tool using Decision Tree and Sound Signal , 2018 .

[10]  Dmitry Bratanov,et al.  A Novel Methodology for Improving Plant Pest Surveillance in Vineyards and Crops Using UAV-Based Hyperspectral and Spatial Data , 2018, Sensors.

[11]  Venkatesh Meda,et al.  Artificial Neural Network for Assessment of Grain Losses for Paddy Combine Harvester a Novel Approach , 2011 .

[12]  Lav R. Khot,et al.  High-throughput field phenotyping in dry bean using small unmanned aerial vehicle based multispectral imagery , 2018, Comput. Electron. Agric..

[13]  Josse De Baerdemaeker,et al.  A genetic input selection methodology for identification of the cleaning process on a combine harvester, Part I: Selection of relevant input variables for identification of the sieve losses , 2007 .

[14]  Giyoung Kim,et al.  Detection of Lettuce Discoloration Using Hyperspectral Reflectance Imaging , 2015, Sensors.

[15]  Biljana Abolmasov,et al.  The rainfall-induced landsliding in Western Serbia: A temporal prediction approach using Decision Tree technique , 2018 .

[16]  Zhan Zhao,et al.  Sensor for monitoring rice grain sieve losses in combine harvesters , 2016 .

[17]  D. C. Williams,et al.  REMOTE SENSING OF VINEYARD MANAGEMENT ZONES: IMPLICATIONS FOR WINE QUALITY , 2001 .

[18]  Kuo-Wei Liao,et al.  Detection of rust defects on steel bridge coatings via digital image recognition , 2016 .

[19]  Kurt C. Lawrence,et al.  Morphological Image Analysis for Foodborne Bacteria Classification , 2018 .

[20]  Ofer Levi,et al.  Detection of Green Apples in Hyperspectral Images of Apple-Tree Foliage Using Machine Vision , 2007 .

[21]  Hong Sun,et al.  Potato feature prediction based on machine vision and 3D model rebuilding , 2017, Comput. Electron. Agric..

[22]  Wenquan Feng,et al.  Brightness preserving image enhancement based on a gradient and intensity histogram , 2015, J. Electronic Imaging.

[23]  Yaoming Li,et al.  Original papers: Grain separation loss monitoring system in combine harvester , 2011 .

[24]  L. Johnson,et al.  FEASIBILITY OF MONITORING COFFEE FIELD RIPENESS WITH AIRBORNE MULTISPECTRAL IMAGERY , 2004 .

[25]  Zou Shuliang,et al.  $\gamma $ -Ray Detection Using Commercial Off-the-Shelf CMOS and CCD Image Sensors , 2017, IEEE Sensors Journal.

[26]  Lizhang Xu,et al.  NUMERICAL AND EXPERIMENTAL ANALYSIS OF AIRFLOW IN A MULTI-DUCT CLEANING SYSTEM FOR A RICE COMBINE HARVESTER , 2016 .

[27]  Usman Ahmad,et al.  Double Lighting Machine Vision System to Monitor Harvested Paddy Grain Quality during Head-Feeding Combine Harvester Operation , 2015 .

[28]  Ryszard Myhan,et al.  Grain separation in a straw walker unit of a combine harvester: Process model , 2016 .