Determination of the Amount of Grain in Silos With Deep Learning Methods Based on Radar Spectrogram Data

Since the grain is a crucial food source, the determination of the quantity of stored grain in silos is inevitable in terms of commercial and correct inventory planning. In this study, a convolutional neural network (CNN) is developed to determine grain quantity using the spectrograms of the radar backscattering data. The radar backscattering signals of different amounts of grain for different grain surface condition types are collected using a stepped frequency continuous-wave radar system. In the scaled model silo, a total of 5681 measurements are carried out for grain stacks with different surface patterns and different weights (0–20 kg). Then, the dataset is constituted by using the spectrograms of these radar measurements. Randomly selected 4261 data corresponding to 75% of the dataset are used for training and the remaining 1420 data are used for testing. The proposed method is compared with pretrained CNN. Accuracy of the methods is given with metric parameters for both classification and regression. The classification task results of the proposed method are obtained as 98.45% accuracy, 98.15% sensitivity, 99.07% specitivity, 98.77% precision, 98.45% F1-Score, and 97.62% Matthews correlation coefficient. The regression task results are calculated as 0.3228 mean absolute error, 0.5150 mean absolute percentage error (MAPE), 0.9649 mean squared error, and 0.9823 root-mean-squared error. The proposed method is also compared with previous studies in the literature (with 3.29 MAPE) and its superiority is demonstrated with metric parameters. The results point out that, if CNN is properly modeled and trained, the combination of CNN and proper signal processing can provide effective results in the quantity measurement applications of the grain stacks.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Michael Vogt,et al.  Silo and Tank Vision: Applica?tions, Challenges, and Technical Solutions for Radar Measurement of Liquids and Bulk Solids in Tanks and Silos , 2017, IEEE Microwave Magazine.

[3]  Guilherme Serpa Sestito,et al.  Machine-learning classification of environmental conditions inside a tank by analyzing radar curves in industrial level measurements , 2021 .

[4]  Hüseyin Duysak Level Measurement in Grain Silos with Extreme Learning Machine Algorithm , 2019, 2019 Scientific Meeting on Electrical-Electronics & Biomedical Engineering and Computer Science (EBBT).

[5]  Lei Li,et al.  Computer vision-based method for monitoring grain quantity change in warehouses , 2020 .

[6]  Tomoaki Ohtsuki,et al.  Heartbeat detection with Doppler radar based on spectrogram , 2017, 2017 IEEE International Conference on Communications (ICC).

[7]  Enes Yigit A novel compressed sensing based quantity measurement method for grain silos , 2018, Comput. Electron. Agric..

[8]  John L. Semmlow,et al.  Biosignal and Medical Image Processing , 2004 .

[9]  Zhigang Liu,et al.  Automatic Defect Detection of Fasteners on the Catenary Support Device Using Deep Convolutional Neural Network , 2018, IEEE Transactions on Instrumentation and Measurement.

[10]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Yonina C. Eldar,et al.  Fast Deep Learning for Automatic Modulation Classification , 2019, ArXiv.

[12]  Xiaohua Zhu,et al.  Remote Structural Health Monitoring for Industrial Wind Turbines Using Short-Range Doppler Radar , 2021, IEEE Transactions on Instrumentation and Measurement.

[13]  Deep Learning-Based Automatic Monitoring Method for Grain Quantity Change in Warehouse Using Semantic Segmentation , 2021, IEEE Transactions on Instrumentation and Measurement.

[14]  Rich Caruana,et al.  Multitask Learning , 1998, Encyclopedia of Machine Learning and Data Mining.

[15]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[16]  Jonathan Baxter,et al.  A Model of Inductive Bias Learning , 2000, J. Artif. Intell. Res..

[17]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[18]  Buse Melis Ozyildirim,et al.  Generalized classifier neural network , 2013, Neural Networks.

[19]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[20]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Adnan Khashman,et al.  Deep learning in vision-based static hand gesture recognition , 2017, Neural Computing and Applications.

[22]  Nojun Kwak,et al.  Radar-Spectrogram-Based UAV Classification Using Convolutional Neural Networks , 2020, Sensors.

[23]  Lan Du,et al.  Micro-Doppler Feature Extraction Based on Time-Frequency Spectrogram for Ground Moving Targets Classification With Low-Resolution Radar , 2016, IEEE Sensors Journal.

[24]  Naoufel Werghi,et al.  Ground Moving Radar Targets Classification Based on Spectrogram Images Using Convolutional Neural Networks , 2018, 2018 19th International Radar Symposium (IRS).

[25]  B. Jacobs,et al.  Validation of a computational electromagnetic model of a boeing 707 aircraft by comparison to scale model measurements , 2012, 2012 IEEE-APS Topical Conference on Antennas and Propagation in Wireless Communications (APWC).

[26]  Sebastian Ruder,et al.  An Overview of Multi-Task Learning in Deep Neural Networks , 2017, ArXiv.

[27]  Tarmo Lipping,et al.  Crop yield prediction with deep convolutional neural networks , 2019, Comput. Electron. Agric..

[28]  E. Yiğit,et al.  Machine learning based quantity measurement method for grain silos , 2020 .

[29]  G. P. Cabic,et al.  Radar micro-Doppler feature extraction using the spectrogram and the cepstrogram , 2014, 2014 11th European Radar Conference.

[30]  Jonathan Baxter,et al.  A Bayesian/Information Theoretic Model of Learning to Learn via Multiple Task Sampling , 1997, Machine Learning.

[31]  Rafael Rieder,et al.  Computer vision and artificial intelligence in precision agriculture for grain crops: A systematic review , 2018, Comput. Electron. Agric..

[32]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[33]  Brian Kingsbury,et al.  New types of deep neural network learning for speech recognition and related applications: an overview , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.