Machine-Learning-Based Microwave Sensing: A Case Study for the Food Industry

Despite the meticulous attention of food industries to prevent hazards in packaged goods, some contaminants may still elude the controls. Indeed, standard methods, like X-rays, metal detectors and near-infrared imaging, cannot detect low-density materials. Microwave sensing is an alternative method that, combined with machine learning classifiers, can tackle these deficiencies. In this paper we present a design methodology applied to a case study in the food sector. Specifically, we offer a complete flow from microwave dataset acquisition to deployment of the classifiers on real-time hardware and we show the effectiveness of this method in terms of detection accuracy. In the case study, we apply the machine-learning based microwave sensing approach to the case of food jars flowing at high speed on a conveyor belt. First, we collected a dataset from hazelnut-cocoa spread jars which were uncontaminated or contaminated with various intrusions, including low-density plastics. Then, we performed a design space exploration to choose the best MLPs as binary classifiers, which resulted to be exceptionally accurate. Finally, we selected the two most light-weight models for implementation on both an ARM-based CPU and an FPGA SoC, to cover a wide range of possible latency requirements, from loose to strict, to detect contaminants in real-time. The proposed design flow facilitates the design of the FPGA accelerator that might be required to meet the timing requirements by using a high-level approach, which might be suited for the microwave domain experts without specific digital hardware skills.

[1]  Luca P. Carloni,et al.  Invited: The case for Embedded Scalable Platforms , 2016, 2016 53nd ACM/EDAC/IEEE Design Automation Conference (DAC).

[2]  Changyeun Mo,et al.  Combination of mass spectrometry-based targeted lipidomics and supervised machine learning algorithms in detecting adulterated admixtures of white rice. , 2017, Food research international.

[3]  Claire Migliaccio,et al.  Damaged Apple Sorting With mmWave Imaging and Nonlinear Support Vector Machine , 2020, IEEE Transactions on Antennas and Propagation.

[4]  Xin He,et al.  On line detection of defective apples using computer vision system combined with deep learning methods , 2020 .

[5]  Ioannis S. Arvanitoyannis,et al.  Detecting Foreign Bodies in Food , 2004 .

[6]  Jarno Vanne,et al.  Are We There Yet? A Study on the State of High-Level Synthesis , 2019, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[7]  Natsuko Toyofuku,et al.  X-ray detection of defects and contaminants in the food industry , 2008 .

[8]  Da-Wen Sun,et al.  Emerging non-destructive terahertz spectroscopic imaging technique: Principle and applications in the agri-food industry , 2017 .

[9]  Fei Liu,et al.  Application of Deep Learning in Food: A Review. , 2019, Comprehensive reviews in food science and food safety.

[10]  Noel D.G. White,et al.  Extraction of Spectral Information from Hyperspectral Data and Application of Hyperspectral Imaging for Food and Agricultural Products , 2016, Food and Bioprocess Technology.

[11]  Luca P. Carloni,et al.  COSMOS , 2017, ACM Trans. Embed. Comput. Syst..

[12]  Vicente Rodríguez Fuentes,et al.  The Rapid Alert System for Food and Feed – a Critical Approach , 2017 .

[13]  Mario R. Casu,et al.  A Machine-Learning Based Microwave Sensing Approach to Food Contaminant Detection , 2020, 2020 IEEE International Symposium on Circuits and Systems (ISCAS).

[14]  Mario R. Casu,et al.  Design and Experimental Assessment of a 2D Microwave Imaging System for Brain Stroke Monitoring , 2019, International Journal of Antennas and Propagation.

[15]  Weida Tong,et al.  Comparing SVM and ANN based Machine Learning Methods for Species Identification of Food Contaminating Beetles , 2018, Scientific Reports.

[16]  J. A. Tobon Vasquez,et al.  Noninvasive Inline Food Inspection via Microwave Imaging Technology: An Application Example in the Food Industry , 2020, IEEE Antennas and Propagation Magazine.

[17]  Dongpo Xu,et al.  Raman spectroscopy combined with machine learning for rapid detection of food-borne pathogens at the single-cell level. , 2021, Talanta.

[18]  Joe LoVetri,et al.  Innovations in Electromagnetic Imaging Technology: The Stored-Grain-Monitoring Case , 2020, IEEE Antennas and Propagation Magazine.

[19]  Won-Hui Lee,et al.  Food inspection system using terahertz imaging , 2014 .

[20]  Song Han,et al.  Fast inference of deep neural networks in FPGAs for particle physics , 2018, Journal of Instrumentation.

[21]  Haigang Wang,et al.  Microwave Tomography for Industrial Process Imaging: Example Applications and Experimental Results. , 2017, IEEE Antennas and Propagation Magazine.

[22]  Zhenbo Wei,et al.  Development of Multifrequency-Swept Microwave Sensing System for Moisture Measurement of Sweet Corn With Deep Neural Network , 2020, IEEE Transactions on Instrumentation and Measurement.

[23]  Bo Chen,et al.  Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[24]  V. Reddi,et al.  TensorFlow Lite Micro: Embedded Machine Learning on TinyML Systems , 2020, MLSys.

[25]  Luca P. Carloni,et al.  hls4ml: An Open-Source Codesign Workflow to Empower Scientific Low-Power Machine Learning Devices , 2021, ArXiv.

[26]  R. Knochel,et al.  UWB-sensors in food quality management — the way from the concept to market , 2008, 2008 IEEE International Conference on Ultra-Wideband.

[27]  M. Koch,et al.  Detection of foreign bodies in chocolate with pulsed terahertz spectroscopy , 2008 .

[28]  Lorenzo Crocco,et al.  Design and Numerical Characterization of a Low-Complexity Microwave Device for Brain Stroke Monitoring , 2018, IEEE Transactions on Antennas and Propagation.