AI-enabled Efficient and Safe Food Supply Chain

This paper provides a review of an emerging field in the food processing sector, referring to efficient and safe food supply chains, ’from farm to fork’, as enabled by Artificial Intelligence (AI). The field is of great significance from economic, food safety and public health points of views. The paper focuses on effective food production, food maintenance energy management and food retail packaging labeling control, using recent advances in machine learning. Appropriate deep neural architectures are adopted and used for this purpose, including Fully Convolutional Networks, Long Short-Term Memories and Recurrent Neural Networks, Auto-Encoders and Attention mechanisms, Latent Variable extraction and clustering, as well as Domain Adaptation. Three experimental studies are presented, illustrating the ability of these AI methodologies to produce state-of-the-art performance in the whole food supply chain. In particular, these concern: (i) predicting plant growth and tomato yield in greenhouses, thus matching food production to market needs and reducing food waste or food unavailability; (ii) optimizing energy consumption across large networks of food retail refrigeration systems, through optimal selection of systems that can be shut-down and through prediction of the respective food de-freezing times, during peaks of power demand load; (iii) optical recognition and verification of food consumption expiry date in automatic inspection of retail packaged food, thus ensuring safety of food and people’s health.

[1]  Stefanos Zafeiriou,et al.  Training Deep Neural Networks with Different Datasets In-the-wild: The Emotion Recognition Paradigm , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[2]  Mei Wang,et al.  Deep Visual Domain Adaptation: A Survey , 2018, Neurocomputing.

[3]  Seong Joon Oh,et al.  What Is Wrong With Scene Text Recognition Model Comparisons? Dataset and Model Analysis , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[4]  Philipp Grünewald,et al.  Demand response from the non-domestic sector: Early UK experiences and future opportunities , 2013 .

[5]  Mark Swainson,et al.  Deep Bayesian Self-Training , 2018, Neural Computing and Applications.

[6]  Matthew Leach,et al.  Financial incentive approaches for reducing peak electricity demand, experience from pilot trials with a UK energy provider , 2016 .

[7]  E. Heuvelink,et al.  A knowledge-and-data-driven modeling approach for simulating plant growth: A case study on tomato growth , 2015 .

[8]  Mohammad Bagher Fakhrzad,et al.  A new multi-objective mathematical model for a Citrus supply chain network design: Metaheuristic algorithms , 2021 .

[9]  Michael Mangan,et al.  L*a*b*Fruits: A Rapid and Robust Outdoor Fruit Detection System Combining Bio-Inspired Features with One-Stage Deep Learning Networks , 2020, Sensors.

[10]  Pan He,et al.  Detecting Text in Natural Image with Connectionist Text Proposal Network , 2016, ECCV.

[11]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[12]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[13]  Ep Heuvelink,et al.  Tomato growth and yield : quantitative analysis and synthesis , 1996 .

[14]  G. Stamou,et al.  Interweaving Knowledge Representation and Adaptive Neural Networks , 2009 .

[15]  Navid Sahebjamnia,et al.  Optimization of Multi-period Three-echelon Citrus Supply Chain Problem , 2020 .

[16]  Federico Milano,et al.  Demand response algorithms for smart-grid ready residential buildings using machine learning models , 2019, Applied Energy.

[17]  Stefanos Kollias,et al.  Using Deep Learning to Predict Plant Growth and Yield in Greenhouse Environments , 2019, Acta Horticulturae.

[18]  Kai-Nan An,et al.  Stem diameter and micromotion of press fit radial head prosthesis: a biomechanical study. , 2009, Journal of shoulder and elbow surgery.

[19]  Paul Lukowicz,et al.  Robust Shipping Label Recognition and Validation for Logistics by Using Deep Neural Networks , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[20]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[21]  Amir F. Atiya,et al.  A review and comparison of strategies for multi-step ahead time series forecasting based on the NN5 forecasting competition , 2011, Expert Syst. Appl..

[22]  Ching Y. Suen,et al.  Historical review of OCR research and development , 1992, Proc. IEEE.

[23]  J. W. Jones,et al.  REDUCED STATE–VARIABLE TOMATO GROWTH MODEL , 1999 .

[24]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Nipun Katyal,et al.  Automated Detection and Rectification of Defects in Fluid-Based Packaging using Machine Vision , 2019, 2019 IEEE International Symposium on Circuits and Systems (ISCAS).

[26]  Andreas Stafylopatis,et al.  Adaptation and contextualization of deep neural network models , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[27]  Yongming Han,et al.  Semantic relation extraction using sequential and tree-structured LSTM with attention , 2020, Inf. Sci..

[28]  Xiang Bai,et al.  An End-to-End Trainable Neural Network for Image-Based Sequence Recognition and Its Application to Scene Text Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Patrizia Busato,et al.  Machine Learning in Agriculture: A Review , 2018, Sensors.

[30]  Chris Bingham,et al.  Aggregated power profile of a large network of refrigeration compressors following FFR DSR events , 2018 .

[31]  Mark Swainson,et al.  Multi-source domain adaptation for quality control in retail food packaging , 2020, Comput. Ind..

[32]  S. Cohen,et al.  The implementation of software engineering concepts in the greenhouse and crop model HORTISIM. , 1998 .

[33]  Ali Bozorgi-Amiri,et al.  A multi-objective sustainable hub location-scheduling problem for perishable food supply chain , 2017, Comput. Ind. Eng..

[34]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[35]  Lavanya Ramakrishnan,et al.  Performance evaluation of a MongoDB and hadoop platform for scientific data analysis , 2013, Science Cloud '13.

[36]  Laurence T. Yang,et al.  An Efficient Deep Learning Model to Predict Cloud Workload for Industry Informatics , 2018, IEEE Transactions on Industrial Informatics.

[37]  Stefanos D. Kollias,et al.  An End-to-End Deep Neural Architecture for Optical Character Verification and Recognition in Retail Food Packaging , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[38]  Evor L. Hines,et al.  Yield Prediction for Tomato Greenhouse Using EFuNN , 2013 .

[39]  Andreas Kamilaris,et al.  Deep learning in agriculture: A survey , 2018, Comput. Electron. Agric..

[40]  Lars Grimstad,et al.  An autonomous strawberry‐harvesting robot: Design, development, integration, and field evaluation , 2019, J. Field Robotics.

[41]  Shouyong Jiang,et al.  An autoencoder wavelet based deep neural network with attention mechanism for multistep prediction of plant growth , 2020, Inf. Sci..

[42]  Daniel Houle,et al.  Modelling day-to-day stem diameter variation and annual growth of balsam fir (Abies balsamea (L.) Mill.) from daily climate , 2011 .

[43]  Mengjie Zhang,et al.  Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptation , 2016, ECCV.

[44]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[45]  Luc Bidaut,et al.  A Unified Deep Learning Approach for Prediction of Parkinson's Disease , 2019, IET Image Process..

[46]  Stefanos Kollias,et al.  Face detection in color images and video sequences , 2000, 2000 10th Mediterranean Electrotechnical Conference. Information Technology and Electrotechnology for the Mediterranean Countries. Proceedings. MeleCon 2000 (Cat. No.00CH37099).

[47]  Shuchang Zhou,et al.  EAST: An Efficient and Accurate Scene Text Detector , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Ashish Dwivedi,et al.  Meta-heuristic algorithms for solving the sustainable agro-food grain supply chain network design problem , 2020 .

[49]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[50]  Chris Bingham,et al.  Impact of Demand Side Response on a Commercial Retail Refrigeration System , 2018 .

[51]  Junki Ito,et al.  N-deficiency damps out circadian rhythmic changes of stem diameter dynamics in tomato plant , 2008 .

[52]  Xiang Bai,et al.  Detecting Oriented Text in Natural Images by Linking Segments , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[53]  George A Xydis,et al.  An R-based forecasting approach for efficient demand response strategies in autonomous micro-grids , 2018, Energy & Environment.

[54]  Nitish Srivastava,et al.  Unsupervised Learning of Video Representations using LSTMs , 2015, ICML.

[55]  Victor S. Lempitsky,et al.  Unsupervised Domain Adaptation by Backpropagation , 2014, ICML.

[56]  Sašo Džeroski,et al.  Application of automated model discovery from data and expert knowledge to a real-world domain: Lake Glumsø , 2008 .

[57]  Stefanos D. Kollias,et al.  A Deep Learning Approach for Load Demand Forecasting of Power Systems , 2018, 2018 IEEE Symposium Series on Computational Intelligence (SSCI).

[58]  Shengxiang Yang,et al.  A Scalable Test Suite for Continuous Dynamic Multiobjective Optimization , 2019, IEEE Transactions on Cybernetics.

[59]  Giorgos B. Stamou,et al.  Using the TBox to Optimise SPARQL Queries , 2013, Description Logics.

[60]  Kathy Steppe,et al.  Long-term versus daily stem diameter variation in co-occurring mangrove species: Environmental versus ecophysiological drivers , 2014 .

[61]  S. Kollias,et al.  Transparent Adaptation in Deep Medical Image Diagnosis , 2020, TAILOR.

[62]  M. Swainson,et al.  Testing the data platforms required for the 21st century food system using an industry ecosystem approach. , 2020, The Science of the total environment.

[63]  Mark Swainson,et al.  A novel unified deep neural networks methodology for use by date recognition in retail food package image , 2020, Signal, Image and Video Processing.

[64]  Saso Dzeroski,et al.  Integrating Knowledge-Driven and Data-Driven Approaches to Modeling , 2006, EnviroInfo.

[65]  S. Kollias,et al.  Deep Transparent Prediction through Latent Representation Analysis , 2020, ArXiv.

[66]  Fuzhen Zhuang,et al.  Supervised Representation Learning: Transfer Learning with Deep Autoencoders , 2015, IJCAI.

[67]  R. Maull,et al.  Are Distributed Ledger Technologies the panacea for food traceability? , 2019, Global Food Security.

[68]  Kate Saenko,et al.  Deep CORAL: Correlation Alignment for Deep Domain Adaptation , 2016, ECCV Workshops.

[69]  Yeongjae Cheon,et al.  PVANET: Deep but Lightweight Neural Networks for Real-time Object Detection , 2016, ArXiv.

[70]  Tomassini Marco,et al.  A Survey of Artificial Neural Network-Based Modeling in Agroecology , 2008, Soft Computing Applications in Industry.

[71]  Colin J. Axon,et al.  Power-use profile analysis of non-domestic consumers for electricity tariff switching , 2016 .

[72]  S. Pearson,et al.  Framing food security and food loss statistics for incisive supply chain improvement and knowledge transfer between Kenyan, Indian and United Kingdom food manufacturers , 2020, Emerald Open Research.

[73]  Michael I. Jordan,et al.  Learning Transferable Features with Deep Adaptation Networks , 2015, ICML.

[74]  Andreas Stafylopatis,et al.  Deep neural architectures for prediction in healthcare , 2017, Complex & Intelligent Systems.

[75]  Shengxiang Yang,et al.  A Strength Pareto Evolutionary Algorithm Based on Reference Direction for Multiobjective and Many-Objective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[76]  知秀 柴田 5分で分かる!? 有名論文ナナメ読み:Jacob Devlin et al. : BERT : Pre-training of Deep Bidirectional Transformers for Language Understanding , 2020 .

[77]  C. Gary,et al.  Tompousse, a model of yield prediction for tomato crops: calibration study for unheated plastic greenhouses. , 2000 .

[78]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[79]  Salah Sukkarieh,et al.  Machine learning approaches for crop yield prediction and nitrogen status estimation in precision agriculture: A review , 2018, Comput. Electron. Agric..

[80]  Simon Pearson,et al.  Nemesyst: A Hybrid Parallelism Deep Learning-Based Framework Applied for Internet of Things Enabled Food Retailing Refrigeration Systems , 2019, Comput. Ind..

[81]  Ian Horrocks,et al.  Answering Queries over OWL Ontologies with SPARQL , 2011, OWLED.

[82]  Jian Shen,et al.  Wasserstein Distance Guided Representation Learning for Domain Adaptation , 2017, AAAI.

[83]  Stefanos D. Kollias,et al.  A unified neutral network approach to digital image halftoning , 1991, IEEE Trans. Signal Process..

[84]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[85]  S. R. Adams PREDICTING THE WEEKLY FLUCTUATIONS IN GLASSHOUSE TOMATO YIELDS , 2002 .

[86]  Dhabaleswar K. Panda,et al.  High performance distributed deep learning: a beginner's guide , 2019, PPoPP.