Implementation of multi-task learning neural network architectures for robust industrial optical sensing

The simultaneous determination of multiple physical or chemical parameters can be very advantageous in many sensor applications. In some cases, it is unavoidable because the parameters of interest display cross sensitivities or depend on multiple quantities varying simultaneously. One notable example is the determination of oxygen partial pressure via luminescence quenching. The measuring principle is based on the measurement of the luminescence of a specific molecule, whose intensity and decay time are reduced due to collisions with oxygen molecules. Since both the luminescence and the quenching phenomena are strongly temperature-dependent, this type of sensor needs continuous monitoring of the temperature. This is typically achieved by adding temperature sensors and employing a multi-parametric model (Stern–Volmer equation), whose parameters are all temperature- dependent. As a result, the incorrect measurement of the temperature of the indicator is a major source of error. In this work a new approach based on multi-task learning (MTL) artificial neural networks (ANN) was successfully implemented to achieve robust sensing for industrial applications. These were integrated in a sensor that not only does not need the separate detection of temperature but even exploits the intrinsic cross-interferences of the sensing principle to predict simultaneously oxygen partial pressure and temperature. A detailed analysis of the robustness of the method was performed to demonstrate its potential for industrial applications. This type of sensor could in the future significantly simplify the design of the sensor and at the same time increase its performance.

[1]  Umberto Michelucci,et al.  Applied Deep Learning: A Case-Based Approach to Understanding Deep Neural Networks , 2018 .

[2]  Umberto Michelucci,et al.  Multi-Task Learning for Multi-Dimensional Regression: Application to Luminescence Sensing , 2019, Applied Sciences.

[3]  Umberto Michelucci,et al.  Dual Oxygen and Temperature Luminescence Learning Sensor with Parallel Inference , 2020, Sensors.

[4]  O. Wolfbeis,et al.  Optical methods for sensing and imaging oxygen: materials, spectroscopies and applications. , 2014, Chemical Society reviews.

[5]  Jianhua Z. Huang An Introduction to Statistical Learning: With Applications in R By Gareth James, Trevor Hastie, Robert Tibshirani, Daniela Witten , 2014, Journal of Agricultural, Biological, and Environmental Statistics.

[6]  Umberto Michelucci,et al.  Optical Oxygen Sensing with Artificial Intelligence , 2019, Sensors.

[7]  Ingo Klimant,et al.  Indicators for optical oxygen sensors , 2012, Bioanalytical reviews.

[8]  Umberto Michelucci,et al.  Estimating Neural Network's Performance with Bootstrap: A Tutorial , 2021, Mach. Learn. Knowl. Extr..

[9]  Yaoguang Wei,et al.  Review of Dissolved Oxygen Detection Technology: From Laboratory Analysis to Online Intelligent Detection , 2019, Sensors.

[10]  P. Hartmann,et al.  Response characteristics of luminescent oxygen sensors , 1995 .

[11]  Rich Caruana,et al.  Multitask Learning , 1998, Encyclopedia of Machine Learning and Data Mining.

[12]  Jonathan Baxter,et al.  A Model of Inductive Bias Learning , 2000, J. Artif. Intell. Res..

[13]  Wenying Xu,et al.  Modeling of Luminescence Quenching-Based Sensors: Comparison of Multisite and Nonlinear Gas Solubility Models , 1995 .

[14]  Benjamin A. DeGraff,et al.  Luminescence quenching mechanism for microheterogeneous systems , 1991 .

[15]  P. Pastore,et al.  Determination of thermodynamic parameters from light intensity signals obtained from oxygen optical sensors , 2012 .

[16]  Ammasi Periasamy,et al.  Fluorescence Microscopy Study of Heterogeneity in Polymer-supported Luminescence-based Oxygen Sensors , 2000, Microscopy and Microanalysis.

[17]  Gang Li,et al.  Frequency-domain fluorescence lifetime optrode system design and instrumentation without a concurrent reference light-emitting diode. , 2009, Applied optics.