Machine Learning in Measurement Part 1: Error Contribution and Terminology Confusion

Like any science and engineering field, Instrumentation and Measurement (I&M) is currently experiencing the impact of the recent rise of Applied AI and in particular Machine Learning (ML) [1]. But I&M and ML use terminology that sometimes sound or look similar, though they might only have a marginal relationship or even be false friends. Therefore, understanding the terminology used by both communities and how they do and do not relate to one another is of crucial importance to understand the influences of ML in an I&M system. In addition, while I&M experts are well aware of the importance of measurement uncertainty, the concept has been understudied in the ML context. In this article, we will give an overview of ML's contribution to measurement error, and how to avoid confusion with the said terminology, to better understand the application of ML in measurement. Then, in Part 2 [2], we use that understanding and terminology to show how to quantify the uncertainty introduced by ML in a measurement system. This is of particular importance for measurement in the age of big data because we need to evaluate the trustworthiness of the available data and their impact on the derived conclusions and decision-making [3].

[1]  Dario Petri,et al.  Big data, dataism and measurement , 2020, IEEE Instrumentation & Measurement Magazine.

[2]  Hussein Al Osman,et al.  Machine Learning in Measurement Part 2: Uncertainty Quantification , 2021, IEEE Instrumentation & Measurement Magazine.

[3]  Shervin Shirmohammadi,et al.  Measuring Calorie and Nutrition From Food Image , 2014, IEEE Transactions on Instrumentation and Measurement.

[4]  Emil Jovanov,et al.  Virtual Instrumentation , 2002 .

[5]  Petra Perner,et al.  Data Mining - Concepts and Techniques , 2002, Künstliche Intell..

[6]  Yingnan Sun,et al.  Image-Based Food Classification and Volume Estimation for Dietary Assessment: A Review , 2020, IEEE Journal of Biomedical and Health Informatics.

[7]  Alex Kendall,et al.  What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision? , 2017, NIPS.

[8]  Abdulsalam Yassine,et al.  You are what you eat: So measure what you eat! , 2016, IEEE Instrumentation & Measurement Magazine.

[9]  Mounib Khanafer,et al.  Applied AI in instrumentation and measurement: The deep learning revolution , 2020, IEEE Instrumentation & Measurement Magazine.

[10]  Luís Torgo,et al.  Precision and Recall for Regression , 2009, Discovery Science.

[11]  E. Iso,et al.  Measurement Uncertainty and Probability: Guide to the Expression of Uncertainty in Measurement , 1995 .

[12]  Dario Petri,et al.  On the Commonly-Used Incorrect Visual Representation of Accuracy and Precision , 2021, IEEE Instrumentation & Measurement Magazine.

[13]  Andrés F. Ramírez-Barrera,et al.  Soft metrology based on machine learning: a review , 2019, Measurement Science and Technology.

[14]  David J. Schwab,et al.  A high-bias, low-variance introduction to Machine Learning for physicists , 2018, Physics reports.

[15]  Kevin Smith,et al.  Bayesian Uncertainty Estimation for Batch Normalized Deep Networks , 2018, ICML.

[16]  Shervin Shirmohammadi,et al.  A Multimodal Deep Learning-Based Distributed Network Latency Measurement System , 2020, IEEE Transactions on Instrumentation and Measurement.

[17]  Alessandro Ferrero,et al.  Camera as the instrument: the rising trend of vision based measurement , 2014, IEEE Instrumentation & Measurement Magazine.

[18]  Dario Petri,et al.  Fundamentals of Hard and Soft Measurement , 2015 .

[19]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.