Measurement Noise Recommendation for Efficient Kalman Filtering over a Large Amount of Sensor Data

To effectively maintain and analyze a large amount of real-time sensor data, one often uses a filtering technique that reflects characteristics of original data well. This paper proposes a novel method for recommending the measurement noise for Kalman filtering, which is one of the most representative filtering techniques. Kalman filtering corrects inaccurate values of input sensor data, and its filtering performance varies depending on the input noise parameters. In particular, if the noise parameters determined based on the user’s experience are incorrect, the accuracy of Kalman filtering may be reduced significantly. Based on this observation, this paper addresses how to determine the measurement noise variance, a major input parameter of Kalman filtering, by analyzing past sensor data and how to use the estimated noise to improve the filtering accuracy. More specifically, to estimate the measurement noise variance, two analytical methods are proposed: one a transform-based method using a wavelet transform and the other a learning-based method using a denoising autoencoder. Experimental results show that the proposed methods estimated the measurement noise variance accurately and were superior to the experience-based method in the filtering accuracy.

[1]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[2]  Yalcin Bulut,et al.  Process and Measurement Noise Estimation for Kalman Filtering , 2011 .

[3]  Wei Gao,et al.  A New Variational Bayesian Adaptive Extended Kalman Filter for Cooperative Navigation , 2018, Sensors.

[4]  Chris Develder,et al.  Two-Stage Load Pattern Clustering Using Fast Wavelet Transformation , 2016, IEEE Transactions on Smart Grid.

[5]  Tiago M. Fernández-Caramés,et al.  Towards The Internet-of-Smart-Clothing: A Review on IoT Wearables and Garments for Creating Intelligent Connected E-Textiles , 2018, Electronics.

[6]  Yong Bai,et al.  Real-Time Processing of Continuous Physiological Signals in a Neurocritical Care Unit on a Stream Data Analytics Platform. , 2016, Acta neurochirurgica. Supplement.

[7]  J. L. Roux An Introduction to the Kalman Filter , 2003 .

[8]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[9]  Andrea Zanella,et al.  Long-range communications in unlicensed bands: the rising stars in the IoT and smart city scenarios , 2015, IEEE Wireless Communications.

[10]  Jean-Yves Fourniols,et al.  A Study about Kalman Filters Applied to Embedded Sensors , 2017, Sensors.

[11]  Pierre Baldi,et al.  Autoencoders, Unsupervised Learning, and Deep Architectures , 2011, ICML Unsupervised and Transfer Learning.

[12]  Madhuchhanda Mitra,et al.  Application of Cross Wavelet Transform for ECG Pattern Analysis and Classification , 2014, IEEE Transactions on Instrumentation and Measurement.

[13]  R. Mehra On the identification of variances and adaptive Kalman filtering , 1970 .

[14]  Robert S. Balog,et al.  Arc Fault and Flash Signal Analysis in DC Distribution Systems Using Wavelet Transformation , 2015, IEEE Transactions on Smart Grid.

[15]  Javier Cuenca,et al.  Improving an autotuning engine for 3D Fast Wavelet Transform on manycore systems , 2014, The Journal of Supercomputing.

[16]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing, 2nd Edition , 1999 .

[17]  Yonggang Zhang,et al.  A Novel Adaptive Kalman Filter With Inaccurate Process and Measurement Noise Covariance Matrices , 2018, IEEE Transactions on Automatic Control.

[18]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[19]  Myeong-Seon Gil,et al.  Storm-based distributed sampling system for multi-source stream environment , 2018, Int. J. Distributed Sens. Networks.

[20]  Angelo M. Sabatini,et al.  A Novel Kalman Filter for Human Motion Tracking With an Inertial-Based Dynamic Inclinometer , 2015, IEEE Transactions on Biomedical Engineering.

[21]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[22]  Simo Särkkä,et al.  Recursive Noise Adaptive Kalman Filtering by Variational Bayesian Approximations , 2009, IEEE Transactions on Automatic Control.

[23]  Dong Wang,et al.  Music removal by convolutional denoising autoencoder in speech recognition , 2015, 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[24]  S. Godbole,et al.  Kalman filtering with no A-priori information about noise-White noise case: Part I: Identification of covariances , 1973, CDC 1973.

[25]  Yang-Sae Moon,et al.  General match: a subsequence matching method in time-series databases based on generalized windows , 2002, SIGMOD '02.

[26]  Liqing Zhang,et al.  Feature learning from incomplete EEG with denoising autoencoder , 2014, Neurocomputing.

[27]  Jizhong Xiao,et al.  A Linear Kalman Filter for MARG Orientation Estimation Using the Algebraic Quaternion Algorithm , 2016, IEEE Transactions on Instrumentation and Measurement.

[28]  I. Daubechies Orthonormal bases of compactly supported wavelets , 1988 .

[29]  Reza Olfati-Saber,et al.  Distributed Kalman filtering for sensor networks , 2007, 2007 46th IEEE Conference on Decision and Control.

[30]  Raman K. Mehra,et al.  Approaches to adaptive filtering , 1970 .

[31]  Emmanuel Vincent,et al.  Variational Bayesian Inference for Source Separation and Robust Feature Extraction , 2016, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[32]  H. Akaike,et al.  Comment on "An innovations approach to least-squares estimation, part I: Linear filtering in additive white noise" , 1970 .

[33]  Kyung-Hyune Rhee,et al.  Smart Contract-Based Review System for an IoT Data Marketplace , 2018, Sensors.

[34]  T. Kailath,et al.  An innovations approach to least-squares estimation--Part II: Linear smoothing in additive white noise , 1968 .

[35]  Tony T. Lee A direct approach to identify the noise covariances of Kalman filtering , 1980 .

[36]  Greg Welch,et al.  A Two-Stage Kalman Filter Approach for Robust and Real-Time Power System State Estimation , 2014, IEEE Transactions on Sustainable Energy.

[37]  Eamonn J. Keogh,et al.  A symbolic representation of time series, with implications for streaming algorithms , 2003, DMKD '03.

[38]  Yang-Sae Moon,et al.  Efficient time-series subsequence matching using duality in constructing windows , 2001, Inf. Syst..