Comparison of delayless digital filtering algorithms and their application to multi-sensor signal processing

In the phase of industry digitalization, data are collected from many sensors and signal processing techniques play a crucial role. Data preprocessing is a fundamental step in the analysis of measurements, and a first step before applying machine learning. To reduce the influence of distortions from signals, selective digital filtering is applied to minimize or remove unwanted components. Standard software and hardware digital filtering algorithms introduce a delay, which has to be compensated for to avoid destroying signal associations. The delay from filtering becomes more crucial when the analysis involves measurements from multiple sensors, therefore in this paper we provide an overview and comparison of existing digital filtering methods with an application based on real-life marine examples. In addition, the design of special-purpose filters is a complex process and for preprocessing data from many sources, the application of digital filtering in the time domain can have a high numerical cost. For this reason we describe discrete Fourier transformation digital filtering as a tool for efficient sensor data preprocessing, which does not introduce a time delay and has low numerical cost. The discrete Fourier transformation digital filtering has a simpler implementation and does not require expert-level filter design knowledge, which is beneficial for practitioners from various disciplines. Finally, we exemplify and show the application of the methods on real signals from marine systems.

[1]  Hitoshi Kiya,et al.  A development of symmetric extension method for subband image coding , 1994, IEEE Trans. Image Process..

[2]  Cheh Pan Gibbs phenomenon removal and digital filtering directly through the fast Fourier transform , 2001, IEEE Trans. Signal Process..

[3]  Rachida Dssouli,et al.  Big Data Pre-processing: A Quality Framework , 2015, 2015 IEEE International Congress on Big Data.

[4]  Qihui Wu,et al.  Erratum to: A survey of machine learning for big data processing , 2016, EURASIP J. Adv. Signal Process..

[5]  Fredrik Gustafsson,et al.  Determining the initial states in forward-backward filtering , 1996, IEEE Trans. Signal Process..

[6]  Francisco Herrera,et al.  Big data preprocessing: methods and prospects , 2016 .

[7]  K. R. Rao,et al.  The Transform and Data Compression Handbook , 2000 .

[8]  Mark J. T. Smith,et al.  Subband coding of images with octave band tree structures , 1987, ICASSP '87. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[9]  Ivan W. Selesnick,et al.  The discrete Fourier transforms , 2000 .

[10]  Mark J. T. Smith,et al.  Analysis/synthesis techniques for subband image coding , 1990, IEEE Trans. Acoust. Speech Signal Process..

[11]  Gonzalo Mateos,et al.  Modeling and Optimization for Big Data Analytics: (Statistical) learning tools for our era of data deluge , 2014, IEEE Signal Processing Magazine.

[12]  M. Verleysen,et al.  Classification in the Presence of Label Noise: A Survey , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Qihui Wu,et al.  A survey of machine learning for big data processing , 2016, EURASIP Journal on Advances in Signal Processing.