Multi-Channel Fusion Classification Method Based on Time-Series Data

Time-series data generally exists in many application fields, and the classification of time-series data is one of the important research directions in time-series data mining. In this paper, univariate time-series data are taken as the research object, deep learning and broad learning systems (BLSs) are the basic methods used to explore the classification of multi-modal time-series data features. Long short-term memory (LSTM), gated recurrent unit, and bidirectional LSTM networks are used to learn and test the original time-series data, and a Gramian angular field and recurrence plot are used to encode time-series data to images, and a BLS is employed for image learning and testing. Finally, to obtain the final classification results, Dempster–Shafer evidence theory (D–S evidence theory) is considered to fuse the probability outputs of the two categories. Through the testing of public datasets, the method proposed in this paper obtains competitive results, compensating for the deficiencies of using only time-series data or images for different types of datasets.

[1]  Kemal Polat,et al.  A Novel Medical Diagnosis model for COVID-19 infection detection based on Deep Features and Bayesian Optimization , 2020, Applied Soft Computing.

[2]  D. Ruelle,et al.  Recurrence Plots of Dynamical Systems , 1987 .

[3]  Tingli Su,et al.  Distributed Deep Fusion Predictor for a Multi-Sensor System Based on Causality Entropy , 2021, Entropy.

[4]  C. L. Philip Chen,et al.  A rapid learning and dynamic stepwise updating algorithm for flat neural networks and the application to time-series prediction , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[5]  Xingda Qu,et al.  Automatic Activity Classification Based on Human Body Kinematics and Dynamic Time Wrapping , 2018, 2018 IEEE 23rd International Conference on Digital Signal Processing (DSP).

[6]  Ahlame Douzal Chouakria,et al.  Multiple metric learning for large margin kNN classification of time series , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[7]  Xiaoyi Wang,et al.  Multi-stream hybrid architecture based on cross-level fusion strategy for fine-grained crop species recognition in precision agriculture , 2021, Comput. Electron. Agric..

[8]  Jiankun Hu,et al.  Deep Gaussian Mixture-Hidden Markov Model for Classification of EEG Signals , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[9]  Abdulhamit Subasi,et al.  Ensemble SVM Method for Automatic Sleep Stage Classification , 2018, IEEE Transactions on Instrumentation and Measurement.

[10]  Luning Liu,et al.  An ELECTRE-Based Multiple Criteria Decision Making Method for Supplier Selection Using Dempster-Shafer Theory , 2019, IEEE Access.

[11]  Shubo Wang,et al.  Adaptive Predefined Performance Sliding Mode Control of Motor Driving Systems With Disturbances , 2021, IEEE Transactions on Energy Conversion.

[12]  Peng Laixian,et al.  Research on the Hidden Markov Model in Hot Topics of the Internet , 2018, 2018 IEEE 18th International Conference on Communication Technology (ICCT).

[13]  Jian-Lei Kong,et al.  The New Trend of State Estimation: From Model-Driven to Hybrid-Driven Methods , 2021, Sensors.

[14]  Tim Oates,et al.  Encoding Time Series as Images for Visual Inspection and Classification Using Tiled Convolutional Neural Networks , 2014 .

[15]  Ting-Li Su,et al.  Broad learning system for human activity recognition using sensor data , 2019, Int. J. Comput. Appl. Technol..

[16]  Saeed Karimi-Bidhendi,et al.  Scalable Classification of Univariate and Multivariate Time Series , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[17]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[18]  Shubo Wang,et al.  Asymptotic Tracking Control for Nonaffine Systems With Disturbances , 2021, IEEE Transactions on Circuits and Systems II: Express Briefs.

[19]  Kusumika Krori Dutta,et al.  Multi-class time series classification of EEG signals with Recurrent Neural Networks , 2019, 2019 9th International Conference on Cloud Computing, Data Science & Engineering (Confluence).

[20]  C. L. Philip Chen,et al.  Broad Learning System: An Effective and Efficient Incremental Learning System Without the Need for Deep Architecture , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Victor C. M. Leung,et al.  A Saliency Map Fusion Method Based on Weighted DS Evidence Theory , 2018, IEEE Access.

[22]  Nima Hatami,et al.  Classification of time-series images using deep convolutional neural networks , 2017, International Conference on Machine Vision.

[23]  Sezer Ulukaya,et al.  Classification of Parkinson’s Disease Using Dynamic Time Warping , 2019, 2019 27th Telecommunications Forum (TELFOR).

[24]  Jie Huang,et al.  An Improved kNN Based on Class Contribution and Feature Weighting , 2018, 2018 10th International Conference on Measuring Technology and Mechatronics Automation (ICMTMA).