Quantitative and Qualitative Analysis of Time-Series Classification Using Deep Learning

Time-series classification is utilized in a variety of applications leading to the development of many data mining techniques for time-series analysis. Among the broad range of time-series classification algorithms, recent studies are considering the impact of deep learning methods on time-series classification tasks. The quantity of related publications requires a bibliometric study to explore most prominent keywords, countries, sources and research clusters. The paper conducts a bibliometric analysis on related publications in time-series classification, adopted from Scopus database between 2010 and 2019. Through keywords co-occurrence analysis, a visual network structure of top keywords in time-series classification research has been produced and deep learning has been introduced as the most common topic by additional inquiry of the bibliography. The paper continues by exploring the publication trends of recent deep learning approaches for time-series classification. The annual number of publications, the productive and collaborative countries, the growth rate of sources, the most occurred keywords and the research collaborations are revealed from the bibliometric analysis within the study period. The research field has been broken down into three main categories as different frameworks of deep neural networks, different applications in remote sensing and also in signal processing for time-series classification tasks. The qualitative analysis highlights the categories of top citation rate papers by describing them in details.

[1]  Seung Hwan Lee,et al.  Temporal data classification and forecasting using a memristor-based reservoir computing system , 2019, Nature Electronics.

[2]  Carol A Gotway Crawford,et al.  A bibliometric analysis of U.S.-based research on the Behavioral Risk Factor Surveillance System. , 2015, American journal of preventive medicine.

[3]  Chao Wang,et al.  The evolution of Industrial Management & Data Systems over the past 25 years , 2019, Ind. Manag. Data Syst..

[4]  Yuehua Wan,et al.  The 100 most-cited articles in Urological Surgery: A bibliometric analysis. , 2020, International journal of surgery.

[5]  Germain Forestier,et al.  Deep learning for time series classification: a review , 2018, Data Mining and Knowledge Discovery.

[6]  José M. Merigó,et al.  An overview of fuzzy research with bibliometric indicators , 2015, Appl. Soft Comput..

[7]  Yong Chen,et al.  Analytic network process: Academic insights and perspectives analysis , 2019, Journal of Cleaner Production.

[8]  Dino Ienco,et al.  DuPLO: A DUal view Point deep Learning architecture for time series classificatiOn , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[9]  Francesco Carlo Morabito,et al.  Deep convolutional neural networks for classification of mild cognitive impaired and Alzheimer's disease patients from scalp EEG recordings , 2016, 2016 IEEE 2nd International Forum on Research and Technologies for Society and Industry Leveraging a better tomorrow (RTSI).

[10]  Robert X. Gao,et al.  Virtualization and deep recognition for system fault classification , 2017 .

[11]  Tim Oates,et al.  Imaging Time-Series to Improve Classification and Imputation , 2015, IJCAI.

[12]  Tim Oates,et al.  Encoding Time Series as Images for Visual Inspection and Classification Using Tiled Convolutional Neural Networks , 2014 .

[13]  Mohammad Najafi,et al.  Deep phenotyping: deep learning for temporal phenotype/genotype classification , 2017, Plant Methods.

[14]  Jason Lines,et al.  Time Series Classification with HIVE-COTE , 2018, ACM Trans. Knowl. Discov. Data.

[15]  Lifeng Shen,et al.  Dynamic Barycenter Averaging Kernel in RBF Networks for Time Series Classification , 2019, IEEE Access.

[16]  Longfeng Zhao,et al.  The evolution of Omega-The International Journal of Management Science over the past 40 years: A bibliometric overview , 2020 .

[17]  Chien-Liang Liu,et al.  Multivariate Time Series Early Classification Using Multi-Domain Deep Neural Network , 2018, 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA).

[18]  Justin A. Blanco,et al.  Modeling electroencephalography waveforms with semi-supervised deep belief nets: fast classification and anomaly measurement , 2011, Journal of neural engineering.

[19]  Houshang Darabi,et al.  Multivariate LSTM-FCNs for Time Series Classification , 2018, Neural Networks.

[20]  Lovekesh Vig,et al.  ConvTimeNet: A Pre-trained Deep Convolutional Neural Network for Time Series Classification , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[21]  Zeshui Xu,et al.  Bibliometric analysis of support vector machines research trend: a case study in China , 2019, International Journal of Machine Learning and Cybernetics.

[22]  Bowon Lee,et al.  Appliance Classification by Power Signal Analysis Based on Multi-Feature Combination Multi-Layer LSTM , 2019, Energies.

[23]  Yuhei Umeda,et al.  Time Series Classification via Topological Data Analysis , 2017, Inf. Media Technol..

[24]  T. Connelly,et al.  The 100 most influential manuscripts in robotic surgery: a bibliometric analysis , 2020, Journal of robotic surgery.

[25]  Tim Oates,et al.  Time series classification from scratch with deep neural networks: A strong baseline , 2016, 2017 International Joint Conference on Neural Networks (IJCNN).

[26]  Mario Muñoz Organero,et al.  Automatic detection of traffic lights, street crossings and urban roundabouts combining outlier detection and deep learning classification techniques based on GPS traces while driving , 2018, Comput. Environ. Urban Syst..

[27]  Stanislas Chambon,et al.  A Deep Learning Architecture for Temporal Sleep Stage Classification Using Multivariate and Multimodal Time Series , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  Toby A Patterson,et al.  Objective classification of latent behavioral states in bio-logging data using multivariate-normal hidden Markov models. , 2015, Ecological applications : a publication of the Ecological Society of America.

[29]  Masood Fooladi,et al.  A Comparison between Two Main Academic Literature Collections: Web of Science and Scopus Databases , 2013, ArXiv.

[30]  Chien-Liang Liu,et al.  Multivariate Time Series Early Classification with Interpretability Using Deep Learning and Attention Mechanism , 2019, PAKDD.

[31]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[32]  Nader Ale Ebrahim,et al.  Qualitative and quantitative analysis of solar hydrogen generation literature from 2001 to 2014 , 2015, Scientometrics.

[33]  A. Harlev,et al.  Bibliometrics: tracking research impact by selecting the appropriate metrics , 2016, Asian journal of andrology.

[34]  Rajiv Ranjan,et al.  Towards Brain Big Data Classification: Epileptic EEG Identification With a Lightweight VGGNet on Global MIC , 2018, IEEE Access.

[35]  Yi Zheng,et al.  Time Series Classification Using Multi-Channels Deep Convolutional Neural Networks , 2014, WAIM.

[36]  Jason Lines,et al.  Classification of time series by shapelet transformation , 2013, Data Mining and Knowledge Discovery.

[37]  Joseph Sarkis,et al.  Green supply chain management: A review and bibliometric analysis , 2015 .

[38]  Nader Ale Ebrahim,et al.  Publication Trends in Drug Delivery and Magnetic Nanoparticles , 2019, Nanoscale Research Letters.

[39]  Tim Oates,et al.  SensorNet: A Scalable and Low-Power Deep Convolutional Neural Network for Multimodal Data Classification , 2019, IEEE Transactions on Circuits and Systems I: Regular Papers.

[40]  Vincent G. Duffy,et al.  Bibliometric Analysis of Affective Computing Researches during 1999~2018 , 2020, Int. J. Hum. Comput. Interact..

[41]  Nima Hatami,et al.  Classification of time-series images using deep convolutional neural networks , 2017, International Conference on Machine Vision.

[42]  Anton J. Nederhof,et al.  Bibliometric monitoring of research performance in the Social Sciences and the Humanities: A Review , 2006, Scientometrics.

[43]  John Cristian Borges Gamboa,et al.  Deep Learning for Time-Series Analysis , 2017, ArXiv.

[44]  Houshang Darabi,et al.  LSTM Fully Convolutional Networks for Time Series Classification , 2017, IEEE Access.

[45]  Xia Zhao,et al.  A New Method of Mixed Gas Identification Based on a Convolutional Neural Network for Time Series Classification , 2019, Sensors.

[46]  Nader Ale Ebrahim,et al.  Major trends in knowledge management research: a bibliometric study , 2016, Scientometrics.

[47]  Dino Ienco,et al.  Land Cover Classification via Multitemporal Spatial Data by Deep Recurrent Neural Networks , 2017, IEEE Geoscience and Remote Sensing Letters.

[48]  Guoqing Li,et al.  Bibliometric Analysis of Global Remote Sensing Research during 2010-2015 , 2017, ISPRS Int. J. Geo Inf..

[49]  Nader Ale Ebrahim,et al.  Five Decades of Scientific Development on 'Attachment Theory': Trends and Future Landscape , 2018 .

[50]  Pankoo Kim,et al.  A Deep Bidirectional GRU Network Model for Biometric Electrocardiogram Classification Based on Recurrent Neural Networks , 2019, IEEE Access.

[51]  Nader Ale Ebrahim,et al.  Firms' sustainable practice research in developing countries: mapping the cited literature by bibliometric analysis approach , 2019, International Journal of Sustainable Strategic Management.

[52]  José Antonio Lozano,et al.  A review on distance based time series classification , 2018, Data Mining and Knowledge Discovery.

[53]  Amol P. Bhopale,et al.  Temporal Topic Modeling of Scholarly Publications for Future Trend Forecasting , 2017, BDA.

[54]  Xiaoyan Zhou,et al.  Global Research on Artificial Intelligence from 1990-2014: Spatially-Explicit Bibliometric Analysis , 2016, ISPRS Int. J. Geo Inf..

[55]  Dana Kulic,et al.  Exercise motion classification from large-scale wearable sensor data using convolutional neural networks , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[56]  Eamonn J. Keogh,et al.  Time series shapelets: a new primitive for data mining , 2009, KDD.

[57]  Houshang Darabi,et al.  Insights Into LSTM Fully Convolutional Networks for Time Series Classification , 2019, IEEE Access.

[58]  Peter Loos,et al.  Time Series Classification using Deep Learning for Process Planning: A Case from the Process Industry , 2017 .

[59]  Geoffrey I. Webb,et al.  Temporal Convolutional Neural Network for the Classification of Satellite Image Time Series , 2018, Remote. Sens..

[60]  M. Shamim Hossain,et al.  Multilevel Weighted Feature Fusion Using Convolutional Neural Networks for EEG Motor Imagery Classification , 2019, IEEE Access.

[61]  Massimo Aria,et al.  bibliometrix: An R-tool for comprehensive science mapping analysis , 2017, J. Informetrics.

[62]  Yi Zheng,et al.  Convolutional Nonlinear Neighbourhood Components Analysis for Time Series Classification , 2015, PAKDD.

[63]  Nader Ale Ebrahim,et al.  A Crisis in “Open Access”: Should Communication Scholarly Outputs Take 77 Years to Become Open Access? , 2019, SAGE Open.

[64]  C. Anderson,et al.  Echo State Networks for Modeling and Classification of EEG Signals in Mental-Task Brain-Computer Interfaces , 2015 .

[65]  Carlos Aguirre,et al.  Deep multi-survey classification of variable stars , 2018, Monthly Notices of the Royal Astronomical Society.

[66]  Jie Zhou,et al.  Classification of motor imagery eeg using wavelet envelope analysis and LSTM networks , 2018, 2018 Chinese Control And Decision Conference (CCDC).

[67]  Germain Forestier,et al.  Transfer learning for time series classification , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[68]  Na Lu,et al.  A Deep Learning Scheme for Motor Imagery Classification based on Restricted Boltzmann Machines , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[69]  Yi Zheng,et al.  Exploiting multi-channels deep convolutional neural networks for multivariate time series classification , 2015, Frontiers of Computer Science.

[70]  Daoyuan Li.  Transforming Time Series for Efficient and Accurate Classification , 2018 .

[71]  Te-Chung Yang,et al.  Classification of acoustic physiological signals based on deep learning neural networks with augmented features , 2016, 2016 Computing in Cardiology Conference (CinC).

[72]  Arizona Phoenix,et al.  Highly cited works in neurosurgery. Part I: the 100 top-cited papers in neurosurgical journals , 2010 .

[73]  U. Rajendra Acharya,et al.  Use of features from RR-time series and EEG signals for automated classification of sleep stages in deep neural network framework , 2018 .

[74]  Shraddha Singh,et al.  Classification of ECG Arrhythmia using Recurrent Neural Networks , 2018 .

[75]  Tong Wang,et al.  Lattice Boltzmann Method for Fluid-Thermal Systems: Status, Hotspots, Trends and Outlook , 2020, IEEE Access.

[76]  Emile Ndikumana,et al.  Deep Recurrent Neural Network for Agricultural Classification using multitemporal SAR Sentinel-1 for Camargue, France , 2018, Remote. Sens..

[77]  Stefan Wermter,et al.  Towards Effective Classification of Imbalanced Data with Convolutional Neural Networks , 2016, ANNPR.

[78]  Hang Zhou,et al.  Deep learning based multi-temporal crop classification , 2019, Remote Sensing of Environment.

[79]  Pattreeya Tanisaro,et al.  Time Series Classification Using Time Warping Invariant Echo State Networks , 2016, 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA).

[80]  Ludo Waltman,et al.  Software survey: VOSviewer, a computer program for bibliometric mapping , 2009, Scientometrics.

[81]  A. J. Connolly,et al.  Models and Simulations for the Photometric LSST Astronomical Time Series Classification Challenge (PLAsTiCC) , 2019, Publications of the Astronomical Society of the Pacific.

[82]  Jianye Hao,et al.  Application of artificial intelligence to wastewater treatment: A bibliometric analysis and systematic review of technology, economy, management, and wastewater reuse , 2020 .

[83]  Jianjing Li,et al.  Day-ahead power forecasting in a large-scale photovoltaic plant based on weather classification using LSTM , 2019, Energy.

[84]  Marcin Korytkowski,et al.  Convolutional Neural Networks for Time Series Classification , 2017, ICAISC.

[85]  Fiorenzo Franceschini,et al.  Regularity in the research output of individual scientists: An empirical analysis by recent bibliometric tools , 2011, J. Informetrics.

[86]  Liping Di,et al.  Using long short-term memory recurrent neural network in land cover classification on Landsat and Cropland data layer time series , 2018, International Journal of Remote Sensing.

[87]  Tak-Chung Fu,et al.  A review on time series data mining , 2011, Eng. Appl. Artif. Intell..

[88]  Chenglin Wen,et al.  A Novel Multimode Fault Classification Method Based on Deep Learning , 2017, J. Control. Sci. Eng..

[89]  H. Moed,et al.  The use of bibliometric data for the measurement of university research performance , 1985 .

[90]  Wei Wang,et al.  Unsupervised classification of multi-omics data during cardiac remodeling using deep learning. , 2019, Methods.

[91]  Chang Ouk Kim,et al.  A Convolutional Neural Network for Fault Classification and Diagnosis in Semiconductor Manufacturing Processes , 2017, IEEE Transactions on Semiconductor Manufacturing.

[92]  Eamonn J. Keogh,et al.  The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances , 2016, Data Mining and Knowledge Discovery.

[93]  Chien-Liang Liu,et al.  Time Series Classification With Multivariate Convolutional Neural Network , 2019, IEEE Transactions on Industrial Electronics.

[94]  Jian Pei,et al.  A brief survey on sequence classification , 2010, SKDD.

[95]  Matteo Terzi,et al.  Time-Series Classification Methods: Review and Applications to Power Systems Data , 2018 .