An attention-based CNN-BiLSTM hybrid neural network enhanced with features of discrete wavelet transformation for fetal acidosis classification

Abstract Cardiotocography (CTG) is widely used in fetal monitoring, especially in the diagnosis of fetal acidosis. However, the manual interpretation of CTG analysis may easily lead to a low diagnostic rate, usually caused by various subjective factors. In order to reduce misdiagnosis, we propose an attention-based CNN-BiLSTM hybrid neural network enhanced with features of discrete wavelet transformation (DWT) for fetal acidosis classification. A joint model of convolutional neural network (CNN) and bi-directional long short-term memory (BiLSTM) is established to capture the complex nonlinear spatial and temporal relations of fetal heart rate (FHR) signals. The attention mechanism is then adopted to focus on important input features. And DWT is used to obtain FHR signals transformation coefficient features in order to reduce overfitting. Two features are fused together to classify fetal acidosis. This study uses signals from the public databases of the CTU-UHB for evaluation. A ten different verifications yields average sensitivity (SE), specificity (SP), and quality index (QI) of 75.23%, 70.82% and 72.29%, respectively. Our approach achieves better experimental results than previous works. Moreover, Our hybrid model is an end to end one, with a much simpler DWT feature extraction. With the advent of the big data era, our hybrid model will have great advantages.

[1]  D. Ayres-de-Campos,et al.  FIGO consensus guidelines on intrapartum fetal monitoring: Cardiotocography , 2015, International journal of gynaecology and obstetrics: the official organ of the International Federation of Gynaecology and Obstetrics.

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Jacek M. Leski,et al.  Fuzzy classifier based on clustering with pairs of ε-hyperballs and its application to support fetal state assessment , 2019, Expert Syst. Appl..

[4]  D. Ayres-de- Campos,et al.  SisPorto 2.0: a program for automated analysis of cardiotocograms. , 2000, The Journal of maternal-fetal medicine.

[5]  D. Young,et al.  Fetal health surveillance: antepartum and intrapartum consensus guideline. , 2007, Journal of obstetrics and gynaecology Canada : JOGC = Journal d'obstetrique et gynecologie du Canada : JOGC.

[6]  S. Thurner,et al.  Multiresolution Wavelet Analysis of Heartbeat Intervals Discriminates Healthy Patients from Those with Cardiac Pathology , 1997, adap-org/9711003.

[7]  E. Chandraharan,et al.  Continuous cardiotocography during labour: Analysis, classification and management. , 2016, Best practice & research. Clinical obstetrics & gynaecology.

[8]  Edmond Zahedi,et al.  Antepartum fetal heart rate feature extraction and classification using empirical mode decomposition and support vector machine , 2011, Biomedical engineering online.

[9]  Diyi Yang,et al.  Hierarchical Attention Networks for Document Classification , 2016, NAACL.

[10]  Zhang Yang,et al.  Performance evaluation of Empirical Mode Decomposition and Discrete Wavelet Transform for computerized hypoxia detection and prediction , 2018, 2018 26th Signal Processing and Communications Applications Conference (SIU).

[11]  Sandra Rees,et al.  Fetal and neonatal origins of altered brain development. , 2005, Early human development.

[12]  Ivan Jordanov,et al.  Multimodal Convolutional Neural Networks to Detect Fetal Compromise During Labor and Delivery , 2019, IEEE Access.

[13]  Yang Zhang,et al.  Computer-Aided Diagnosis System of Fetal Hypoxia Incorporating Recurrence Plot With Convolutional Neural Network , 2019, Front. Physiol..

[14]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[15]  Hiroshi Nishiura,et al.  Age-Dependent Estimates of the Epidemiological Impact of Pandemic Influenza (H1N1-2009) in Japan , 2013, Comput. Math. Methods Medicine.

[16]  Lenka Lhotská,et al.  Discriminating Normal from "Abnormal" Pregnancy Cases Using an Automated FHR Evaluation Method , 2014, SETN.

[17]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[18]  Bob L. Sturm International Symposium: Iannis XenakisThe Electroacoustic Work , 2007, Computer Music Journal.

[19]  Paul Fergus,et al.  Machine learning ensemble modelling to classify caesarean section and vaginal delivery types using Cardiotocography traces , 2018, Comput. Biol. Medicine.

[20]  Lenka Lhotská,et al.  Investigating pH based evaluation of fetal heart rate (FHR) recordings , 2017, Health and Technology.

[21]  Yang Zhang,et al.  A Comprehensive Feature Analysis of the Fetal Heart Rate Signal for the Intelligent Assessment of Fetal State , 2018, Journal of clinical medicine.

[22]  Doina Precup,et al.  Identification of the Dynamic Relationship Between Intrapartum Uterine Pressure and Fetal Heart Rate for Normal and Hypoxic Fetuses , 2009, IEEE Transactions on Biomedical Engineering.

[23]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Masoumeh Haghpanahi,et al.  Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network , 2019, Nature Medicine.

[25]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  M. Nageotte,et al.  Fetal heart rate monitoring , 1997, Springer Berlin Heidelberg.

[27]  Lenka Lhotská,et al.  The Use of Convolutional Neural Networks in Biomedical Data Processing , 2017, ITBAM.

[28]  Mei-Ling Huang,et al.  Fetal distress prediction using discriminant analysis, decision tree, and artificial neural network , 2012 .

[29]  Zafer Cömert,et al.  Prognostic model based on image-based time-frequency features and genetic algorithm for fetal hypoxia assessment , 2018, Comput. Biol. Medicine.

[30]  M. Ross,et al.  Use of umbilical artery base excess: algorithm for the timing of hypoxic injury. , 2002, American journal of obstetrics and gynecology.

[31]  Ersen Yilmaz,et al.  Fetal State Assessment from Cardiotocogram Data Using Artificial Neural Networks , 2016 .

[32]  Jieyun Bai,et al.  Cardiotocography signal abnormality classification using time-frequency features and Ensemble Cost-sensitive SVM classifier , 2021, Comput. Biol. Medicine.

[33]  Petar M. Djuric,et al.  Fetal Heart Rate Classification Using Generative Models , 2014, IEEE Transactions on Biomedical Engineering.

[34]  Ramesh A. Gopinath,et al.  On upsampling, downsampling, and rational sampling rate filter banks , 1994, IEEE Trans. Signal Process..

[35]  João Bernardes,et al.  On the prediction of foetal acidaemia: A spectral analysis-based approach , 2019, Comput. Biol. Medicine.

[36]  Maria Romano,et al.  An algorithm for the recovery of fetal heart rate series from CTG data , 2007, Comput. Biol. Medicine.

[37]  M. Huptych,et al.  Fetal heart rate data pre-processing and annotation , 2009, 2009 9th International Conference on Information Technology and Applications in Biomedicine.

[38]  Zafer Cömert,et al.  Fetal Hypoxia Detection Based on Deep Convolutional Neural Network with Transfer Learning Approach , 2018, CSOS.

[39]  Lenka Lhotská,et al.  Agreement on intrapartum cardiotocogram recordings between expert obstetricians. , 2015, Journal of evaluation in clinical practice.

[40]  Lenka Lhotská,et al.  Open access intrapartum CTG database , 2014, BMC Pregnancy and Childbirth.

[41]  María J. Ibáñez,et al.  Hermite spline interpolation on a three direction mesh from Powell-Sabin and Hsieh-Clough-Tocher finite elements , 2017, J. Comput. Appl. Math..

[42]  Sadasivan Puthusserypady,et al.  A deep learning approach for real-time detection of atrial fibrillation , 2019, Expert Syst. Appl..

[43]  Edwin Chandraharan,et al.  Prevention of birth asphyxia: responding appropriately to cardiotocograph (CTG) traces. , 2007, Best practice & research. Clinical obstetrics & gynaecology.

[44]  João Bernardes,et al.  Agreement studies in obstetrics and gynaecology: inappropriateness, controversies and consequences , 2005, BJOG : an international journal of obstetrics and gynaecology.

[45]  Zafer Cömert,et al.  Evaluation of Fetal Distress Diagnosis during Delivery Stages based on Linear and Nonlinear Features of Fetal Heart Rate for Neural Network Community , 2016 .

[46]  Ersen Yilmaz,et al.  Determination of Fetal State from Cardiotocogram Using LS-SVM with Particle Swarm Optimization and Binary Decision Tree , 2013, Comput. Math. Methods Medicine.