Design and Assessment of a Robust and Generalizable ANN-Based Classifier for the Prediction of Premature Birth by means of Multichannel Electrohysterographic Records

Preterm labor is one of the major causes of neonatal deaths and also the cause of significant health and development impairments in those who survive. However, there are still no reliable and accurate tools for preterm labor prediction in clinical settings. Electrohysterography (EHG) has been proven to provide relevant information on the labor time horizon. Many studies focused on predicting preterm labor by using temporal, spectral, and nonlinear parameters extracted from single EHG recordings. However, multichannel analysis, which includes information from the whole uterus and about coupling between the recording areas, may provide better results. The cross validation method is often used to design classifiers and evaluate their performance. However, when the validation dataset is used to tune the classifier hyperparameters, the performance metrics of this dataset may not properly assess its generalization capacity. In this work, we developed and compared different classifiers, based on artificial neural networks, for predicting preterm labor using EHG features from single and multichannel recordings. A set of temporal, spectral, nonlinear, and synchronization parameters computed from EHG recordings was used as the input features. All the classifiers were evaluated on independent test datasets, which were never “seen” by the models, to determine their generalization capacity. Classifiers’ performance was also evaluated when obstetrical data were included. The experimental results show that the classifier performance metrics were significantly lower in the test dataset (AUC range 76-91%) than in the train and validation sets (AUC range 90-99%). The multichannel classifiers outperformed the single-channel classifiers, especially when information was combined into mean efficiency indexes and included coupling information between channels. Including obstetrical data slightly improved the classifier metrics and reached an AUC of for the test dataset. These results show promise for the transfer of the EHG technique to preterm labor prediction in clinical practice.

[1]  Javier Mas-Cabo,et al.  Uterine electromyography for discrimination of labor imminence in women with threatened preterm labor under tocolytic treatment , 2018, Medical & Biological Engineering & Computing.

[2]  Wlodzimierz Klonowski,et al.  Personalized Neurological Diagnostics from Biomedical Physicist's Point of View and Application of New Non-Linear Dynamics Methods in Biosignal Analysis , 2011 .

[3]  Aly Chkeir,et al.  Patterns of electrical activity synchronization in the pregnant rat uterus , 2013 .

[4]  Ahmad Diab,et al.  Classification of pregnancy and labor contractions using a graph theory based analysis , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[5]  Ana Pilar Betran,et al.  The worldwide incidence of preterm birth: a systematic review of maternal mortality and morbidity. , 2010, Bulletin of the World Health Organization.

[6]  C. Marque,et al.  Spectral characterization of human EHG frequency components based on the extraction and reconstruction of the ridges in the scalogram , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[7]  J. Kurinczuk,et al.  Pregnancy at very advanced maternal age: a UK population‐based cohort study , 2016, BJOG : an international journal of obstetrics and gynaecology.

[8]  R. Garfield,et al.  Changes in transcripts encoding calcium channel subunits of rat myometrium during pregnancy. , 1995, The American journal of physiology.

[9]  Javier Mas-Cabo,et al.  Uterine contractile efficiency indexes for labor prediction: A bivariate approach from multichannel electrohysterographic records , 2018, Biomed. Signal Process. Control..

[10]  G. Prats-Boluda,et al.  Electrohysterography in the diagnosis of preterm birth: a review , 2018, Physiological measurement.

[11]  Jing Liu,et al.  A new EEG synchronization strength analysis method: S-estimator based normalized weighted-permutation mutual information , 2016, Neural Networks.

[12]  Brynjar Karlsson,et al.  Performance analysis of four nonlinearity analysis methods using a model with variable complexity and application to uterine EMG signals. , 2014, Medical engineering & physics.

[13]  William L. Maner,et al.  Identification of Human Term and Preterm Labor using Artificial Neural Networks on Uterine Electromyography Data , 2007, Annals of Biomedical Engineering.

[14]  Mohamed A. A. Eldosoky,et al.  New technique based on uterine electromyography nonlinearity for preterm delivery detection , 2014 .

[15]  Erik W. Jensen,et al.  EEG complexity as a measure of depth of anesthesia for patients , 2001, IEEE Trans. Biomed. Eng..

[16]  Léon Bottou,et al.  Stochastic Gradient Descent Tricks , 2012, Neural Networks: Tricks of the Trade.

[17]  Miha Lucovnik,et al.  Accuracy of frequency-related parameters of the electrohysterogram for predicting preterm delivery. , 2010, Obstetrical & gynecological survey.

[18]  Assuring Healthy Outcomes,et al.  Preterm Birth : Causes , Consequences , and Prevention , 2005 .

[19]  F Jager,et al.  Separating sets of term and pre-term uterine EMG records , 2015, Physiological measurement.

[20]  M. Lucovnik,et al.  Noninvasive uterine electromyography for prediction of preterm delivery. , 2011, American journal of obstetrics and gynecology.

[21]  Yuhua Li,et al.  Evaluation of Sampling Methods for Learning from Imbalanced Data , 2013, ICIC.

[22]  C. Rabotti,et al.  Accuracy of Frequency-Related Parameters of the Electrohysterogram for Predicting Preterm Delivery: A Review of the Literature , 2009, Obstetrical & gynecological survey.

[23]  W. Maner,et al.  Physiology and electrical activity of uterine contractions. , 2007, Seminars in cell & developmental biology.

[24]  Marta Borowska,et al.  Early diagnosis of threatened premature labor by electrohysterographic recordings – The use of digital signal processing , 2016 .

[25]  Gari D. Clifford,et al.  A machine learning approach to multi-level ECG signal quality classification , 2014, Comput. Methods Programs Biomed..

[26]  R. Garfield,et al.  Appearance of gap junctions in the myometrium of women during labor. , 1981, American journal of obstetrics and gynecology.

[27]  O. Langer,et al.  Can myometrial electrical activity identify patients in preterm labor? , 2008, American journal of obstetrics and gynecology.

[28]  D. Haas,et al.  Short-term tocolytics for preterm delivery – current perspectives , 2014, International journal of women's health.

[29]  Chelsea Dobbins,et al.  Advanced artificial neural network classification for detecting preterm births using EHG records , 2016, Neurocomputing.

[30]  Zoubin Ghahramani,et al.  Unifying linear dimensionality reduction , 2014, 1406.0873.

[31]  J. Jezewski,et al.  Early predicting a risk of preterm labour by analysis of antepartum electrohysterograhic signals , 2016 .

[32]  Andrew P. Bradley,et al.  The use of the area under the ROC curve in the evaluation of machine learning algorithms , 1997, Pattern Recognit..

[33]  Gary M. Weiss,et al.  Cost-Sensitive Learning vs. Sampling: Which is Best for Handling Unbalanced Classes with Unequal Error Costs? , 2007, DMIN.

[34]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[35]  Chelsea Dobbins,et al.  Prediction of Preterm Deliveries from EHG Signals Using Machine Learning , 2013, PloS one.

[36]  G. Saade,et al.  Predicting Term and Preterm Delivery With Transabdominal Uterine Electromyography , 2003, Obstetrics and gynecology.

[37]  D. Rudel,et al.  Evaluating Uterine Electrohysterogram with Entropy , 2007 .

[38]  Marimuthu Palaniswami,et al.  Do existing measures of Poincare plot geometry reflect nonlinear features of heart rate variability? , 2001, IEEE Transactions on Biomedical Engineering.

[39]  Brynjar Karlsson,et al.  Comparison between approximate entropy, correntropy and time reversibility: application to uterine electromyogram signals. , 2011, Medical engineering & physics.

[40]  Mohamed A. A. Eldosoky,et al.  Kl. Comparison between Using Linear and Non-linear Features to Classify Uterine Electromyography Signals of Term and Preterm Deliveries , 2013, NRSC 2013.

[41]  P. Husslein,et al.  Oxytocin receptors in the human uterus during pregnancy and parturition. , 1984, American journal of obstetrics and gynecology.

[42]  Zhenlong Li,et al.  Performance analysis of K-nearest neighbor, support vector machine, and artificial neural network classifiers for driver drowsiness detection with different road geometries , 2017, Int. J. Distributed Sens. Networks.

[43]  C Marque,et al.  Uterine electromyography: a critical review. , 1993, American journal of obstetrics and gynecology.

[44]  Peng Ren,et al.  Improved Prediction of Preterm Delivery Using Empirical Mode Decomposition Analysis of Uterine Electromyography Signals , 2015, PloS one.

[45]  H. S. Niranjana Murthy,et al.  ANN, SVM and KNN Classifiers for Prognosis of Cardiac Ischemia- A Comparison , 2015 .

[46]  Michael Y. Hu,et al.  Forecasting with artificial neural networks: The state of the art , 1997 .

[47]  Casimir A. Kulikowski,et al.  Computer Systems That Learn: Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning and Expert Systems , 1990 .

[48]  J. Kleijnen,et al.  The accuracy of risk scores in predicting preterm birth—a systematic review , 2004, Journal of obstetrics and gynaecology : the journal of the Institute of Obstetrics and Gynaecology.

[49]  G. Fele-Zorz,et al.  A comparison of various linear and non-linear signal processing techniques to separate uterine EMG records of term and pre-term delivery groups , 2008, Medical & Biological Engineering & Computing.

[50]  U. Rajendra Acharya,et al.  Automated detection of premature delivery using empirical mode and wavelet packet decomposition techniques with uterine electromyogram signals , 2017, Comput. Biol. Medicine.

[51]  Stavros Petrou,et al.  The economic consequences of preterm birth duringthe first 10 years of life , 2005, BJOG : an international journal of obstetrics and gynaecology.

[52]  Rich Caruana,et al.  Overfitting in Neural Nets: Backpropagation, Conjugate Gradient, and Early Stopping , 2000, NIPS.

[53]  Jinchang Ren,et al.  ANN vs. SVM: Which one performs better in classification of MCCs in mammogram imaging , 2012, Knowl. Based Syst..

[54]  M Gissler,et al.  Preterm birth time trends in Europe: a study of 19 countries , 2013, BJOG : an international journal of obstetrics and gynaecology.

[55]  Danilo P. Mandic,et al.  A Multivariate Multiscale Fuzzy Entropy Algorithm with Application to Uterine EMG Complexity Analysis , 2016, Entropy.

[56]  D. N. Tibarewala,et al.  Comparing ANN, LDA, QDA, KNN and SVM algorithms in classifying relaxed and stressful mental state from two-channel prefrontal EEG data , 2012, Int. J. Artif. Intell. Soft Comput..

[57]  J. Terrien,et al.  Improving the classification rate of labor vs. normal pregnancy contractions by using EHG multichannel recordings , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[58]  Shalom Darmanjian,et al.  Monitoring uterine activity during labor: a comparison of 3 methods. , 2012, American journal of obstetrics and gynecology.

[59]  W. Maner,et al.  Biophysical methods of prediction and prevention of preterm labor : uterine electromyography and cervical light-induced fluorescence – new obstetrical diagnostic techniques , 2006 .

[60]  Holger Maul,et al.  Use of uterine EMG and cervical LIF in monitoring pregnant patients , 2005, BJOG: an International Journal of Obstetrics and Gynaecology.

[61]  Blockin SVM : Which One Performs Better in Classification of MCCs in Mammogram Imaging , 2022 .

[62]  J. Crane,et al.  SOGC Clinical Practice Guideline. Ultrasonographic cervical length assessment in predicting preterm birth in singleton pregnancies. , 2011, Journal of obstetrics and gynaecology Canada : JOGC = Journal d'obstetrique et gynecologie du Canada : JOGC.

[63]  Roberto Romero,et al.  Epidemiology and causes of preterm birth , 2008, The Lancet.

[64]  G. Saade,et al.  Non-invasive transabdominal uterine electromyography correlates with the strength of intrauterine pressure and is predictive of labor and delivery , 2004, The journal of maternal-fetal & neonatal medicine : the official journal of the European Association of Perinatal Medicine, the Federation of Asia and Oceania Perinatal Societies, the International Society of Perinatal Obstetricians.