Machine Learning Approach for Prediction of the Test Results of Gonadotropin-Releasing Hormone Stimulation: Model Building and Implementation

Precocious puberty in girls is defined as the onset of pubertal changes before 8 years of age, and gonadotropin-releasing hormone (GnRH) agonist treatment is available for central precocious puberty (CPP). The gold standard for diagnosing CPP is the GnRH stimulation test. However, the GnRH stimulation test is time-consuming, costly, and requires repeated blood sampling. We aimed to develop an artificial intelligence (AI) prediction model to assist pediatric endocrinologists in decision making regarding the optimal timing to perform the GnRH stimulation test. We reviewed the medical charts of 161 girls who received the GnRH stimulation test from 1 August 2010 to 31 August 2021, and we selected 15 clinically relevant features for machine learning modeling. We chose the models with the highest area under the receiver operating characteristic curve (AUC) to integrate into our computerized physician order entry (CPOE) system. The AUC values for the CPP diagnosis prediction model (LH ≥ 5 IU/L) were 0.884 with logistic regression, 0.912 with random forest, 0.942 with LightGBM, and 0.942 with XGBoost. For the Taiwan National Health Insurance treatment coverage prediction model (LH ≥ 10 IU/L), the AUC values were 0.909, 0.941, 0.934, and 0.881, respectively. In conclusion, our AI predictive system can assist pediatric endocrinologists when they are deciding whether a girl with suspected CPP should receive a GnRH stimulation test. With proper use, this prediction model may possibly avoid unnecessary invasive blood sampling for GnRH stimulation tests.

[1]  F. Chiarelli,et al.  Evaluation of Bone Age in Children: A Mini-Review , 2021, Frontiers in Pediatrics.

[2]  Y. Tung Central precocious puberty in girls: Increasing with time. , 2021, Pediatrics and neonatology.

[3]  Yann-Jinn Lee,et al.  Diagnostic evaluation of central precocious puberty in girls. , 2020, Pediatrics and neonatology.

[4]  Jiangfeng Ye,et al.  Clinical risk score for central precocious puberty among girls with precocious pubertal development: a cross sectional study , 2020, BMC Endocrine Disorders.

[5]  Julia Omar,et al.  Gonadotropin-releasing hormone stimulation test and diagnostic cutoff in precocious puberty: a mini review , 2020, Annals of pediatric endocrinology & metabolism.

[6]  M. Dattani,et al.  Brook's Clinical Pediatric Endocrinology , 2019 .

[7]  Huiying Liang,et al.  Development of Prediction Models Using Machine Learning Algorithms for Girls with Suspected Central Precocious Puberty: Retrospective Study , 2018, JMIR medical informatics.

[8]  J. Carel,et al.  Causes, diagnosis, and treatment of central precocious puberty. , 2016, The lancet. Diabetes & endocrinology.

[9]  J. H. Kim,et al.  Basal luteinizing hormone and follicular stimulating hormone: is it sufficient for the diagnosis of precocious puberty in girls? , 2013, Annals of pediatric endocrinology & metabolism.

[10]  J. Hwang,et al.  Utility of Basal Luteinizing Hormone Levels for Detecting Central Precocious Puberty in Girls , 2012, Hormone and Metabolic Research.

[11]  M. Friger,et al.  The utility of basal serum LH in prediction of central precocious puberty in girls. , 2012, European journal of endocrinology.

[12]  Hyo-Kyoung Nam,et al.  Factors to Predict Positive Results of Gonadotropin Releasing Hormone Stimulation Test in Girls with Suspected Precocious Puberty , 2012, Journal of Korean medical science.

[13]  D. Edmonds,et al.  Puberty and its disorders. , 2012, Endocrinology and metabolism clinics of North America.

[14]  I. Hughes,et al.  Premature adrenarche , 2011, Archives of Disease in Childhood.

[15]  A. Alikaşifoğlu,et al.  GnRH Stimulation Test in Precocious Puberty: Single Sample is Adequate for Diagnosis and Dose Adjustment , 2011, Journal of clinical research in pediatric endocrinology.

[16]  E. Costello,et al.  Outcomes of early pubertal timing in young women: a prospective population-based study. , 2010, The American journal of psychiatry.

[17]  Mei-Hwei Chang,et al.  New growth charts for Taiwanese children and adolescents based on World Health Organization standards and health-related physical fitness. , 2010, Pediatrics and neonatology.

[18]  W. R. Alromaih Brook's Clinical Pediatric Endocrinology , 2010 .

[19]  M. Du,et al.  Onset of Breast and Pubic Hair Development and Menses in Urban Chinese Girls , 2009, Pediatrics.

[20]  A. Kunselman,et al.  Adequacy of a Single Unstimulated Luteinizing Hormone Level to Diagnose Central Precocious Puberty in Girls , 2009, Pediatrics.

[21]  J. Toppari,et al.  The timing of normal puberty and the age limits of sexual precocity: variations around the world, secular trends, and changes after migration. , 2003, Endocrine reviews.

[22]  W. Greulich,et al.  Radiographic Atlas of Skeletal Development of the Hand and Wrist , 1999 .

[23]  Darrell M. Wilson,et al.  A single-sample, subcutaneous gonadotropin-releasing hormone test for central precocious puberty. , 1996, Pediatrics.

[24]  P. A. Lee,et al.  Spontaneous serum gonadotropin concentrations in the evaluation of precocious puberty. , 1995, The Journal of pediatrics.

[25]  P. A. Lee,et al.  Normal ranges for immunochemiluminometric gonadotropin assays. , 1995, The Journal of pediatrics.

[26]  A. Cavallo,et al.  A simplified gonadotrophin‐releasing hormone test for precocious puberty , 1995, Clinical endocrinology.

[27]  J M Tanner,et al.  Variations in pattern of pubertal changes in girls. , 1969, Archives of disease in childhood.

[28]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[29]  H. Vignes [Precocious puberty]. , 1950, Journal des praticiens; revue generale de clinique et de therapeutique.