Development, External Validation, and Comparative Assessment of a New Diagnostic Score for Hepatic Steatosis

OBJECTIVES:We used data from population-based studies to determine the accuracy of the Fatty Liver Index (FLI) and the Hepatic Steatosis Index (HSI) in determining individual risk of hepatic steatosis. We also developed a new risk scoring system and validated all three indices using external data.METHODS:We used data from the Study of Health in Pomerania (SHIP; n=4,222), conducted in North-eastern Germany, to validate the existing scoring systems and to develop our own index. Data from the South German Echinococcus Multilocularis and Internal Diseases in Leutkirch (EMIL) study (n=2,177) were used as an external validation data set. Diagnostic performance was evaluated in terms of discrimination (area under the receiver operating characteristic curve (AUC)) and calibration plots. We applied boosting for generalized linear models to select relevant diagnostic separators.RESULTS:The FLI accurately discriminated patients with fatty liver disease from those without (AUC=0.817) but had poor calibration, in that predicted risks differed considerably from observed risks, based on SHIP data. The FLI performed well in discrimination and calibration in the analysis of EMIL data (AUC=0.890). The HSI performed worse than the FLI in analysis of both data sets (SHIP: AUC=0.782 and EMIL: AUC=0.841), showing an extremely skewed calibration. Our newly developed risk score had a good performance in the development data set (SHIP: AUC=0.860) and also good discrimination ability in the validation data (EMIL: AUC=0.876), but it had low calibration based on the validation data set.CONCLUSIONS:We compared the ability of the FLI, HSI, and our own scoring system to determine the risk of hepatic steatosis using two population-based data sets (one for the development of our own system and one for validation). In the development and independent replication data set, all three indices discriminated well between patients with and without hepatic steatosis, but the predicted risks did not match well with the observed risks, when applied to external data. Scoring systems for fatty liver disease could depend on methodological standardization of ultrasound diagnosis and laboratory measurements.

[1]  Frank E. Harrell,et al.  Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis , 2001 .

[2]  Lena Osterhagen,et al.  Multiple Imputation For Nonresponse In Surveys , 2016 .

[3]  L. See,et al.  Gout and risk of non-alcoholic fatty liver disease , 2010, Scandinavian journal of rheumatology.

[4]  F. Schaffner,et al.  Nonalcoholic fatty liver disease. , 1986, Progress in liver diseases.

[5]  Daniel B. Mark,et al.  TUTORIAL IN BIOSTATISTICS MULTIVARIABLE PROGNOSTIC MODELS: ISSUES IN DEVELOPING MODELS, EVALUATING ASSUMPTIONS AND ADEQUACY, AND MEASURING AND REDUCING ERRORS , 1996 .

[6]  U. John,et al.  Study of Health in Pomerania (SHIP): A health examination survey in an east German region: Objectives and design , 2005, Sozial- und Präventivmedizin.

[7]  Henry Völzke,et al.  Multicausality in fatty liver disease: is there a rationale to distinguish between alcoholic and non-alcoholic origin? , 2012, World journal of gastroenterology.

[8]  E. Fassio,et al.  Natural history of nonalcoholic steathepatitis: A longitudinal study of repeat liver biopsies , 2004, Hepatology.

[9]  Anna Castiglione,et al.  The Fatty Liver Index: a simple and accurate predictor of hepatic steatosis in the general population , 2006, BMC gastroenterology.

[10]  N. Schlesinger,et al.  Diagnosing and Treating Gout: A Review to Aid Primary Care Physicians , 2010, Postgraduate medicine.

[11]  N. Lundbom,et al.  Prediction of non-alcoholic fatty liver disease and liver fat using metabolic and genetic factors. , 2009, Gastroenterology.

[12]  K. Reynolds,et al.  Global burden of obesity in 2005 and projections to 2030 , 2008, International Journal of Obesity.

[13]  Ncbi.  National Center for Biotechnology Information , 2008 .

[14]  W. Rathmann,et al.  Cohort profile: the study of health in Pomerania. , 2011, International journal of epidemiology.

[15]  S. Kwon,et al.  Validation of fatty liver index and lipid accumulation product for predicting fatty liver in Korean population , 2011, Liver international : official journal of the International Association for the Study of the Liver.

[16]  Torsten Hothorn,et al.  A Framework for Unbiased Model Selection Based on Boosting , 2011 .

[17]  T. Arndt.  Carbohydrate-deficient transferrin as a marker of chronic alcohol abuse: a critical review of preanalysis, analysis, and interpretation. , 2001, Clinical chemistry.

[18]  R. Terkeltaub.  Update on gout: new therapeutic strategies and options , 2010, Nature Reviews Rheumatology.

[19]  H. Tjalsma,et al.  Serum ferritin levels are associated with vascular damage in patients with nonalcoholic fatty liver disease. , 2009, Nutrition, metabolism, and cardiovascular diseases : NMCD.

[20]  Patrick Royston,et al.  Multiple imputation using chained equations: Issues and guidance for practice , 2011, Statistics in medicine.

[21]  Martha Sajatovic,et al.  Clinical Prediction Models , 2013 .

[22]  P. Bossuyt,et al.  Empirical evidence of design-related bias in studies of diagnostic tests. , 1999, JAMA.

[23]  P. Royston,et al.  Building multivariable prognostic and diagnostic models: transformation of the predictors by using fractional polynomials , 1999 .

[24]  Alexander Pertsemlidis,et al.  Genetic variation in PNPLA3 confers susceptibility to nonalcoholic fatty liver disease , 2008, Nature Genetics.

[25]  A. Hofman,et al.  External validation of the fatty liver index for identifying nonalcoholic fatty liver disease in a population-based study. , 2013, Clinical gastroenterology and hepatology : the official clinical practice journal of the American Gastroenterological Association.

[26]  N. Chalasani.  Nonalcoholic fatty liver disease liver fat score and fat equation to predict and quantitate hepatic steatosis: promising but not prime time! , 2009, Gastroenterology.

[27]  D. Mark,et al.  Clinical prediction models: are we building better mousetraps? , 2003, Journal of the American College of Cardiology.

[28]  Henry Völzke,et al.  Impact of fatty liver disease on health care utilization and costs in a general population: a 5-year observation. , 2008, Gastroenterology.

[29]  H. Kim,et al.  Hepatic steatosis index: a simple screening tool reflecting nonalcoholic fatty liver disease. , 2010, Digestive and liver disease : official journal of the Italian Society of Gastroenterology and the Italian Association for the Study of the Liver.

[30]  W. Koenig,et al.  Overweight, physical activity, tobacco and alcohol consumption in a cross-sectional random sample of German adults , 2006, BMC public health.

[31]  Enzo Bonora,et al.  Risk of cardiovascular disease in patients with nonalcoholic fatty liver disease. , 2010, The New England journal of medicine.