Cardiac output method comparison studies: the relation of the precision of agreement and the precision of method

Abstract Cardiac output (CO) plays a crucial role in the hemodynamic management of critically ill patients treated in the intensive care unit and in surgical patients undergoing major surgery. In the field of cardiovascular dynamics, innovative techniques for CO determination are increasingly available. Therefore, the number of studies comparing these techniques with a reference, such as pulmonary artery thermodilution, is rapidly growing. There are mainly two outcomes of such method comparison studies: (1) the accuracy of agreement and (2) the precision of agreement. The precision of agreement depends on the precision of each method, i.e., the precision that the studied and the reference technique are able to achieve. We call this “precision of method”. A decomposition of variance shows that method agreement does not only depend on the precision of method but also on another important source of variability, i.e., the method’s general variability about the true values. Ignorance of that fact leads to falsified conclusions about the precision of method of the studied technique. In CO studies, serial measurements are frequently confused with repeated measurements. But as the actual CO of a subject changes from assessment to assessment, there is no real repetition of a measurement. This situation equals a scenario in which single measurements are given for multiple true values per subject. In such a case it is not possible to assess the precision of method.

[1]  جمال الهاشمي,et al.  Cardiac output monitoring: an integrative perspective , 2011 .

[2]  K. Reinhart,et al.  Is the placement of a pulmonary artery catheter still justified solely for the measurement of cardiac output? , 2000, Journal of cardiothoracic and vascular anesthesia.

[3]  A. Beckett,et al.  AKUFO AND IBARAPA. , 1965, Lancet.

[4]  M. Cecconi,et al.  Noninvasive continuous cardiac output monitoring in perioperative and intensive care medicine. , 2015, British journal of anaesthesia.

[5]  D. Altman,et al.  Agreement Between Methods of Measurement with Multiple Observations Per Individual , 2007, Journal of biopharmaceutical statistics.

[6]  Assessment of agreement and trending between haemodynamic monitors is still challenging , 2014, Intensive Care Medicine.

[7]  D. Altman,et al.  Measuring agreement in method comparison studies , 1999, Statistical methods in medical research.

[8]  K. Reinhart,et al.  Comparison of pulmonary artery and arterial thermodilution cardiac output in critically ill patients , 1999, Intensive Care Medicine.

[9]  G. Diamond,et al.  Catheterization of the heart in man with use of a flow-directed balloon-tipped catheter. , 1970, The New England journal of medicine.

[10]  J M Bland,et al.  Statistical methods for assessing agreement between two methods of clinical measurement , 1986 .

[11]  Douglas G. Altman,et al.  Measurement in Medicine: The Analysis of Method Comparison Studies , 1983 .

[12]  M. Cecconi,et al.  Metrology in Medicine: From Measurements to Decision, with Specific Reference to Anesthesia and Intensive Care , 2014, Anesthesia and analgesia.

[13]  T. Schuerholz,et al.  Comparison of cardiac output measurements by arterial trans‐cardiopulmonary and pulmonary arterial thermodilution with direct Fick in septic shock , 2005, European journal of anaesthesiology.

[14]  Philip J Peyton,et al.  Minimally Invasive Measurement of Cardiac Output during Surgery and Critical Care: A Meta-analysis of Accuracy and Precision , 2010, Anesthesiology.

[15]  David L Streiner,et al.  "Precision" and "accuracy": two terms that are neither. , 2006, Journal of clinical epidemiology.

[16]  L. Critchley,et al.  A Meta-Analysis of Studies Using Bias and Precision Statistics to Compare Cardiac Output Measurement Techniques , 1999, Journal of Clinical Monitoring and Computing.

[17]  M. Cecconi,et al.  Bench-to-bedside review: The importance of the precision of the reference technique in method comparison studies – with specific reference to the measurement of cardiac output , 2009, Critical care.

[18]  James S. Forrester,et al.  A new technique for measurement of cardiac output by thermodilution in man , 1971 .

[19]  P. Marik,et al.  Noninvasive cardiac output monitors: a state-of the-art review. , 2013, Journal of cardiothoracic and vascular anesthesia.

[20]  L. Critchley Bias and precision statistics: should we still adhere to the 30% benchmark for cardiac output monitor validation studies? , 2011, Anesthesiology.