Comparison of Clinical Interpretation With Visual Assessment and Quantitative Coronary Angiography in Patients Undergoing Percutaneous Coronary Intervention in Contemporary Practice: The Assessing Angiography (A2) Project

Background— Studies conducted decades ago described substantial disagreement and errors in physicians’ angiographic interpretation of coronary stenosis severity. Despite the potential implications of such findings, no large-scale efforts to measure or improve clinical interpretation were subsequently undertaken. Methods and Results— We compared clinical interpretation of stenosis severity in coronary lesions with an independent assessment using quantitative coronary angiography (QCA) in 175 randomly selected patients undergoing elective percutaneous coronary intervention at 7 US hospitals in 2011. To assess agreement, we calculated mean difference in percent diameter stenosis between clinical interpretation and QCA and a Cohen weighted &kgr; statistic. Of 216 treated lesions, median percent diameter stenosis was 80.0% (quartiles 1 and 3, 80.0% and 90.0%), with 213 (98.6%) assessed as ≥70%. Mean difference in percent diameter stenosis between clinical interpretation and QCA was 8.2±8.4%, reflecting an average higher percent diameter stenosis by clinical interpretation (P<0.001). A weighted &kgr; of 0.27 (95% confidence interval, 0.18–0.36) was found between the 2 measurements. Of 213 lesions considered ≥70% by clinical interpretation, 56 (26.3%) were <70% by QCA, although none were <50%. Differences between the 2 measurements were largest for intermediate lesions by QCA (50% to <70%), with variation existing across sites. Conclusions— Physicians tended to assess coronary lesions treated with percutaneous coronary intervention as more severe than measurements by QCA. Almost all treated lesions were ≥70% by clinical interpretation, whereas approximately one quarter were <70% by QCA. These findings suggest opportunities to improve clinical interpretation of coronary angiography.

[1]  R. Popp,et al.  Accuracy and reproducibility of visual coronary stenosis estimates using information from multiple observers , 1992, Clinical cardiology.

[2]  J. J. Gerbrands,et al.  Assessment of short-, medium-, and long-term variations in arterial dimensions from computer-assisted quantitation of coronary cineangiograms. , 1985, Circulation.

[3]  Sharmila Devi US physicians urge end to unnecessary stent operations , 2011, The Lancet.

[4]  A. Lansky,et al.  Quantitative angiographic methods for bifurcation lesions : A consensus statement from the European Bifurcation Group , 2009, Catheterization and cardiovascular interventions : official journal of the Society for Cardiac Angiography & Interventions.

[5]  M. Murphy,et al.  Coronary angiogram interpretation. Interobserver variability. , 1978, JAMA.

[6]  A. Wear CIRCULATION , 1964, The Lancet.

[7]  K. Gould,et al.  Patterns in visual interpretation of coronary arteriograms as detected by quantitative coronary arteriography. , 1991, Journal of the American College of Cardiology.

[8]  S. M. Collins,et al.  Visual estimates of percent diameter coronary stenosis: "a battered gold standard". , 1988, Journal of the American College of Cardiology.

[9]  T. Cupples Single Reading with Computer-Aided Detection for Screening Mammography , 2009 .

[10]  C. D'Orsi,et al.  Influence of computer-aided detection on performance of screening mammography. , 2007, The New England journal of medicine.

[11]  M. Raphael,et al.  A "SIGNIFICANT" STENOSIS: THIRTY YEARS ON , 1989, The Lancet.

[12]  P J Scanlon,et al.  ACC/AHA guidelines for coronary angiography: executive summary and recommendations. A report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Committee on Coronary Angiography) developed in collaboration with the Society for Cardiac Angiography and , 1999, Circulation.

[13]  Laura Mauri,et al.  2011 ACCF/AHA/SCAI guideline for percutaneous coronary intervention , 2013, Catheterization and cardiovascular interventions : official journal of the Society for Cardiac Angiography & Interventions.

[14]  Laura Mauri,et al.  2011 ACCF/AHA/SCAI Guideline for Percutaneous Coronary Intervention: a report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines and the Society for Cardiovascular Angiography and Interventions. , 2011, Circulation.

[15]  T. Takaro,et al.  Observer Agreement in Evaluating Coronary Angiograms , 1975, Circulation.

[16]  N. Kleiman,et al.  Comparison of quantitative coronary angiography to visual estimates of lesion severity pre and post PTCA. , 1990, American heart journal.

[17]  W. Laskey,et al.  2012 American College of Cardiology Foundation/Society for Cardiovascular Angiography and Interventions expert consensus document on cardiac catheterization laboratory standards update: A report of the American College of Cardiology Foundation Task Force on Expert Consensus documents developed in co , 2012, Journal of the American College of Cardiology.

[18]  H. Krumholz,et al.  Putting ad hoc PCI on pause. , 2010, JAMA.

[19]  J. Murray,et al.  ACC/AHA guidelines for coronary angiography. A report of the American College of Cardiology/American Heart Association Task Force on practice guidelines (Committee on Coronary Angiography). Developed in collaboration with the Society for Cardiac Angiography and Interventions. , 1999, Journal of the American College of Cardiology.

[20]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[21]  P. Hartigan,et al.  Relation between coronary artery stenosis assessed by visual, caliper, and computer methods and exercise capacity in patients with single-vessel coronary artery disease. The Veterans Affairs ACME Investigators. , 1994, Circulation.

[22]  R. Vogel,et al.  Accuracy of individual and panel visual interpretations of coronary arteriograms: implications for clinical decisions. , 1990, Journal of the American College of Cardiology.

[23]  D. Faxon,et al.  Value of visual versus central quantitative measurements of angiographic success after percutaneous transluminal coronary angioplasty. NHLBI PTCA Registry Investigators. , 1996, The American journal of cardiology.

[24]  J. J. Gerbrands,et al.  Coronary Artery Dimensions from Cineangiograms-Methodology and Validation of a Computer-Assisted Analysis Procedure , 1984, IEEE Transactions on Medical Imaging.

[25]  J. Messenger,et al.  A contemporary view of diagnostic cardiac catheterization and percutaneous coronary intervention in the United States: a report from the CathPCI Registry of the National Cardiovascular Data Registry, 2010 through June 2011. , 2012, Journal of the American College of Cardiology.

[26]  S. Astley,et al.  Single reading with computer-aided detection for screening mammography. , 2008, The New England journal of medicine.

[27]  L D Fisher,et al.  Reproducibility of coronary arteriographic reading in the coronary artery surgery study (CASS). , 1982, Catheterization and cardiovascular diagnosis.

[28]  J. Spertus,et al.  ACCF/SCAI/STS/AATS/AHA/ASNC/HFSA/SCCT 2012 Appropriate use criteria for coronary revascularization focused update: a report of the American College of Cardiology Foundation Appropriate Use Criteria Task Force, Society for Cardiovascular Angiography and Interventions, Society of Thoracic Surgeons, Am , 2012, Journal of the American College of Cardiology.

[29]  R H Brook,et al.  Effect of variability in the interpretation of coronary angiograms on the appropriateness of use of coronary revascularization procedures. , 2000, American heart journal.

[30]  J. Murray,et al.  Variability in the Analysis of Coronary Arteriograms , 1977, Circulation.

[31]  W. Desmet,et al.  Discrepancy between visual estimation and computer-assisted measurement of lesion severity before and after coronary angioplasty. , 1994, Catheterization and cardiovascular diagnosis.

[32]  Peter Niederer,et al.  Quantitative Coronary Arteriography , 1991, Developments in Cardiovascular Medicine.

[33]  A. Viera,et al.  Understanding interobserver agreement: the kappa statistic. , 2005, Family medicine.

[34]  J. H. C. Reiber,et al.  State of the Art in Quantitative Coronary Arteriography , 1986, Developments in Cardiovascular Medicine.