Defining competency in flexible cystoscopy: a novel approach using cumulative Sum analysis

BackgroundFlexible cystoscopy (FC) is one of the most frequently performed urological intervention. Cumulative sum analysis (CUSUM) allows objective assessment of a proceduralist’s performance to ensure acceptable outcomes. This study investigated the application of CUSUM to assess a trainee’s learning curve and maintenance of competence in performing FC.MethodsA single urology trainee, with no previous experience of FC, performed FCs between August 2013 and February 2014. For assessment FC was divided into 5 steps. Each step was assigned a CUSUM completion score. The primary outcome measure was successful performance of a complete FC. Prospective data were collected and analysed using CUSUM.ResultsIn total, 419 FCs were performed. Acceptable performance of FC was achieved by the 122nd procedure. Complete assessment of the ureteric orifices and trigone was the most difficult step of FC to achieve consistently. Competence for complete FC was achieved following 289 procedures.ConclusionCUSUM analysis objectively assesses acquisition of competence in flexible cystoscopy. Recommended indicative numbers may underestimate the number of FCs trainees require to achieve, and maintain, competency. Validation of CUSUM method in a larger cohort of trainees should be considered.

[1]  Barbara M A Schout,et al.  Transfer of cysto‐urethroscopy skills from a virtual‐reality simulator to the operating room: a randomized controlled trial , 2009, BJU international.

[2]  Albert J. J. A. Scherpbier,et al.  Acquisition of flexible cystoscopy skills on a virtual reality simulator by experts and novices , 2010, BJU international.

[3]  C. Mayne,et al.  Analysis of the surgical learning curve using the cumulative sum (CUSUM) method , 2013, Neurourology and urodynamics.

[4]  A Darzi,et al.  Validation of a flexible cystoscopy course , 2002, BJU international.

[5]  G. Fried,et al.  How should we establish the clinical case numbers required to achieve proficiency in flexible endoscopy? , 2010, American journal of surgery.

[6]  I. Robinson,et al.  Assessment of surgical competence in parotid surgery using a CUSUM assessment tool. , 2003, Clinical otolaryngology and allied sciences.

[7]  S Bolsin,et al.  The use of the Cusum technique in the assessment of trainee competence in new procedures. , 2000, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[8]  S. Weerasinghe,et al.  Cumulative sum (CUSUM) analysis in the assessment of trainee competence in fetal biometry measurement , 2006, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[9]  K. O’Flynn,et al.  Indicative operative numbers in urology training in the UK and Ireland , 2015 .

[10]  S. Connor,et al.  Cumulative sum (Cusum) analysis provides an objective measure of competency during training in endoscopic retrograde cholangio-pancreatography (ERCP). , 2009, HPB : the official journal of the International Hepato Pancreato Biliary Association.

[11]  V. Naik,et al.  Cusum analysis is a useful tool to assess resident proficiency at insertion of labour epidurals , 2003, Canadian journal of anaesthesia = Journal canadien d'anesthesie.