Assessment of basic human performance resources predicts the performance of virtual ureterorenoscopy.

PURPOSE Regardless of training, innate ability may influence the acquisition of endoscopic skills. Until recently objective methods to assess innate ability have not been available. We compared objective measures of human basic performance resources (BPRs) using nonlinear causal resource analysis (NCRA) and expert rated endoscopic performance of medical students on a virtual reality (VR) simulator. MATERIALS AND METHODS BPRs were measured in 18 medical students (group 1) using 13 validated tests. BPR results were compared to the results of ureteroscopic skills assessment on the VR simulator. An NCRA model was devised to predict performance based on BPRs and the limiting performance resource (LPR). The same BPRs were measured in a second group of 14 medical students (group 2). Using the model created from group 1 performance of VR ureterorenoscopy was predicted based on LPR for each student in group 2. Predicted performance was compared to rated performance. RESULTS The average difference in score between 2 expert raters was 7.2%. The average difference in predicted score based on the NCRA model and rated score was only 8.0%. In 9 of the 14 group 2 subjects (63%) the performance prediction by NCRA was in excellent agreement (+/-10%) with the expert rating on the VR simulation. NCRA over predicted performance in 2 subjects (14%) and under predicted performance in 3 (21%). CONCLUSIONS Objective prediction of ureteroscopic performance in the VR environment using LPRs (measures of innate ability) for each subject is possible and practical using new measurement and modeling methods. The selection of surgical candidates, training and the educational curriculum could be impacted.

[1]  G. V. Kondraske,et al.  Performance prediction and limiting resource identification with nonlinear causal resource analysis , 1997, Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 'Magnificent Milestones and Emerging Opportunities in Medical Engineering' (Cat. No.97CH36136).

[2]  Daniel B. Jones,et al.  Assessment of basic human performance resources predicts operative performance of laparoscopic surgery. , 2003, Journal of the American College of Surgeons.

[3]  D. Scott,et al.  The impact of intense laparoscopic skills training on the operative performance of urology residents. , 2001, The Journal of urology.

[4]  R. Reznick,et al.  Testing technical skill via an innovative "bench station" examination. , 1997, American journal of surgery.

[5]  Paul J. Vasta,et al.  Measurement of Information-Processing Performance Capacities , 1999 .

[6]  R. M. Satava,et al.  The need for metrics in surgical education , 1999, Surgical Endoscopy.

[7]  W. Melvin,et al.  Laparoscopic skills enhancement. , 1996, American journal of surgery.

[8]  George V. Kondraske,et al.  Applying General Systems Performance Theory and the Elemental Resource Model to Gender-Related Issues in Physical Education and Sport , 1994 .

[9]  George V. Kondraske,et al.  A Working Model for Human System-Task Interfaces , 1999 .

[10]  A Cuschieri,et al.  Assessment of innate ability and skills for endoscopic manipulations by the Advanced Dundee Endoscopic Psychomotor Tester: predictive and concurrent validity. , 1999, American journal of surgery.

[11]  George V. Kondraske,et al.  A PC-Based performance measurement laboratory system , 1990 .

[12]  A. Hawasli,et al.  Laparoscopic training in residency program. , 1996, Journal of laparoendoscopic surgery.

[13]  R. M. Satava,et al.  PicSOr: An objective test of perceptual skill that predicts laparoscopic technical skill in three initial studies of laparoscopopic performance , 2003, Surgical Endoscopy And Other Interventional Techniques.

[14]  A. Gallagher,et al.  Virtual reality training in laparoscopic surgery: a preliminary assessment of minimally invasive surgical trainer virtual reality (MIST VR). , 1999, Endoscopy.

[15]  A. Darzi,et al.  Assessing operative skill , 1999, BMJ.

[16]  G. V. Kondraske,et al.  Neuromotor channel capacity, coordination, and motion quality , 2000, Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Cat. No.00CH37143).

[17]  W. McGaghie,et al.  Simulation technology for health care professional skills training and assessment. , 1999, JAMA.

[18]  Joseph D. Bronzino,et al.  The Biomedical Engineering Handbook , 1995 .