Video-based analysis of motion skills in simulation-based surgical training

Analysis ofmotionexpertiseisanimportantprobleminmanydomainsincludingsportsandsurgery.Inrecent years,surgicalsimulationhasemergedattheforefrontofnewtechnologiesforimprovingtheeducationand training ofsurgicalresidents.Insimulation-basedsurgicaltraining,akeytaskistoratetheperformanceofthe operators,whichisdonecurrentlybyseniorsurgeons.Thispaperintroducesanovelsolutiontothisproblem through employingvision-basedtechniques.Wedevelopanautomatic,video-basedapproachtoanalyzingthe motion skillsofasurgeoninsimulation-basedsurgicaltraining,whereasurgicalactioniscapturedbymultiple video cameraswithlittleornocalibration,resultinginmultiplevideostreamsofheterogeneousproperties. Typicalmultiple-viewvisiontechniquesareinadequateforprocessingsuchdata.Weproposeanovelapproach that employsbothcanonicalcorrelationanalysis(CCA)andthebag-of-wordsmodeltoclassifytheexpertise levelofthesubjectbasedontheheterogeneousvideostreamscapturingboththemotionofthesubject'shands and theresultantmotionofthetools.Experimentsweredesignedandperformedtovalidatetheproposed approachusingrealisticdatacapturedfromresidentsurgeonsinlocalhospitals.Theresultssuggestthatthe proposedapproachmayprovideapromisingpracticalsolutiontotherealworldproblemevaluatingmotionskills in simulation-basedsurgicaltraining.

[1]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[2]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[3]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[4]  Teodor P Grantcharov,et al.  Assessment of technical surgical skills. , 2002, The European journal of surgery = Acta chirurgica.

[5]  R. M. Satava,et al.  Metrics for objective Assessment , 2003, Surgical Endoscopy And Other Interventional Techniques.

[6]  Ethan D Grober,et al.  Validation of novel and objective measures of microsurgical skill: Hand‐motion analysis and stereoscopic visual acuity , 2003, Microsurgery.

[7]  John Shawe-Taylor,et al.  Canonical Correlation Analysis: An Overview with Application to Learning Methods , 2004, Neural Computation.

[8]  R. Satava,et al.  Virtual Reality Simulation for the Operating Room: Proficiency-Based Training as a Paradigm Shift in Surgical Skills Training , 2005, Annals of surgery.

[9]  Ivan Laptev,et al.  On Space-Time Interest Points , 2005, International Journal of Computer Vision.

[10]  Gregory D. Hager,et al.  Towards automatic skill evaluation: detection and segmentation of robot-assisted surgical motions. , 2006 .

[11]  Blake Hannaford,et al.  Generalized approach for modeling minimally invasive surgery as a stochastic process using a discrete Markov model , 2006, IEEE Transactions on Biomedical Engineering.

[12]  Sethuraman Panchanathan,et al.  Measuring movement expertise in surgical tasks , 2006, MM '06.

[13]  Jonathan L Rees,et al.  Motion analysis: a validated method for showing skill levels in arthroscopy. , 2008, Arthroscopy : the journal of arthroscopic & related surgery : official publication of the Arthroscopy Association of North America and the International Arthroscopy Association.