An augmented reality platform for CABG surgery

In this paper, we introduce a new platform for in CABG surgery based on marker-less augmented reality technology. Our real-time system captures the surgery scene by a camera, extracts SURF features and matches them in video sequence to track the patient's heart. It estimates the camera's pose robustly using RANSAC and highlights the clogged vessel to guide the surgeon during the surgery.

[1]  Lucas H A Sanders,et al.  Management of right ventricular injury after localization of the left anterior descending coronary artery. , 2009, The Annals of thoracic surgery.

[2]  A. Morales,et al.  Cardiac resuscitation with hydrogen peroxide. , 1966, The Annals of thoracic surgery.

[3]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[4]  R. Fisk,et al.  Expeditious location of the embedded proximal left anterior descending coronary artery. , 1980, The Annals of thoracic surgery.

[5]  Yoshikazu Nakajima,et al.  Image guidance of breast cancer surgery using 3-D ultrasound images and augmented reality visualization , 1998, IEEE Transactions on Medical Imaging.

[6]  T Yamashiro,et al.  Intraoperative detection of embedded coronary arteries in MIDCAB using a color Doppler microprobe. , 1999, The Annals of thoracic surgery.

[7]  Duane C. Brown,et al.  Close-Range Camera Calibration , 1971 .

[8]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Edem Ziadinov,et al.  Localizing intramyocardially embedded left anterior descending artery during coronary bypass surgery: literature review , 2013, Journal of Cardiothoracic Surgery.

[10]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[11]  Masashi Komeda,et al.  Visualization of intramuscular left anterior descending coronary arteries during off-pump bypass surgery. , 2004, The Annals of thoracic surgery.

[12]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[13]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[14]  M C Oz,et al.  Exposure of the intramyocardial left anterior descending artery. , 1994, The Annals of thoracic surgery.

[15]  Kevin Cleary,et al.  Stereoscopic augmented reality for laparoscopic surgery , 2014, Surgical Endoscopy.

[16]  Ufuk Aydin,et al.  A method for locating embedded left anterior descending coronary arteries. , 2013, The Annals of thoracic surgery.

[17]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[18]  A. S. Olearchyk,et al.  Use of a handheld epicardial ultrasonic Doppler flow detector to locate an intramyocardial coronary artery encased in inflamed neoplastic pericardium. , 2004, Texas Heart Institute journal.

[19]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.