Registration made easy - standalone orthopedic navigation with HoloLens

In surgical navigation, finding correspondence between preoperative plan and intraoperative anatomy, the so-called registration task, is imperative. One promising approach is to intraoperatively digitize anatomy and register it with the preoperative plan. State-of-the-art commercial navigation systems implement such approaches for pedicle screw placement in spinal fusion surgery. Although these systems improve surgical accuracy, they are not gold standard in clinical practice. Besides economical reasons, this may be due to their difficult integration into clinical workflows and unintuitive navigation feedback. Augmented Reality has the potential to overcome these limitations. Consequently, we propose a surgical navigation approach comprising intraoperative surface digitization for registration and intuitive holographic navigation for pedicle screw placement that runs entirely on the Microsoft HoloLens. Preliminary results from phantom experiments suggest that the method may meet clinical accuracy requirements.

[1]  Tsung-Ting Tsai,et al.  Computed tomography-based navigation-assisted pedicle screw insertion for thoracic and lumbar spine fractures. , 2012, Chang Gung medical journal.

[2]  Nassir Navab,et al.  Technical Note: Towards Virtual Monitors for Image Guided Interventions - Real-time Streaming to Optical See-Through Head-Mounted Displays , 2017, ArXiv.

[3]  Florentin Liebmann,et al.  Augmented reality-assisted rod bending in spinal surgery. , 2019, The spine journal : official journal of the North American Spine Society.

[4]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[5]  D. Louis Collins,et al.  Ultrasound-CT registration of vertebrae without reconstruction , 2012, International Journal of Computer Assisted Radiology and Surgery.

[6]  Adam Rankin,et al.  Hologram stability evaluation for Microsoft HoloLens , 2017, Medical Imaging.

[7]  Simon Weidert,et al.  On-the-fly augmented reality for orthopedic surgery using a multimodal fiducial , 2018, Journal of medical imaging.

[8]  Francisco José Madrid-Cuevas,et al.  Generation of fiducial marker dictionaries using Mixed Integer Linear Programming , 2016, Pattern Recognit..

[9]  René Schmidt,et al.  Cervical Pedicle Screws: Conventional Versus Computer-Assisted Placement of Cannulated Screws , 2005, Spine.

[10]  Francisco José Madrid-Cuevas,et al.  Automatic generation and detection of highly reliable fiducial markers under occlusion , 2014, Pattern Recognit..

[11]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[12]  Kern Singh,et al.  Radiation exposure and reduction in the operating room: Perspectives and future directions in spine surgery , 2017, World journal of orthopedics.

[13]  Bostjan Likar,et al.  A review of 3D/2D registration methods for image-guided interventions , 2012, Medical Image Anal..

[14]  Peter Kazanzides,et al.  Comparison of optical see-through head-mounted displays for surgical interventions with object-anchored 2D-display , 2017, International Journal of Computer Assisted Radiology and Surgery.

[15]  Lejing Wang,et al.  First Deployments of Augmented Reality in Operating Rooms , 2012, Computer.

[16]  Jan Victor,et al.  Image-Based Computer-Assisted Total Knee Arthroplasty Leads to Lower Variability in Coronal Alignment , 2004, Clinical orthopaedics and related research.

[17]  Edwin Olson,et al.  AprilTag: A robust and flexible visual fiducial system , 2011, 2011 IEEE International Conference on Robotics and Automation.

[18]  E. Catmull,et al.  A CLASS OF LOCAL INTERPOLATING SPLINES , 1974 .

[19]  Karl Pearson F.R.S..  LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[20]  N. Navab,et al.  Advanced Medical Displays: A Literature Review of Augmented Reality , 2008, Journal of Display Technology.

[21]  A Uneri,et al.  3D–2D image registration for target localization in spine surgery: investigation of similarity metrics providing robustness to content mismatch , 2016, Physics in medicine and biology.

[22]  Cem Yuksel,et al.  On the parameterization of Catmull-Rom curves , 2009, Symposium on Solid and Physical Modeling.

[23]  Eric W Nottmeier,et al.  Timing of Paired Points and Surface Matching Registration in Three-Dimensional (3D) Image-guided Spinal Surgery , 2007, Journal of spinal disorders & techniques.

[24]  Edwin Olson,et al.  AprilTag 2: Efficient and robust fiducial detection , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[25]  Rafael Muñoz-Salinas,et al.  Speeded up detection of squared fiducial markers , 2018, Image Vis. Comput..

[26]  Rui Liao,et al.  Dilated FCN for Multi-Agent 2D/3D Medical Image Registration , 2017, AAAI.

[27]  Paul J. Besl,et al.  Method for registration of 3-D shapes , 1992, Other Conferences.

[28]  Davide Scaramuzza,et al.  Pedicle screw navigation using surface digitization on the Microsoft HoloLens , 2019, International Journal of Computer Assisted Radiology and Surgery.

[29]  Jürgen G. Harms,et al.  Die posteriore, lumbale, interkorporelle Fusion in unilateraler transforaminaler Technik , 1998, Operative Orthopädie und Traumatologie.