MITK-OpenIGTLink for combining open-source toolkits in real-time computer-assisted interventions

PurposeDue to rapid developments in the research areas of medical imaging, medical image processing and robotics, computer-assisted interventions (CAI) are becoming an integral part of modern patient care. From a software engineering point of view, these systems are highly complex and research can benefit greatly from reusing software components. This is supported by a number of open-source toolkits for medical imaging and CAI such as the medical imaging interaction toolkit (MITK), the public software library for ultrasound imaging research (PLUS) and 3D Slicer. An independent inter-toolkit communication such as the open image-guided therapy link (OpenIGTLink) can be used to combine the advantages of these toolkits and enable an easier realization of a clinical CAI workflow.MethodsMITK-OpenIGTLink is presented as a network interface within MITK that allows easy to use, asynchronous two-way messaging between MITK and clinical devices or other toolkits. Performance and interoperability tests with MITK-OpenIGTLink were carried out considering the whole CAI workflow from data acquisition over processing to visualization.ResultsWe present how MITK-OpenIGTLink can be applied in different usage scenarios. In performance tests, tracking data were transmitted with a frame rate of up to 1000 Hz and a latency of 2.81 ms. Transmission of images with typical ultrasound (US) and greyscale high-definition (HD) resolutions of $$640\times 480$$640×480 and $$1920\times 1080$$1920×1080 is possible at up to 512 and 128 Hz, respectively.ConclusionWith the integration of OpenIGTLink into MITK, this protocol is now supported by all established open-source toolkits in the field. This eases interoperability between MITK and toolkits such as PLUS or 3D Slicer and facilitates cross-toolkit research collaborations. MITK and its submodule MITK-OpenIGTLink are provided open source under a BSD-style licence (http://mitk.org).

[1]  Charles Marion,et al.  ITK: enabling reproducible research and open science , 2014, Front. Neuroinform..

[2]  Nobuhiko Hata,et al.  Interfacing proprietary hardware with the image-guided surgery toolkit (IGSTK): a case for the OpenIGTLink protocol , 2009, Medical Imaging.

[3]  Andras Lasso,et al.  PLUS: Open-Source Toolkit for Ultrasound-Guided Intervention Systems , 2014, IEEE Transactions on Biomedical Engineering.

[4]  Darrel C. Ince,et al.  The case for open computer programs , 2012, Nature.

[5]  Marco Nolden,et al.  The Medical Imaging Interaction Toolkit , 2004, Medical Image Anal..

[6]  Nobuhiko Hata,et al.  Open core control software for surgical robots , 2009, International Journal of Computer Assisted Radiology and Surgery.

[7]  Nobuhiko Hata,et al.  Piezoelectrically Actuated Robotic System for MRI-Guided Prostate Percutaneous Therapy , 2015, IEEE/ASME Transactions on Mechatronics.

[8]  Sascha Zelzer,et al.  Simplified development of image-guided therapy software with MITK-IGT , 2012, Medical Imaging.

[9]  Jun Yoshida,et al.  Neurosurgical robotic system for brain tumor removal , 2010, International Journal of Computer Assisted Radiology and Surgery.

[10]  Keno März,et al.  Interventional real-time ultrasound imaging with an integrated electromagnetic field generator , 2014, International Journal of Computer Assisted Radiology and Surgery.

[11]  K. Cleary,et al.  Image-guided interventions: technology review and clinical applications. , 2010, Annual review of biomedical engineering.

[12]  Keno März,et al.  MITK-US: real-time ultrasound support within MITK , 2013, International Journal of Computer Assisted Radiology and Surgery.

[13]  Ron Kikinis,et al.  3D Slicer , 2012, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[14]  Fumio Harashima,et al.  Mechatronics - "What Is It, Why, and How?" An editorial , 1996, IEEE/ASME Transactions on Mechatronics.

[15]  Klaus H. Maier-Hein,et al.  The Medical Imaging Interaction Toolkit: challenges and advances , 2013, International Journal of Computer Assisted Radiology and Surgery.

[16]  Gabor Fichtinger,et al.  OpenIGTLink: an open network protocol for image‐guided therapy environment , 2009, The international journal of medical robotics + computer assisted surgery : MRCAS.

[17]  Lena Maier-Hein,et al.  Mobile augmented reality for computer-assisted percutaneous nephrolithotomy , 2013, International Journal of Computer Assisted Radiology and Surgery.

[18]  Arianeb Mehrabi,et al.  Towards markerless navigation for percutaneous needle insertions , 2015, International Journal of Computer Assisted Radiology and Surgery.

[19]  Russell H. Taylor,et al.  A framework for calibration of electromagnetic surgical navigation system , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[20]  Lena Maier-Hein,et al.  In vivo accuracy assessment of a needle-based navigation system for CT-guided radiofrequency ablation of the liver. , 2008, Medical physics.

[21]  Robert J. Teather,et al.  Effects of tracking technology, latency, and spatial jitter on object movement , 2009, 2009 IEEE Symposium on 3D User Interfaces.

[22]  Milan Sonka,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[23]  Lena Maier-Hein,et al.  Mobile markerless augmented reality and its application in forensic medicine , 2015, International Journal of Computer Assisted Radiology and Surgery.

[24]  Sébastien Ourselin,et al.  The NifTK software platform for image-guided interventions: platform overview and NiftyLink messaging , 2014, International Journal of Computer Assisted Radiology and Surgery.

[25]  Luis Ibáñez,et al.  The ITK Software Guide , 2005 .

[26]  Jumpei Arata,et al.  Surgical bedside master console for neurosurgical robotic system , 2012, International Journal of Computer Assisted Radiology and Surgery.

[27]  Marco Nolden,et al.  MITK-ToF—Range data within MITK , 2011, International Journal of Computer Assisted Radiology and Surgery.

[28]  Marco Nolden,et al.  MITK-IGT: Eine Navigationskomponente für das Medical Imaging Interaction Toolkit , 2009, Bildverarbeitung für die Medizin.

[29]  Christopher Nimsky,et al.  Integration of the OpenIGTLink Network Protocol for image‐guided therapy with the medical platform MeVisLab , 2012, The international journal of medical robotics + computer assisted surgery : MRCAS.

[30]  M. Branicky,et al.  Design Considerations for Software Only Implementations of the IEEE 1588 Precision Time Protocol , 2005 .