Real-time image fusion involving diagnostic ultrasound.

OBJECTIVE The aim of our article is to give an overview of the current and future possibilities of real-time image fusion involving ultrasound. We present a review of the existing English-language peer-reviewed literature assessing this technique, which covers technical solutions (for ultrasound and endoscopic ultrasound), image fusion in several anatomic regions, and electromagnetic needle tracking. CONCLUSION The recent progress of real-time ultrasound in image fusion may provide several new possibilities, including diagnosis, treatment, and follow-up of oncologic patients.

[1]  T. Fukutomi,et al.  Reproducible surveillance breast ultrasound using an image fusion technique in a short-interval follow-up for BI-RADS 3 lesions: a pilot study. , 2014, Ultrasound in medicine & biology.

[2]  Ping Liang,et al.  Microwave ablation assisted by a real-time virtual navigation system for hepatocellular carcinoma undetectable by conventional ultrasonography. , 2012, European journal of radiology.

[3]  J. Krücker,et al.  Electromagnetic tracking for thermal ablation and biopsy guidance: clinical evaluation of spatial accuracy. , 2007, Journal of vascular and interventional radiology : JVIR.

[4]  G K Svensson,et al.  Ultrasound image fusion for external beam radiotherapy for prostate cancer. , 1996, International journal of radiation oncology, biology, physics.

[5]  Caroline Ewertsen,et al.  Stanzbiopsie eines kleinen retroperitonealen Lymphoms gestützt durch Bildfusion und elektromagnetischem Nadel-Tracking , 2012 .

[6]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[7]  Mark Fiala,et al.  Designing Highly Reliable Fiducial Markers , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Carlo Bartolozzi,et al.  Targeting Liver Lesions for Radiofrequency Ablation: An Experimental Feasibility Study Using a CT–US Fusion Imaging System , 2008, Investigative radiology.

[9]  S. Stoeckli,et al.  Positron emission tomography/computed tomography for staging and restaging of head and neck cancer: comparison with positron emission tomography read together with contrast-enhanced computed tomography. , 2008, Clinical imaging.

[10]  Real‐time virtual ultrasonographic radiofrequency ablation of renal cell carcinoma , 2008, BJU international.

[11]  Joseph V. Hajnal,et al.  Registration and Subtraction of Serial Magnetic Resonance Images of the Brain: Image Interpretation and Clinical Applications , 2001 .

[12]  Kazuko Ohno,et al.  Fusion of MRI and sonography image for breast cancer evaluation using real-time virtual sonography with magnetic navigation: first experience. , 2009, Japanese journal of clinical oncology.

[13]  Pingkun Yan,et al.  Magnetic resonance imaging/ultrasound fusion guided prostate biopsy improves cancer detection following transrectal ultrasound biopsy and correlates with multiparametric magnetic resonance imaging. , 2011, The Journal of urology.

[14]  E. M. Pedersen,et al.  The suprasacral parallel shift vs lumbar plexus blockade with ultrasound guidance in healthy volunteers – a randomised controlled trial , 2014, Anaesthesia.

[15]  M. Figl,et al.  2D/3D registration of endoscopic ultrasound to CT volume data , 2008, Physics in medicine and biology.

[16]  Dorothea Miller,et al.  A Novel Platform for Image-guided Ultrasound , 2006, Neurosurgery.

[17]  P. Kasprzak,et al.  Hochauflösende 3-D-Sonographie und Bildfusion mit der CT-Angiographie , 2014, Gefässchirurgie.

[18]  C. Ewertsen,et al.  Comparison of two co-registration methods for real-time ultrasonography fused with MRI: a phantom study. , 2010, Ultraschall in der Medizin.

[19]  M. Oka,et al.  Sentinel lymph node detection in breast cancer patients by real-time virtual sonography constructed with three-dimensional computed tomography-lymphography. , 2009 .

[20]  A. Iagnocco,et al.  Magnetic resonance and ultrasonography real-time fusion imaging of the hand and wrist in osteoarthritis and rheumatoid arthritis. , 2011, Rheumatology.

[21]  Raúl San José Estépar,et al.  EUS with CT improves efficiency and structure identification over conventional EUS. , 2007, Gastrointestinal endoscopy.

[22]  M. Nielsen,et al.  Ultrasonography of the Kidney: A Pictorial Review , 2015, Diagnostics.

[23]  Atsushi Hiraoka,et al.  Virtual sonographic radiofrequency ablation of hepatocellular carcinoma visualized on CT but not on conventional sonography. , 2006, AJR. American journal of roentgenology.

[24]  R. Piccazzo,et al.  Advantages of percutaneous abdominal biopsy under PET-CT/ultrasound fusion imaging guidance: a pictorial essay , 2014, Abdominal Imaging.

[25]  Christian Stroszczynski,et al.  Image fusion of contrast enhanced ultrasound (CEUS) with computed tomography (CT) or magnetic resonance imaging (MRI) using volume navigation for detection, characterization and planning of therapeutic interventions of liver tumors. , 2011, Clinical hemorheology and microcirculation.

[26]  Takamichi Murakami,et al.  Effectiveness of real‐time virtual sonography‐guided radiofrequency ablation treatment for patients with hepatocellular carcinomas , 2008, Hepatology research : the official journal of the Japan Society of Hepatology.

[27]  Samuel Kadoury,et al.  Real-time FDG PET guidance during biopsies and radiofrequency ablation using multimodality fusion with electromagnetic navigation. , 2011, Radiology.

[28]  Michael Kranzfelder,et al.  CT-navigated real-time ultrasonography: evaluation of registration accuracy for clinical application / CT-navigierter Ultraschall: Evaluation der Registrierungsgenauigkeit für den klinischen Einsatz , 2008, Biomedizinische Technik. Biomedical engineering.

[29]  Anne Auperin,et al.  Clinical Evaluation of Spatial Accuracy of a Fusion Imaging Technique Combining Previously Acquired Computed Tomography and Real-Time Ultrasound for Imaging of Liver Metastases , 2011, CardioVascular and Interventional Radiology.

[30]  Nassir Navab,et al.  Automatic CT-ultrasound registration for diagnostic imaging and image-guided intervention , 2008, Medical Image Anal..

[31]  Masatoshi Kudo,et al.  Radiofrequency ablation of hepatocellular carcinoma: value of virtual CT sonography with magnetic navigation. , 2008, AJR. American journal of roentgenology.

[32]  C. Ewertsen,et al.  Characterization by biopsy or CEUS of liver lesions guided by image fusion between ultrasonography and CT, PET/CT or MRI. , 2011, Ultraschall in der Medizin.

[33]  Peter Guion,et al.  Initial clinical experience with real‐time transrectal ultrasonography‐magnetic resonance imaging fusion‐guided prostate biopsy , 2008, BJU international.

[34]  T. Fukutomi,et al.  Targeted sonography using an image fusion technique for evaluation of incidentally detected breast lesions on chest CT: a pilot study , 2016, Breast Cancer.

[35]  Scott T. Grafton,et al.  Automated image registration: I. General methods and intrasubject, intramodality validation. , 1998, Journal of computer assisted tomography.

[36]  M. Nielsen,et al.  Freehand Biopsy Guided by Electromagnetic Needle Tracking: A Phantom Study , 2011, Ultraschall in der Medizin.

[37]  Neil A. Thacker,et al.  3D Image Fusion , 2008 .

[38]  Ren-Shyan Liu,et al.  An imaging co-registration system using novel non-invasive and non-radioactive external markers , 2003, European Journal of Nuclear Medicine and Molecular Imaging.

[39]  Raúl San José Estépar,et al.  The role of a computed tomography-based image registered navigation system for natural orifice transluminal endoscopic surgery: a comparative study in a porcine model , 2010, Endoscopy.

[40]  E M Jung,et al.  New real-time image fusion technique for characterization of tumor vascularisation and tumor perfusion of liver tumors with contrast-enhanced ultrasound, spiral CT or MRI: first results. , 2009, Clinical hemorheology and microcirculation.

[41]  T. Miki,et al.  Technique for a hybrid system of real‐time transrectal ultrasound with preoperative magnetic resonance imaging in the guidance of targeted prostate biopsy , 2010, International journal of urology : official journal of the Japanese Urological Association.

[42]  Carl-Fredrik Westin,et al.  Towards real time 2D to 3D registration for ultrasound-guided endoscopic and laparoscopic procedures , 2009, International Journal of Computer Assisted Radiology and Surgery.

[43]  Selective activation of pig forearm muscles using thin-film intrafascicular electrodes implanted in the median nerve , 2008 .

[44]  P. Choyke,et al.  Real-time MRI-TRUS fusion for guidance of targeted prostate biopsies , 2008, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[45]  N. Pelc,et al.  Co‐registration of x‐ray and MR fields of view in a hybrid XMR system , 2005, Journal of magnetic resonance imaging : JMRI.

[46]  Kazuma Fujimoto,et al.  Radiofrequency Ablation with the Real-Time Virtual Sonography System for Treating Hepatocellular Carcinoma Difficult to Detect by Ultrasonography , 2006, Journal of clinical biochemistry and nutrition.

[47]  Masaru Ueki,et al.  Assessment of the ablated area after radiofrequency ablation by contrast-enhanced sonography; comparison with virtual sonography with magnetic navigation. , 2010, Clinical imaging.

[48]  Sheng Xu,et al.  Clinical utility of real-time fusion guidance for biopsy and ablation. , 2011, Journal of vascular and interventional radiology : JVIR.

[49]  Masatoshi Kudo,et al.  Treatment response assessment of radiofrequency ablation for hepatocellular carcinoma: usefulness of virtual CT sonography with magnetic navigation. , 2012, European journal of radiology.

[50]  Sheng Xu,et al.  Closed-Loop Control in Fused MR-TRUS Image-Guided Prostate Biopsy , 2007, MICCAI.

[51]  Hepatic Computed Tomography for Simultaneous Depiction of Hepatocellular Carcinoma, Intrahepatic Portal Veins, and Hepatic Veins in Real‐time Virtual Sonography , 2007, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[52]  M. Nielsen,et al.  Biopsy guided by real-time sonography fused with MRI: a phantom study. , 2008, AJR. American journal of roentgenology.

[53]  Fernando J. Kim,et al.  Is apparent diffusion coefficient associated with clinical risk scores for prostate cancers that are visible on 3-T MR images? , 2011 .

[54]  Kinuyo Hatanaka,et al.  Percutaneous radiofrequency ablation of sonographically unidentifiable liver tumors. Feasibility and usefulness of a novel guiding technique with an integrated system of computed tomography and sonographic images. , 2007, Oncology.

[55]  Martin Keuchel,et al.  Real-Time Ultrasonography-Computed Tomography Fusion Imaging for Staging of Hepatic Metastatic Involvement in Patients With Colorectal Cancer: Initial Results From Comparison to US Seeing Separate CT Images and to Multidetector-Row CT Alone , 2010, Investigative radiology.

[56]  R. Felix,et al.  Value of image fusion using single photon emission computed tomography with integrated low dose computed tomography in comparison with a retrospective voxel-based method in neuroendocrine tumours , 2005, European Radiology.

[57]  Raúl San José Estépar,et al.  Image Registered Gastroscopic Ultrasound (IRGUS) in human subjects: a pilot study to assess feasibility. , 2011, Endoscopy.

[58]  M. Oka,et al.  Prospective ultrasonographic prediction of sentinel lymph node metastasis by real-time virtual sonography constructed with three-dimensional computed tomography–lymphography in breast cancer patients , 2011, Breast Cancer.

[59]  Morio Sato,et al.  Radiofrequency Ablation Assisted by Real-Time Virtual Sonography and CT for Hepatocellular Carcinoma Undetectable by Conventional Sonography , 2008, CardioVascular and Interventional Radiology.

[60]  Nassir Navab,et al.  Simulation and Fully Automatic Multimodal Registration of Medical Ultrasound , 2007, MICCAI.

[61]  I. Kaplan,et al.  Real time MRI-ultrasound image guided stereotactic prostate biopsy. , 2002, Magnetic resonance imaging.

[62]  Tsuyoshi Mitake,et al.  Real‐time Virtual Sonography for navigation during targeted prostate biopsy using magnetic resonance imaging data , 2010, International journal of urology : official journal of the Japanese Urological Association.

[63]  G. Feuchtner,et al.  Fusion of real-time US with CT images to guide sacroiliac joint injection in vitro and in vivo. , 2010, Radiology.

[64]  Anne Auperin,et al.  Electromagnetic-Tracked Biopsy under Ultrasound Guidance: Preliminary Results , 2012, CardioVascular and Interventional Radiology.

[65]  Nassir Navab,et al.  Real-Time Fusion of Ultrasound and Gamma Probe for Navigated Localization of Liver Metastases , 2007, MICCAI.

[66]  C. McLaren.  Paediatric interventional radiology , 2014 .

[67]  A. Saftoiu,et al.  Mo1511 Feasibility Study of Tridimensional Co-Registration of Endoscopic Ultrasound and Dynamic Spiral Computer Tomography Procedures for Real-Time Evaluation of Tumor Angiogenesis , 2011 .

[68]  E. Jung,et al.  Image fusion with volume navigation of contrast enhanced ultrasound (CEUS) with computed tomography (CT) or magnetic resonance imaging (MRI) for post-interventional follow-up after transcatheter arterial chemoembolization (TACE) of hepatocellular carcinomas (HCC): Preliminary results. , 2010, Clinical hemorheology and microcirculation.