Ultrasound for Multimodal Data Interpretation of Liver Examinations

Traditional visualization of real-time 2D ultrasound data is difficult to interpret, even for experienced medical personnel. To make the interpretation during the education phase easier, we enhance the visualization during liver examinations with an abstracted depiction of relevant anatomical structures, here denoted as illustrated ultrasound. The specifics of enhancing structures are available through an interactively co-registered computed tomography, which has been enhanced by semantic information. To assist the orientation in the liver, we partition the liver into Couinaud segments. They are defined in a rapid segmentation process based on linked 2D slice views and 3D exploded views. The semantics are interactively related from the co-registered modality to the real-time ultrasound via co-registration. During the illustrated ultrasound examination training we provide visual enhancements that depict which liver segments are intersected by the ultrasound slice.

[1]  Dieter Hönigmann,et al.  Adaptive design of a global opacity transfer function for direct volume rendering of ultrasound data , 2003, IEEE Visualization, 2003. VIS 2003..

[2]  Stefan Bruckner,et al.  Exploded Views for Volume Data , 2006, IEEE Transactions on Visualization and Computer Graphics.

[3]  N. Ayache,et al.  Fully automatic anatomical, pathological, and functional segmentation from CT scans for hepatic surgery , 2001 .

[4]  Georgios Sakas,et al.  Preprocessing and volume rendering of 3D ultrasonic data , 1995, IEEE Computer Graphics and Applications.

[5]  Ivan Viola,et al.  Feature Emphasis and Contextual Cutaways for Multimodal Medical Visualization , 2007, EuroVis.

[6]  David S. Ebert,et al.  Volume Illustration: Nonphotorealistic Rendering of Volume Models , 2001, IEEE Trans. Vis. Comput. Graph..

[7]  Keith Paulsen,et al.  Coregistered intraoperative ultrasonography in resection of malignant glioma. , 2003, Neurosurgical focus.

[8]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[9]  J. Nosher,et al.  Non-rigid Registration of the Liver in Consecutive CT Studies for Assessment of Tumor Response to Radiofrequency Ablation , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  Johan Montagnat,et al.  Fully Automatic Anatomical, Pathological, and Functional Segmentation from CT Scans for Hepatic Surgery , 2000, Medical Imaging: Image Processing.

[11]  Weidong Cai,et al.  Dual-Modality PET-CT Visualization using Real-Time Volume Rendering and Image Fusion with Interactive 3D Segmentation of Anatomical Structures , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[12]  Elena Casiraghi,et al.  Liver Segmentation from CT Scans: A Survey , 2007, WILF.

[13]  Yohan Payan,et al.  Intensity-based registration of freehand 3D ultrasound and CT-scan images of the kidney , 2007, International Journal of Computer Assisted Radiology and Surgery.

[14]  Stefan Bruckner,et al.  TECHNICAL REPORT VolumeShop: An Interactive System for Direct Volume , 2022 .

[15]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Heinz-Otto Peitgen,et al.  Efficient Semiautomatic Segmentation of 3D Objects in Medical Images , 2000, MICCAI.

[17]  Keith D. Paulsen,et al.  Graphical user interface for intraoperative neuroimage updating , 2003, SPIE Medical Imaging.

[18]  Odd Helge Gilja,et al.  Basic And New Aspects Of Gastrointestinal Ultrasonography , 2005 .

[19]  M. Ziskin,et al.  International recommendations and guidelines for the safe use of diagnostic ultrasound in medicine. , 2000, Ultrasound in medicine & biology.

[20]  Bernhard Preim,et al.  Combining Training and Computer-Assisted Planning of Oncologic Liver Surgery , 2006, Bildverarbeitung für die Medizin.

[21]  Markus Hadwiger,et al.  Real time computation and temporal coherence of opacity transfer functions for direct volume rendering of ultrasound data. , 2005, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.