Collaborative view-aligned annotations in web-based 3D medical data visualization

the paper presents our web-based 3D medical data visualization framework with emphasis on user collaboration. The framework supports visualization of volumetric data and 3D meshes in web browsers. The paper focuses on integration of user-shareable 3D view-aligned hand drawn or written annotations into the visualization framework. Annotations are created on separate transparent canvases which are aligned with selected views. View parameters are part of annotations and can be shared with other users over the network. Our implementation allows for real-time sharing of annotations during creation. Annotations from the same or different users can be overlaid within the same view. Annotations were implemented through adaptation of the framework's rendering pipeline, which allows for combining multiple visualization layers into a unified final render. View aligned annotations were added in addition to text annotations pinned to 3D locations on the displayed model. In the framework, users can list through all annotations, whereby upon selection of a 3D view-aligned annotation the camera is positioned according to the stored parameters and the annotation is displayed.

[1]  K F King,et al.  Computed tomography scanning with simultaneous patient translation. , 1990, Medical physics.

[2]  W. Kalender,et al.  Spiral volumetric CT with single-breath-hold technique, continuous transport, and continuous scanner rotation. , 1990, Radiology.

[3]  J. M. Ollinger,et al.  Positron Emission Tomography , 2018, Handbook of Small Animal Imaging.

[4]  Isabelle Bloch,et al.  A review of 3D vessel lumen segmentation techniques: Models, features and extraction schemes , 2009, Medical Image Anal..

[5]  Pat Hanrahan,et al.  Volume Rendering , 2020, Definitions.

[6]  Ciril Bohak,et al.  Remote Interaction in Web-Based Medical Visual Application , 2016 .

[7]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[8]  Peter A. Rinck,et al.  Magnetic Resonance in Medicine , 1993 .

[9]  Saeed Sadri,et al.  A Review of Coronary Vessel Segmentation Algorithms , 2011, Journal of medical signals and sensors.

[10]  Marc Levoy,et al.  Display of surfaces from volume data , 1988, IEEE Computer Graphics and Applications.

[11]  Yves D. Willems,et al.  Bi-directional path tracing , 1993 .

[12]  D. Rimoin,et al.  Use of three‐dimensional ultrasound imaging in the diagnosis of prenatal‐onset skeletal dysplasias , 2003, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[13]  W. Jack Bouknight,et al.  A procedure for generation of three-dimensional half-toned computer graphics presentations , 1970, CACM.