SP-MIOV: A novel framework of shadow proxy based medical image online visualization in computing and storage resource restrained environments

Abstract The rapid development of Internet and various mobile communication media initiate the demands for access to medical image visualization systems. Medical image reading and interpretation at any time, any place and any device become an urgent need for radiologists. The current medical image online visualization methods have disadvantages in computing and storage resource restrained environments. This study presents a novel framework of medical image online visualization based on shadow proxy, which makes applications have across platform ability and universal environmental adaptability especial for devices with restricted running resources. The framework can be adapted in multiple client architectures including the pure web applications, mobile applications or regular desktop applications. It is easy to be integrated into third party software and there are no restrictions of the communication protocols between the client and server side due to two innovations of the framework that are shadow proxy mechanism and shadow data. The shadow proxy just does lightweight tasks on shadow data and the ultimate processing of computing tasks are moved to the server side to complete. The size of shadow data is small enough for shadow proxy that speeds up local display and processing tasks. Finally, the framework takes advantage of high performance on server side to render high quality image results. The performance of proposed work is evaluated in a web based medical image visualization system, and the results show that the framework in this paper allows the system to have smooth and quasi-real-time interaction performance. Therefore, this study ensures the local client operations fluency and fast while the quality of the visualization is still not lost that gives the best user experience.

[1]  Tiago Marques Godinho,et al.  An efficient architecture to support digital pathology in standard medical imaging repositories , 2017, J. Biomed. Informatics.

[2]  Peng Gao,et al.  Medical high-resolution image sharing and electronic whiteboard system: A pure-web-based system for accessing and discussing lossless original images in telemedicine , 2015, Comput. Methods Programs Biomed..

[3]  Jianguo Zhang,et al.  Design and evaluation of web-based image transmission and display with different protocols , 2011, Medical Imaging.

[4]  Dror Ofir,et al.  Reliability of smartphone-based teleradiology for evaluating thoracolumbar spine fractures. , 2017, The spine journal : official journal of the North American Spine Society.

[5]  K C Young,et al.  MEDXVIEWER: PROVIDING A WEB-ENABLED WORKSTATION ENVIRONMENT FOR COLLABORATIVE AND REMOTE MEDICAL IMAGING VIEWING, PERCEPTION STUDIES AND READER TRAINING. , 2016, Radiation protection dosimetry.

[6]  Wei Chen,et al.  An HTML5-Based Pure Website Solution for Rapidly Viewing and Processing Large-Scale 3D Medical Volume Reconstruction on Mobile Internet , 2017, International journal of telemedicine and applications.

[7]  Bernhard Preim,et al.  The LiverAnatomyExplorer: A WebGL-Based Surgical Teaching Tool , 2013, IEEE Computer Graphics and Applications.

[8]  Eleni Kaldoudi,et al.  A service based approach for medical image distribution in healthcare Intranets , 2006, Comput. Methods Programs Biomed..

[9]  Örjan Smedby,et al.  Web‐based interactive 3D visualization as a tool for improved anatomy learning , 2009, Anatomical sciences education.

[10]  Kwan-Liu Ma,et al.  Visualization by Proxy: A Novel Framework for Deferred Interaction with Volume Data , 2010, IEEE Transactions on Visualization and Computer Graphics.

[11]  P J Slomka,et al.  Java-based remote viewing and processing of nuclear medicine images: toward "the imaging department without walls". , 2000, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[12]  José Luís Oliveira,et al.  Design, development, exploitation and assessment of a Cardiology Web PACS , 2009, Comput. Methods Programs Biomed..

[13]  Aitor Moreno,et al.  X3DOM volume rendering component for web content developers , 2017, Multimedia Tools and Applications.

[14]  Andrea Giachetti,et al.  Building a virtual archive using brain architecture and Web 3D to deliver neuropsychopharmacology content over the Internet , 2008, Comput. Methods Programs Biomed..

[15]  Lei Huang,et al.  MIAPS: A web-based system for remotely accessing and presenting medical images , 2014, Comput. Methods Programs Biomed..

[16]  Daniel Forsberg,et al.  Analyzing PACS Usage Patterns by Means of Process Mining: Steps Toward a More Detailed Workflow Analysis in Radiology , 2015, Journal of Digital Imaging.

[17]  Shih-Tsang Tang,et al.  Use of a Rich Internet Application Solution to Present Medical Images , 2011, Journal of Digital Imaging.

[18]  Mathias Kaspar,et al.  An optimized web-based approach for collaborative stereoscopic medical visualization , 2013, J. Am. Medical Informatics Assoc..

[19]  Charles E. Kahn,et al.  DICOMweb™: Background and Application of the Web Standard for Medical Imaging , 2018, Journal of Digital Imaging.

[20]  Ioana-Raluca Adochiei,et al.  A Real-Time WebGL Rendering Piepeline for MRI Using RayCasting Tranfer Functions , 2019 .

[21]  J. Navas,et al.  A Web platform for the interactive visualization and analysis of the 3D fractal dimension of MRI data , 2014, J. Biomed. Informatics.

[22]  Peter Bajcsy,et al.  3D medical volume reconstruction using Web services , 2005, IEEE International Conference on Web Services (ICWS'05).

[23]  Makoto Miyake,et al.  XVL for medicine: the web-based medical 3D applications , 2001, CARS.

[24]  Peng Gao,et al.  [Research on Three-dimensional Medical Image Reconstruction and Interaction Based on HTML5 and Visualization Toolkit]. , 2015, Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi.

[25]  Qiusha Min,et al.  An Evaluation of HTML5 and WebGL for Medical Imaging Applications , 2018, Journal of healthcare engineering.

[26]  Rudolph Pienaar,et al.  Real-time Volume Rendering and Tractography Visualization on the Web , 2012, J. WSCG.

[27]  Aitor Moreno,et al.  Interactive visualization of volumetric data with WebGL in real-time , 2011, Web3D '11.

[28]  Sittapong Settapat,et al.  Web‐based 3D medical image visualization framework for biomedical engineering education , 2014, Comput. Appl. Eng. Educ..

[29]  Sittapong Settapat,et al.  Web-based 3D visualization and interaction of medical data using Web3D , 2010, Proceedings of SICE Annual Conference 2010.

[30]  Qi Zhang,et al.  Medical data visual synchronization and information interaction using Internet-based graphics rendering and message-oriented streaming , 2019, Informatics in Medicine Unlocked.

[31]  Piotr J. Slomka,et al.  Java-based PACS and reporting system for nuclear medicine , 2000, Medical Imaging.

[32]  Imma Boada,et al.  A new e-learning platform for radiology education (RadEd) , 2016, Comput. Methods Programs Biomed..

[33]  S. Mirzaei,et al.  Distributed nuclear medicine applications using World Wide Web and Java technology , 2000, European Radiology.

[34]  Hong Zeng,et al.  Internet (WWW) based system of ultrasonic image processing tools for remote image analysis , 2003, Comput. Methods Programs Biomed..

[35]  Vivek Joshi,et al.  PACS Administrators’ and Radiologists’ Perspective on the Importance of Features for PACS Selection , 2014, Journal of Digital Imaging.

[36]  Jens Borgbjerg.  MULRECON: A Web-based Imaging Viewer for Visualization of Volumetric Images. , 2018, Current problems in diagnostic radiology.

[37]  Qi Zhang,et al.  Web-based medical data visualization and information sharing towards application in distributed diagnosis , 2019, Informatics in Medicine Unlocked.

[38]  David E. Avrin,et al.  Using Applet–Servlet Communication for Optimizing Window, Level and Crop for DICOM to JPEG Conversion , 2007, Journal of Digital Imaging.

[39]  Don MacDonald,et al.  Evaluating the Implementation of Picture Archiving and Communication Systems in Newfoundland and Labrador—a Cost Benefit Analysis , 2010, Journal of Digital Imaging.

[40]  Nicolas Toussaint,et al.  Virtual interaction and visualisation of 3D medical imaging data with VTK and Unity , 2018, Healthcare technology letters.

[41]  Nigel W. John,et al.  The impact of Web3D technologies on medical education and training , 2007, Comput. Educ..

[42]  Jay Wu,et al.  Performance Enhancement of a Web-Based Picture Archiving and Communication System Using Commercial Off-the-Shelf Server Clusters , 2014, BioMed research international.

[43]  Mislav Grgic,et al.  JavaScript Access to DICOM Network and Objects in Web Browser , 2017, Journal of Digital Imaging.

[44]  Sébastien Ourselin,et al.  GIFT-Cloud: A data sharing and collaboration platform for medical imaging research , 2017, Comput. Methods Programs Biomed..

[45]  Heung-Kook Choi,et al.  Tele-medical imaging conference system based on the Web , 2002, Comput. Methods Programs Biomed..

[46]  Nelson Pacheco da Rocha,et al.  Outcomes from Indexing Initiatives of Medical Imaging DICOM Metadata Repositories. A Secondary Analysis , 2018 .

[47]  A. Bhatia,et al.  Intra and Inter-Observer Reliability of Mobile Tablet PACS Viewer System vs. Standard PACS Viewing Station-Diagnosis of Acute Central Nervous System Events , 2013 .

[48]  Hamid Soltanian-Zadeh,et al.  Web-based interactive 2D/3D medical image processing and visualization software , 2010, Comput. Methods Programs Biomed..