Real time exploration and management of large medical volumetric datasets on small mobile devices - Evaluation of remote volume rendering approach

Abstract In this paper I present the architecture of system that can be used for real time exploration and management of large medical volumetric datasets. The new state of the art solution presented in this paper is an example of visual data management system. System prototype evaluation proved that it is possible to use low-powered (and cheap) up-to-date mobile devices with programmable GPUs as the remote interfaces for exploration of large volumetric medical data. The implementation was done with high-level programming language that enables portability between different hardware models. The lack of lossy compression enables to display high quality medical images visualizations without any simplifications and noises in frequency domain. The prototype of system is capable to remotely render and send to a client (for example cell phone or tablet) rendered data with frequency 30 fps with limited resolution during interaction. One second after the interaction is finished client machine receives full resolution image. The evaluation of the system was performed on volumetric computed tomography angiography image with approximate size 512 3  voxels.

[1]  Marek R. Ogiela,et al.  Visualization of perfusion abnormalities with GPU-based volume rendering , 2012, Comput. Graph..

[2]  Yuichi Ohta,et al.  Live 3D Video in Soccer Stadium , 2003, SIGGRAPH '03.

[3]  Chase Qishi Wu,et al.  Pipelining parallel image compositing and delivery for efficient remote visualization , 2009, J. Parallel Distributed Comput..

[4]  Marek R. Ogiela,et al.  Framework for cognitive analysis of dynamic perfusion computed tomography with visualization of large volumetric data , 2012, J. Electronic Imaging.

[5]  H K Huang.  From PACS to Web-based ePR system with image distribution for enterprise-level filmless healthcare delivery , 2011, Radiological physics and technology.

[6]  Lidia Ogiela,et al.  Cognitive Systems for Medical Pattern Understanding and Diagnosis , 2008, KES.

[7]  Elliot K. Fishman,et al.  The iPad as a mobile device for CT display and interpretation: diagnostic accuracy for identification of pulmonary embolism , 2012, Emergency Radiology.

[8]  Jie Yang,et al.  Elliptical splats based isosurface visualization for volume data , 2008 .

[9]  Ruzena Bajcsy,et al.  3D teleimmersion for collaboration and interaction of geographically distributed users , 2012, Virtual Reality.

[10]  Zhifeng Guo,et al.  Web-based visualization of spatial objects in 3DGIS , 2009, Science in China Series F: Information Sciences.

[11]  Suhong Liu,et al.  Effective solutions to a global 3D visual system in networking environments , 2005 .

[12]  Juan M. Orduña,et al.  How mobile phones perform in collaborative augmented reality (CAR) applications , 2013, The Journal of Supercomputing.

[13]  Ulrich Lang,et al.  The parallelized perspective shear-warp algorithm for volume rendering , 2003, Parallel Comput..

[14]  T. Todd Elvins,et al.  Volume visualization in a collaborative computing environment , 1996, Comput. Graph..

[15]  Guanbo Bao,et al.  Large-scale forest rendering: Real-time, realistic, and progressive , 2012, Comput. Graph..

[16]  Bui Tuong Phong.  Illumination for computer generated pictures , 1975, Commun. ACM.

[17]  Sunil Kripalani,et al.  Use of handheld computers in medical education , 2006, Journal of General Internal Medicine.

[18]  Voicu Popescu,et al.  Compact real-time modeling of seated humans by video sprite sequence quantization , 2009, The Visual Computer.

[19]  Elmar Kotter,et al.  Technologies for image distribution in hospitals , 2006, European Radiology.

[20]  Henri E. Bal,et al.  Griz: experience with remote visualization over an optical grid , 2003, Future Gener. Comput. Syst..

[21]  Takeshi Oishi,et al.  Image-Based Network Rendering of Large Meshes for Cloud Computing , 2010, International Journal of Computer Vision.

[22]  Wolfgang Straßer,et al.  Advanced techniques for high-quality multi-resolution volume rendering , 2004, Comput. Graph..

[23]  Luigi Ciminiera,et al.  An Adaptive Control System for Interactive Virtual Environment Content Delivery to Handheld Devices , 2009, UCMedia.

[24]  Insung Ihm,et al.  Mobile collaborative medical display system , 2008, Comput. Methods Programs Biomed..

[25]  Roger J. Hubbold,et al.  Distributed Parallel Volume Rendering on Shared Memory Systems , 1997, HPCN Europe.

[26]  Mehmet Top.  Physicians’ Views and Assessments on Picture Archiving and Communication Systems (PACS) in Two Turkish Public Hospitals , 2012, Journal of Medical Systems.

[27]  Marek R. Ogiela,et al.  DNA-like linguistic secret sharing for strategic information systems , 2012, Int. J. Inf. Manag..

[28]  Azzedine Boukerche,et al.  An end-to-end virtual environment streaming technique for thin mobile devices over heterogeneous networks , 2008, Comput. Commun..

[29]  Gauthier Lafruit,et al.  Erratum to: A model for adapting 3D graphics based on scalable coding, real-time simplification and remote rendering , 2008, The Visual Computer.

[30]  Ravishankar Chityala,et al.  Segmentation and Visualization of a Large, High-Resolution Micro-CT Data of Mice , 2013, Journal of Digital Imaging.

[31]  Arie E. Kaufman,et al.  Interactive wireless virtual colonoscopy , 2007, The Visual Computer.

[32]  Qinping Zhao,et al.  A point-based rendering approach for real-time interaction on mobile devices , 2009, Science in China Series F: Information Sciences.

[33]  Nelson L. Max,et al.  Optical Models for Direct Volume Rendering , 1995, IEEE Trans. Vis. Comput. Graph..