MEDX3DOM: MEDX3D for X3DOM

We present an implementation of MEDX3DOM a MEDX3D standard implemented into the X3DOM framework. We present the report of a work in progress of the implementation identifying the critical sections to be migrated into the new architecture, and possible extensions of the standard on the Web environment. Results for the early implementation are shown, where the visualization of medical datasets with advanced direct volume rendering algorithms are obtained under the X3DOM architecture with interactive frame rates and good image quality. An example of the HTML5/X3DOM document is presented with future.

[1]  Sittapong Settapat,et al.  Web-based 3D visualization and interaction of medical data using Web3D , 2010, Proceedings of SICE Annual Conference 2010.

[2]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[3]  Robert S. Laramee,et al.  The State of the Art in Flow Visualization: Dense and Texture‐Based Techniques , 2004, Comput. Graph. Forum.

[4]  Z. Mihajlovic,et al.  Visualization Service Based on Web Services , 2007 .

[5]  Roberto Scopigno,et al.  Visualization methods for molecular studies on the web platform , 2010, Web3D '10.

[6]  Lan Zhao,et al.  Real-time Data Delivery and Remote Visualization through Multi-layer Interfaces , 2008, 2008 Grid Computing Environments Workshop.

[7]  Afonso Paiva,et al.  Robust adaptive meshes for implicit surfaces , 2006, 2006 19th Brazilian Symposium on Computer Graphics and Image Processing.

[8]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[9]  Nigel W. John,et al.  The impact of Web3D technologies on medical education and training , 2007, Comput. Educ..

[10]  Ronald N. Perry,et al.  Adaptively sampled distance fields: a general representation of shape for computer graphics , 2000, SIGGRAPH.

[11]  David S. Ebert,et al.  Volume Composition Using Eye Tracking Data , 2006, EuroVis.

[12]  Thabo Beeler,et al.  High-quality single-shot capture of facial geometry , 2010, SIGGRAPH 2010.

[13]  Stefano Tubaro,et al.  3 D FACE RECONSTRUCTION WITH A FOUR CAMERA ACQUISITION SYSTEM , 2005 .

[14]  R. Moorhead,et al.  1th International Symposium on Flow Visualization , 2004 .

[15]  Qican Zhang,et al.  Local stereo matching with adaptive support-weight, rank transform and disparity calibration , 2008, Pattern Recognit. Lett..

[16]  Roni Yagel,et al.  Octree-based decimation of marching cubes surfaces , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[17]  Federico Tombari,et al.  Classification and evaluation of cost aggregation methods for stereo correspondence , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Carla Maria Dal Sasso Freitas,et al.  Optimizing Combined Volume and Surface Data Ray Casting , 2000, WSCG.

[19]  Oleg Davydov,et al.  A Novel White Matter Fibre Tracking Algorithm Using Probabilistic Tractography and Average Curves , 2010, MICCAI.

[20]  Lee Westover,et al.  Splatting: a parallel, feed-forward volume rendering algorithm , 1991 .

[21]  Felix G. Hamza-Lup,et al.  INTERACTIVE 3 D USER INTERFACES FOR EXPLORING NEUROANATOMY , 2009 .

[22]  Yasufumi Takama,et al.  Parallel volume segmentation with tetrahedral adaptive grid , 2004, ICPR 2004.

[23]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Daniel Weiskopf,et al.  Hierarchical Line Integration , 2011, IEEE Transactions on Visualization and Computer Graphics.

[25]  Bui Tuong Phong.  Illumination for computer generated pictures , 1975, Commun. ACM.

[26]  Andoni Beristain,et al.  Volume Visual Attention Maps (VVAM) in Ray-Casting Rendering , 2012, MMVR.

[27]  Pradeep Dubey,et al.  Mapping High-Fidelity Volume Rendering for Medical Imaging to CPU, GPU and Many-Core Architectures , 2009, IEEE Transactions on Visualization and Computer Graphics.

[28]  James F. O'Brien,et al.  Interpolating and approximating implicit surfaces from polygon soup , 2005, SIGGRAPH 2005.

[29]  Montse Pardàs,et al.  Shape from incomplete silhouettes based on the reprojection error , 2010, Image Vis. Comput..

[30]  Ruigang Yang,et al.  A Performance Study on Different Cost Aggregation Approaches Used in Real-Time Stereo Matching , 2007, International Journal of Computer Vision.

[31]  Pat Hanrahan,et al.  Volume Rendering , 2020, Definitions.

[32]  R. Schiffer,et al.  INTRODUCTION , 1988, Neurology.

[33]  Ben Weiss.  Fast median and bilateral filtering , 2006, SIGGRAPH 2006.

[34]  Luís Paulo Santos,et al.  GPU ray casting , 2009 .

[35]  James T. Kajiya,et al.  Ray tracing volume densities , 1984, SIGGRAPH.

[36]  Agnieszka Bojko,et al.  Informative or Misleading? Heatmaps Deconstructed , 2009, HCI.

[37]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[38]  Timm Drevensek,et al.  Dynamic and interactive aspects of X3DOM , 2011, Web3D '11.

[39]  Alexander Woodward,et al.  Which Stereo Matching Algorithm for Accurate 3D Face Creation? , 2004, IWCIA.

[40]  Andreas Lanitis,et al.  Image Based 3D Face Reconstruction: a Survey , 2009, Int. J. Image Graph..

[41]  Jarke J. van Wijk,et al.  Image based flow visualization , 2002, ACM Trans. Graph..

[42]  Scott Schaefer,et al.  Dual marching cubes: primal contouring of dual grids , 2004, 12th Pacific Conference on Computer Graphics and Applications, 2004. PG 2004. Proceedings..

[43]  Aitor Moreno,et al.  Hardware-accelerated Web Visualization of Vector Fields - Case Study in Oceanic Currents , 2012, GRAPP/IVAPP.

[44]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[45]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[46]  Željka Mihajlović,et al.  Introduction to the Visualization Service Based on Web Services , 2006 .

[47]  Kalpathi R. Subramanian,et al.  Interpolating implicit surfaces from scattered surface data using compactly supported radial basis functions , 2001, Proceedings International Conference on Shape Modeling and Applications.

[48]  Stefan Bruckner,et al.  Efficient Volume Visualization of Large Medical Datasets: Concepts and Algorithms , 2008 .

[49]  Jonathan H. Connell,et al.  A Statistical Approach for Real-time Robust Background Subtrac tion and Shadow Detection , 2014 .

[50]  Jens H. Krüger,et al.  Tuvok, an Architecture for Large Scale Volume Rendering , 2010, VMV.

[51]  Marc Levoy,et al.  Display of surfaces from volume data , 1988, IEEE Computer Graphics and Applications.

[52]  Premysl Krsek.  Flow Reduction Marching Cubes Algorithm , 2004, ICCVG.

[53]  Margrit Gelautz,et al.  Local stereo matching using geodesic support weights , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[54]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[55]  Marshall W. Bern,et al.  A new Voronoi-based surface reconstruction algorithm , 1998, SIGGRAPH.

[56]  Ruigang Yang,et al.  How Far Can We Go with Local Optimization in Real-Time Stereo Matching , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[57]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[58]  Jean-Philippe Thiran,et al.  The Connectome Viewer Toolkit: An Open Source Framework to Manage, Analyze, and Visualize Connectomes , 2011, Front. Neuroinform..

[59]  Paolo Cignoni,et al.  Controlled and Adaptive Mesh Zippering , 2010, GRAPP.

[60]  Hans P. Moravec.  Towards Automatic Visual Obstacle Avoidance , 1977, IJCAI.

[61]  Henning Scharsach.  Advanced GPU Raycasting , 2005 .

[62]  Hong Yi,et al.  A survey of the marching cubes algorithm , 2006, Comput. Graph..

[63]  Frans Vos,et al.  Improving Triangle Mesh Quality with SurfaceNets , 2000, MICCAI.

[64]  Qunsheng Peng,et al.  Curvature Estimation of Point-Sampled Surfaces and Its Applications , 2005, ICCSA.

[65]  Charles Marion,et al.  Remote visualization of large datasets with MIDAS and ParaViewWeb , 2011, Web3D '11.

[66]  Robert J. Moorhead,et al.  Accelerated unsteady flow line integral convolution , 2005, IEEE Transactions on Visualization and Computer Graphics.

[67]  Jianwei Zhang,et al.  Vision Processing for Realtime 3-D Data Acquisition Based on Coded Structured Light , 2008, IEEE Transactions on Image Processing.

[68]  Pienaar Rudolph,et al.  Realtime Visualization of the Connectome in the Browser using WebGL , 2011 .

[69]  R. Kikinis,et al.  Interactive Diffusion Tensor Tractography Visualization for Neurosurgical Planning , 2011, Neurosurgery.

[70]  David S. Ebert,et al.  Visualization of structured nonuniform grids , 2006, IEEE Computer Graphics and Applications.

[71]  Nigel W. John,et al.  Quantizing the Void: Extending Web3D for Space-Filling Haptic Meshes , 2011, MMVR.

[72]  Klaus Mueller,et al.  A practical evaluation of popular volume rendering algorithms , 2000, VVS '00.

[73]  James F. Brinkley,et al.  Server-based approach to web visualization of integrated 3-D medical image data , 2001, AMIA.

[74]  Timo Ropinski,et al.  Advanced illumination techniques for GPU-based volume raycasting , 2008, SIGGRAPH 2008.

[75]  Roberto Scopigno,et al.  SpiderGL: a JavaScript 3D graphics library for next-generation WWW , 2010, Web3D '10.

[76]  David N. Kenwright,et al.  A 3-D streamline tracking algorithm using dual stream functions , 1992, Proceedings Visualization '92.

[77]  Michael Zöllner,et al.  X3DOM: a DOM-based HTML5/X3D integration model , 2009, Web3D '09.

[78]  Marc Alexa,et al.  Volume visualization in VRML , 2001, Web3D '01.

[79]  Nicholas F. Polys,et al.  Cross-Platform Presentation of Interactive Volumetric Imagery , 2012 .

[80]  Arie E. Kaufman,et al.  Tetra-Cubes: An algorithm to generate 3D isosurfaces based upon tetrahedra , 1996 .

[81]  Brian Cabral,et al.  Imaging vector fields using line integral convolution , 1993, SIGGRAPH.

[82]  Shing-Tung Yau,et al.  High-resolution, real-time-geometry video acquisition , 2006, SIGGRAPH '06.

[83]  Philipp Slusallek,et al.  XML3D: interactive 3D graphics for the web , 2010, Web3D '10.

[84]  E. Melhem,et al.  Diffusion-tensor MR imaging and tractography: exploring brain microstructure and connectivity. , 2007, Radiology.

[85]  Álvaro Segura,et al.  Visual Processing of Geographic and Environmental Information in the Basque Country: Two Basque Case Studies , 2009 .

[86]  E Chernyaev,et al.  Marching cubes 33 : construction of topologically correct isosurfaces , 1995 .

[87]  Miguel Granados,et al.  FEA-driven Geometric Modelling for Meshless Methods , 2005 .

[88]  Min Chen,et al.  Over Two Decades of Integration‐Based, Geometric Flow Visualization , 2010, Comput. Graph. Forum.

[89]  Paul Debevec,et al.  The Digital Emily project: photoreal facial modeling and animation , 2009, SIGGRAPH '09.

[90]  James F. Blinn,et al.  Light reflection functions for simulation of clouds and dusty surfaces , 1982, SIGGRAPH.

[91]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[92]  Joaquim Salvi,et al.  A state of the art in structured light patterns for surface profilometry , 2010, Pattern Recognit..

[93]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[94]  Hamid Soltanian-Zadeh,et al.  Web-based interactive 2D/3D medical image processing and visualization software , 2010, Comput. Methods Programs Biomed..

[95]  James F. Brinkley,et al.  Application of Information Technology: Server-based Approach to Web Visualization of Integrated Three-dimensional Brain Imaging Data , 2005, J. Am. Medical Informatics Assoc..

[96]  Aljoscha Smolic,et al.  Toward a 3D video format for auto-stereoscopic displays , 2008, Optical Engineering + Applications.

[97]  Gabriel Taubin,et al.  Volume warping for adaptive isosurface extraction , 2002, IEEE Visualization, 2002. VIS 2002..

[98]  Wolfgang Grodd,et al.  Visualizing MR diffusion tensor fields by dynamic fiber tracking and uncertainty mapping , 2006, Comput. Graph..

[99]  Francesco Pinciroli,et al.  Web tools for effective retrieval, visualization, and evaluation of cardiology medical images and records , 2000, IS&T/SPIE Electronic Imaging.

[100]  Hans P. Morevec.  Towards automatic visual obstacle avoidance , 1977, IJCAI 1977.

[101]  Thomas Lewiner,et al.  Efficient Implementation of Marching Cubes' Cases with Topological Guarantees , 2003, J. Graphics, GPU, & Game Tools.

[102]  Luc Van Gool,et al.  Fast 3D Scanning with Automatic Motion Compensation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[103]  David A. Lane.  UFAT-a particle tracer for time-dependent flow fields , 1994, Proceedings Visualization '94.

[104]  Len G. Margolin,et al.  On Forward-in-Time Differencing for Fluids: an Eulerian/Semi-Lagrangian Non-Hydrostatic Model for Stratified Flows , 1997 .

[105]  Ulrich Bockholt,et al.  Using X3D for medical training simulations , 2008, Web3D '08.

[106]  Michael G. Strintzis,et al.  Real-time acquisition of depth and color images using structured light and its application to 3D face recognition , 2005, Real Time Imaging.

[107]  Aitor Moreno,et al.  Interactive visualization of volumetric data with WebGL in real-time , 2011, Web3D '11.

[108]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[109]  Alan D. Hudson,et al.  MedX3D: Standards Enabled Desktop Medical 3D , 2008, MMVR.

[110]  Jarke J. van Wijk,et al.  Image based flow visualization for curved surfaces , 2003, IEEE Visualization, 2003. VIS 2003..

[111]  Kurt Konolige,et al.  CenSurE: Center Surround Extremas for Realtime Feature Detection and Matching , 2008, ECCV.

[112]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[113]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[114]  Sunghee Choi,et al.  The power crust , 2001, SMA '01.

[115]  Rüdiger Westermann,et al.  Acceleration techniques for GPU-based volume rendering , 2003, IEEE Visualization, 2003. VIS 2003..

[116]  Raimund Dachselt,et al.  3D attentional maps: aggregated gaze visualizations in three-dimensional virtual environments , 2010, AVI.

[117]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[118]  Constantin F. Aliferis,et al.  Studies in Health Technology and Informatics , 2007 .

[119]  Timo Ropinski,et al.  Voreen: A Rapid-Prototyping Environment for Ray-Casting-Based Volume Visualizations , 2009, IEEE Computer Graphics and Applications.

[120]  Francesc Tarres,et al.  Real-time depth map generation architecture for 3D videoconferencing , 2010, 2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[121]  Milton Chen,et al.  Leveraging the asymmetric sensitivity of eye contact for videoconference , 2002, CHI.

[122]  Jens Keil,et al.  A scalable architecture for the HTML5/X3D integration model X3DOM , 2010, Web3D '10.

[123]  C. Schmid,et al.  Indexing based on scale invariant interest points , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[124]  Lisa K. Forssell,et al.  Using Line Integral Convolution for Flow Visualization: Curvilinear Grids, Variable-Speed Animation, and Unsteady Flows , 1995, IEEE Trans. Vis. Comput. Graph..

[125]  Guillermo Gallego,et al.  Line Geometry and Camera Autocalibration , 2008, Journal of Mathematical Imaging and Vision.

[126]  Sittapong Settapat,et al.  Web‐based 3D medical image visualization framework for biomedical engineering education , 2014, Comput. Appl. Eng. Educ..

[127]  Aitor Moreno,et al.  Interactive and Stereoscopic Hybrid 3D Viewer of Radar Data with Gesture Recognition , 2010, HAIS.

[128]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[129]  Terry M. Peters,et al.  Efficient 3D rendering for web-based medical imaging software: a proof of concept , 2011, Medical Imaging.

[130]  M. Levoy,et al.  Fast volume rendering using a shear-warp factorization of the viewing transformation , 1994, SIGGRAPH.

[131]  Pascal Fua,et al.  A parallel stereo algorithm that produces dense depth maps and preserves image features , 1993, Machine Vision and Applications.

[132]  O. Abe,et al.  MR diffusion tensor imaging: recent advance and new techniques for diffusion tensor visualization. , 2003, European journal of radiology.

[133]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[134]  Markus Gross,et al.  Point-Based Graphics , 2007 .

[135]  Leif Kobbelt,et al.  Robust reconstruction of watertight 3D models from non-uniformly sampled point clouds without normal information , 2006, SGP '06.

[136]  D CohenScott,et al.  Using Line Integral Convolution for Flow Visualization , 1995 .

[137]  Sun K. Yoo,et al.  Web-Based Hybrid Visualization of Medical Images , 2005, CIVR.

[138]  Joseph A Cafazzo,et al.  Perception of eye contact in video teleconsultation , 2007, Journal of telemedicine and telecare.

[139]  Christopher Joseph Pal,et al.  Learning Conditional Random Fields for Stereo , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[140]  Anil K. Jain,et al.  A modified Hausdorff distance for object matching , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[141]  Aitor Moreno,et al.  Adaptative Cubical Grid for Isosurface Extraction , 2009, GRAPP.

[142]  John Shalf,et al.  Extraction of Crack-free Isosurfaces from Adaptive Mesh Refinement Data , 2001, VisSym.

[143]  R. Victor Klassen,et al.  Shadowed hedgehogs: a technique for visualizing 2D slices of 3D vector fields , 1991, Proceeding Visualization '91.

[144]  Heiko Hirschmüller,et al.  Evaluation of Cost Functions for Stereo Matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[145]  Linden J. Ball,et al.  Eye tracking in HCI and usability research. , 2006 .

[146]  W. Hibbard,et al.  Interactivity is the key , 1989, VVS '89.

[147]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[148]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[149]  Diana Wald,et al.  Comparison of Segmentation Algorithms for the Zebrafish Heart in Fluorescent Microscopy Images , 2009, ISVC.

[150]  Toshio Moriya,et al.  Surface Reconstruction from High-Density Points Using Deformed Grids , 2008 .

[151]  Timo Ropinski,et al.  Accelerating Volume Raycasting using Occlusion Frustums , 2008, VG/PBG@SIGGRAPH.