OIPAV: an Integrated Software System for Ophthalmic Image Processing, Analysis, and Visualization

Ophthalmic medical images, such as optical coherence tomography (OCT) images and color photo of fundus, provide valuable information for clinical diagnosis and treatment of ophthalmic diseases. In this paper, we introduce a software system specially oriented to ophthalmic images processing, analysis, and visualization (OIPAV) to assist users. OIPAV is a cross-platform system built on a set of powerful and widely used toolkit libraries. Based on the plugin mechanism, the system has an extensible framework. It provides rich functionalities including data I/O, image processing, interaction, ophthalmic diseases detection, data analysis, and visualization. By using OIPAV, users can easily access to the ophthalmic image data manufactured from different imaging devices, facilitate workflows of processing ophthalmic images, and improve quantitative evaluations. With a satisfying function scalability and expandability, the software is applicable for both ophthalmic researchers and clinicians.

[1]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[2]  Alexander J. Smola,et al.  Learning with Kernels: support vector machines, regularization, optimization, and beyond , 2001, Adaptive computation and machine learning series.

[3]  William J. Schroeder,et al.  Visualizing with VTK: A Tutorial , 2000, IEEE Computer Graphics and Applications.

[4]  Maxime Sermesant,et al.  vtkINRIA3D: A VTK Extension for Spatiotemporal Data Synchronization, Visualization and Management , 2007, The Insight Journal.

[5]  Marco Nolden,et al.  The Medical Imaging Interaction Toolkit , 2004, Medical Image Anal..

[6]  Marco Eichelberg,et al.  Ten years of medical imaging standardization and prototypical implementation: the DICOM standard and the OFFIS DICOM toolkit (DCMTK) , 2004, SPIE Medical Imaging.

[7]  Xinjian Chen,et al.  Comparison of Retinal Thickness Measurements between the Topcon Algorithm and a Graph-Based Algorithm in Normal and Glaucoma Eyes , 2015, PloS one.

[8]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[9]  William E. Lorensen,et al.  The design and implementation of an object-oriented toolkit for 3D graphics and visualization , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[10]  Jasmin Christian Blanchette,et al.  C++ GUI programming with Qt 4 , 2004 .

[11]  Milan Sonka,et al.  Quantitative analysis of retinal layers' optical intensities on 3D optical coherence tomography for central retinal artery occlusion , 2015, Scientific Reports.

[12]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[13]  Milan Sonka,et al.  3 D Segmentation of Fluid-Associated Abnormalities in Retinal OCT : Probability Constrained Graph-Search – Graph-Cut A , 2022 .

[14]  Uwe Haag,et al.  The statistical software guide '95/96 , 1993 .

[15]  Fred B. Schneider,et al.  User Recovery and Reversal in Interactive Systems , 1984, TOPL.

[16]  Klaus H. Maier-Hein,et al.  The Medical Imaging Interaction Toolkit: challenges and advances , 2013, International Journal of Computer Assisted Radiology and Surgery.

[17]  P. Mildenberger,et al.  Introduction to the DICOM standard , 2002, European Radiology.

[18]  Bernhard Preim,et al.  The Medical Exploration Toolkit – an efficient support for visual computing in surgical planning and training , 2008 .

[19]  Marc Levoy,et al.  Display of surfaces from volume data , 1988, IEEE Computer Graphics and Applications.

[20]  Christopher Bowd,et al.  Automated segmentation of anterior lamina cribrosa surface: How the lamina cribrosa responds to intraocular pressure change in glaucoma eyes? , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[21]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[22]  Kenneth Moreland,et al.  Sandia National Laboratories , 2000 .

[23]  Wei Gao,et al.  Investigation of changes in thickness and reflectivity from layered retinal structures of healthy and diabetic eyes with optical coherence tomography , 2011 .

[24]  Vladimir Pavlovic,et al.  Speech/Gesture Interface to a Visual-Computing Environment , 2000, IEEE Computer Graphics and Applications.

[25]  Xinjian Chen,et al.  Automated segmentation of intraretinal cystoid macular edema for retinal 3D OCT images with macular hole , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[26]  Xinjian Chen,et al.  Choroid Neovascularization Growth Prediction With Treatment Based on Reaction-Diffusion Model in 3-D OCT Images , 2017, IEEE Journal of Biomedical and Health Informatics.

[27]  Kenneth W. Martin,et al.  Mastering CMake: A Cross-Platform Build System , 2008 .

[28]  Xinjian Chen,et al.  Automatic detection of microaneurysms in retinal fundus images , 2017, Comput. Medical Imaging Graph..

[29]  Xinjian Chen,et al.  Automatic Three-dimensional Detection of Photoreceptor Ellipsoid Zone Disruption Caused by Trauma in the OCT , 2016, Scientific reports.

[30]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[31]  Xinjian Chen,et al.  An automated framework for 3D serous pigment epithelium detachment segmentation in SD-OCT images , 2016, Scientific Reports.

[32]  Min Sun,et al.  Quantitative analysis of retinal layers on three-dimensional spectral-domain optical coherence tomography for pituitary adenoma , 2017, PloS one.

[33]  Maxime Sermesant,et al.  vtkINRIA 3 D : A VTK Extension for Spatiotemporal Data Synchronization , Visualization and Management Release , 2007 .

[34]  Xinjian Chen,et al.  Profile and Determinants of Retinal Optical Intensity in Normal Eyes with Spectral Domain Optical Coherence Tomography , 2016, PloS one.

[35]  Michelle Becker.  Pacs And Imaging Informatics Basic Principles And Applications , 2016 .

[36]  Bo Wang,et al.  Automated Lamina Cribrosa Microstructural Segmentation in Optical Coherence Tomography Scans of Healthy and Glaucomatous Eyes References and Links , 2022 .

[37]  S. Achilefu.  IEEE International Symposium on Biomedical Imaging , 2018, IEEE Pulse.

[38]  M F Reiser,et al.  [Value of multiplanar reformations (MPR)in multi-slice spiral CT of the lung]. , 2001, RoFo : Fortschritte auf dem Gebiete der Rontgenstrahlen und der Nuklearmedizin.

[39]  Xinjian Chen,et al.  Enhanced low-rank + sparsity decomposition for speckle reduction in optical coherence tomography , 2016, Journal of biomedical optics.

[40]  Xinjian Chen,et al.  Automated 3-D Retinal Layer Segmentation of Macular Optical Coherence Tomography Images With Serous Pigment Epithelial Detachments , 2015, IEEE Transactions on Medical Imaging.

[41]  Ron Kikinis,et al.  3D Slicer , 2012, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[42]  Xinjian Chen,et al.  Automated choroid segmentation in three-dimensional 1-μm wide-view OCT images with gradient and regional costs , 2016, Journal of biomedical optics.

[43]  Yue Gao,et al.  Zero-Shot Learning With Transferred Samples , 2017, IEEE Transactions on Image Processing.

[44]  Osman Ratib,et al.  OsiriX: An Open-Source Software for Navigating in Multidimensional DICOM Images , 2004, Journal of Digital Imaging.

[45]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[46]  Xinjian Chen,et al.  Three-Dimensional Segmentation of Fluid-Associated Abnormalities in Retinal OCT: Probability Constrained Graph-Search-Graph-Cut , 2012, IEEE Transactions on Medical Imaging.

[47]  Xinjian Chen,et al.  Automated Detection of IS/OS Defect Regions in 3D OCT Images , 2014 .

[48]  Matthew McCullough,et al.  Version Control with Git: Powerful Tools and Techniques for Collaborative Software Development , 2009 .

[49]  B. van Ginneken,et al.  Computer-aided diagnosis: how to move from the laboratory to the clinic. , 2011, Radiology.

[50]  Brian Cabral,et al.  Accelerated volume rendering and tomographic reconstruction using texture mapping hardware , 1994, VVS '94.

[51]  Xinjian Chen,et al.  A Framework for Classification and Segmentation of Branch Retinal Artery Occlusion in SD-OCT , 2017, IEEE Transactions on Image Processing.

[52]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[53]  Michael Wall,et al.  Structure versus function in glaucoma: an application of a linear model. , 2007, Investigative ophthalmology & visual science.

[54]  C. Kulinna,et al.  Wertigkeit multiplanarer Reformationen (MPR) in der Mehrschicht-Spiral-CT der Lunge , 2001 .