Multi-threaded integration of HTC-Vive and MeVisLab

This work presents how Virtual Reality (VR) can easily be integrated into medical applications via a plugin for a medical image processing framework called MeVisLab. A multi-threaded plugin has been developed using OpenVR, a VR library that can be used for developing vendor and platform independent VR applications. The plugin is tested using the HTC Vive, a head-mounted display developed by HTC and Valve Corporation.

[1]  Bernd Freisleben,et al.  A software system for stent planning, stent simulation and follow-up examinations in the vascular domain , 2009, 2009 22nd IEEE International Symposium on Computer-Based Medical Systems.

[2]  Christopher Nimsky,et al.  Template-Cut: A Pattern-Based Segmentation Paradigm , 2012, Scientific Reports.

[3]  Lesley Strawderman,et al.  Efficacy of virtual reality in pedestrian safety research. , 2017, Applied ergonomics.

[4]  Christopher Nimsky,et al.  Robust Detection and Segmentation for Diagnosis of Vertebral Diseases Using Routine MR Images , 2014, Comput. Graph. Forum.

[5]  Thomas A. Stoffregen,et al.  The virtual reality head-mounted display Oculus Rift induces motion sickness and is sexist in its effects , 2017, Experimental Brain Research.

[6]  T. Kapur,et al.  Fiber Tractography Based on Diffusion Tensor Imaging Compared with High-angular-resolution Diffusion Imaging with Compressed Sensing: Initial Experience , 2022 .

[7]  N. Newbutt,et al.  Brief Report: A Pilot Study of the Use of a Virtual Reality Headset in Autism Populations , 2016, Journal of autism and developmental disorders.

[8]  Christopher Nimsky,et al.  Cube-Cut: Vertebral Body Segmentation in MRI-Data through Cubic-Shaped Divergences , 2014, PloS one.

[9]  Karen B. Chen,et al.  The accuracy of the Oculus Rift virtual reality head-mounted display during cervical spine mobility measurement. , 2015, Journal of biomechanics.

[10]  P. Mitchell,et al.  The potential of virtual reality in social skills training for people with autistic spectrum disorders. , 2002, Journal of intellectual disability research : JIDR.

[11]  Dieter Schmalstieg,et al.  Computer-Aided Planning of Cranial 3D Implants , 2016 .

[12]  Li Li,et al.  The Accuracy and Precision of Position and Orientation Tracking in the HTC Vive Virtual Reality System for Scientific Research , 2017, i-Perception.

[13]  Christopher Nimsky,et al.  Boundary estimation of fiber bundles derived from diffusion tensor images , 2010, International Journal of Computer Assisted Radiology and Surgery.

[14]  Dieter Schmalstieg,et al.  Interactive Volumetry Of Liver Ablation Zones , 2015, Scientific Reports.

[15]  Enrico Rukzio,et al.  CarVR: Enabling In-Car Virtual Reality Entertainment , 2017, CHI.

[16]  R. Satava,et al.  Virtual Reality Training Improves Operating Room Performance: Results of a Randomized, Double-Blinded Study , 2002, Annals of surgery.

[17]  M. Levin,et al.  Virtual Reality in Stroke Rehabilitation: A Meta-Analysis and Implications for Clinicians , 2011, Stroke.

[18]  Christopher Nimsky,et al.  Pituitary Adenoma Segmentation , 2011, ArXiv.

[19]  Dan MacIsaac.  Google Cardboard: A virtual reality headset for $10? , 2015 .

[20]  Jan Egger,et al.  Development of a surgical navigation system based on augmented reality using an optical see-through head-mounted display , 2015, J. Biomed. Informatics.

[21]  Bernd Freisleben,et al.  A Fast Vessel Centerline Extraction Algorithm for Catheter Simulation , 2007, Twentieth IEEE International Symposium on Computer-Based Medical Systems (CBMS'07).

[22]  Egger Jan.  Cranial Defect Datasets , 2017 .

[23]  Elizabeth A. Krupinski,et al.  Pigeons (Columba livia) as Trainable Observers of Pathology and Radiology Breast Cancer Images , 2015, PloS one.

[24]  Liron Pantanowitz,et al.  Exploring virtual reality technology and the Oculus Rift for the examination of digital pathology slides , 2016, Journal of pathology informatics.

[25]  Bernd Freisleben,et al.  Detection and visualization of endoleaks in CT data for monitoring of thoracic and abdominal aortic aneurysm stents , 2016, SPIE Medical Imaging.

[26]  Arthur W. Toga,et al.  VRAIN: Virtual reality assisted intervention for neuroimaging , 2017, 2017 IEEE Virtual Reality (VR).

[27]  Dieter Schmalstieg,et al.  Liver Surgery Planning Using Virtual Reality , 2006, IEEE Computer Graphics and Applications.

[28]  Christopher Nimsky,et al.  Interactive-cut: Real-time feedback segmentation for translational research , 2014, Comput. Medical Imaging Graph..

[29]  Dieter Schmalstieg,et al.  Computer-aided planning and reconstruction of cranial 3D implants. , 2016, Conference proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference.

[30]  Wei Liang,et al.  Earthquake Safety Training through Virtual Drills , 2017, IEEE Transactions on Visualization and Computer Graphics.

[31]  V. Leitáo,et al.  Computer Graphics: Principles and Practice , 1995 .

[32]  Bernd Freisleben,et al.  Aorta Segmentation for Stent Simulation , 2011, ArXiv.

[33]  Andras Lasso,et al.  An Immersive Virtual Reality Environment for Diagnostic Imaging , 2016, J. Medical Robotics Res..

[34]  Christopher Nimsky,et al.  Square-Cut: A Segmentation Algorithm on the Basis of a Rectangle Shape , 2012, PloS one.

[35]  P. Mildenberger,et al.  Introduction to the DICOM standard , 2002, European Radiology.

[36]  Howard Rheingold,et al.  Virtual Reality: Exploring the Brave New Technologies , 1991 .

[37]  Wolfgang Broll,et al.  Exploring users views on immersive adult entertainment applications , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[38]  Elizabeth A. Krupinski,et al.  The potential of pigeons as surrogate observers in medical image perception studies , 2016, SPIE Medical Imaging.

[39]  Doug A. Bowman,et al.  Virtual Reality: How Much Immersion Is Enough? , 2007, Computer.

[40]  I. Danovitch,et al.  Virtual Reality and Medical Inpatients: A Systematic Review of Randomized, Controlled Trials. , 2017, Innovations in clinical neuroscience.

[41]  Christopher Nimsky,et al.  A Fast and Robust Graph-Based Approach for Boundary Estimation of Fiber Bundles Relying on Fractional Anisotropy Maps , 2010, 2010 20th International Conference on Pattern Recognition.

[42]  Bui Tuong Phong.  Illumination for computer generated pictures , 1975, Commun. ACM.

[43]  Christopher Nimsky,et al.  Integration of the OpenIGTLink Network Protocol for image‐guided therapy with the medical platform MeVisLab , 2012, The international journal of medical robotics + computer assisted surgery : MRCAS.

[44]  R McCloy,et al.  Virtual reality in surgery , 2001, BMJ : British Medical Journal.

[45]  Alan Miller,et al.  Exploring the past with Google Cardboard , 2015, 2015 Digital Heritage.

[46]  Swati Gupta,et al.  Training wheelchair navigation in immersive virtual environments for patients with spinal cord injury – end-user input to design an effective system , 2017, Disability and rehabilitation. Assistive technology.

[47]  D. Peck.  Digital Imaging and Communications in Medicine (DICOM): A Practical Introduction and Survival Guide , 2009, Journal of Nuclear Medicine.

[48]  Christopher Nimsky,et al.  A Flexible Semi-Automatic Approach for Glioblastoma multiforme Segmentation , 2011, ArXiv.

[49]  Heiko Maaß,et al.  Using interactive immersive VR/AR for the therapy of phantom limb pain , 2010, Humans and Computers.

[50]  Michael Zyda,et al.  From visual simulation to virtual reality to games , 2005, Computer.

[51]  Jinsil Hwaryoung Seo,et al.  Anatomy builder VR: Applying a constructive learning method in the virtual reality canine skeletal system , 2017, 2017 IEEE Virtual Reality (VR).

[52]  Veerle Ross,et al.  Can Youth with Autism Spectrum Disorder Use Virtual Reality Driving Simulation Training to Evaluate and Improve Driving Performance? An Exploratory Study , 2017, Journal of Autism and Developmental Disorders.

[53]  T. Garner.  The Domain of Virtual Reality , 2018 .

[54]  Christopher Nimsky,et al.  A Medical Software System for Volumetric Analysis of Cerebral Pathologies in Magnetic Resonance Imaging (MRI) Data , 2012, Journal of Medical Systems.

[55]  Jan Egger,et al.  PCG-Cut: Graph Driven Segmentation of the Prostate Central Gland , 2013, PloS one.

[56]  Mark Segal,et al.  The Design of the OpenGL Graphics Interface , 1998 .

[57]  Dieter Schmalstieg,et al.  HTC Vive MeVisLab integration via OpenVR for medical applications , 2017, PloS one.

[58]  Dieter Schmalstieg,et al.  Integration of the HTC Vive into the medical platform MeVisLab , 2017, Medical Imaging.

[59]  Jonathan C. Roberts,et al.  Immersive Analytics with WebVR and Google Cardboard , 2016 .

[60]  Werner X. Schneider,et al.  Using the virtual reality device Oculus Rift for neuropsychological assessment of visual processing capabilities , 2016, Scientific Reports.

[61]  Jan Egger,et al.  Refinement-Cut: User-Guided Segmentation Algorithm for Translational Science , 2014, Scientific Reports.

[62]  Christopher Nimsky,et al.  Nugget-Cut: A Segmentation Scheme for Spherically- and Elliptically-Shaped 3D Objects , 2010, DAGM-Symposium.

[63]  R. Graham,et al.  DICOM demystified: a review of digital file formats and their use in radiological practice. , 2005, Clinical radiology.

[64]  Alan Watt,et al.  Advanced animation and rendering techniques - theory and practice , 1992 .

[65]  Hiroyuki Kajimoto,et al.  COMS-VR: Mobile virtual reality entertainment system using electric car and head-mounted display , 2017, 2017 IEEE Symposium on 3D User Interfaces (3DUI).

[66]  Robert J. Stone,et al.  Haptic Feedback: A Brief History from Telepresence to Virtual Reality , 2000, Haptic Human-Computer Interaction.

[67]  Christopher Nimsky,et al.  Segmentation of Vertebral Bodies in MR Images , 2012, VMV.

[68]  Sieu K. Khuu,et al.  The Oculus Rift: a cost-effective tool for studying visual-vestibular interactions in self-motion perception , 2015, Front. Psychol..

[69]  Andrew R. Lilja,et al.  Journey to the centre of the cell: Virtual reality immersion into scientific data , 2018, Traffic.

[70]  SooJeong Yoo,et al.  Controller-less Interaction Methods for Google Cardboard , 2015, SUI.

[71]  Bernd Freisleben,et al.  PREOPERATIVE MEASUREMENT OF ANEURYSMS AND STENOSIS AND STENTSIMULATION FOR ENDOVASCULAR TREATMENT , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[72]  Christopher Nimsky,et al.  Modeling and visualization techniques for virtual stenting of aneurysms and stenoses , 2012, Comput. Medical Imaging Graph..

[73]  Bernd Freisleben,et al.  Simulation of bifurcated stent grafts to treat abdominal aortic aneurysms (AAA) , 2007, SPIE Medical Imaging.

[74]  Christopher J Brady,et al.  GOOGLE CARDBOARD INDIRECT OPHTHALMOSCOPY. , 2017, Retina.

[75]  Christopher Nimsky,et al.  Manual Refinement System for Graph-Based Segmentation Results in the Medical Domain , 2012, Journal of Medical Systems.