An Augmented Reality Approach to Visualize Biomedical Images

One of the technologies that is showing the most potential in an always widening range of applications, from entertainment to design and even healthcare, is Augmented Reality (AR). The most de ning characteristic of AR consists of the possibility to overlap virtual object to be projected by a dedicated device upon a real environment. Throughout this work, the development of an application for the visualization of medical data in AR environments will be discussed. Nowadays, the most appropriate devices for such applications are Head Mounted Displays (HMDs). Investigating current visualization procedures of medical data deriving from CT or MRI scans, AR tools and features have the potential to streamline common activities, as diagnostic and surgery planning precesses, providing a much more immersive user experience. In this paper, an e ective visualization approach merging these new technologies and biomedical images is proposed. Using a cutting edge HMD device, an application that takes as input CT or MRI scans and gives as output an immersive visualization of patient's internal body structures has been developed. The range of possible use scenarios is very wide. In essence, the goal is to recreate the illusion for the user to be able to see through the patient's skin with no visual distortion, providing a much improved perception of the relative position of the inner body structures. Present techniques make use of DICOM data mostly in the diagnostic stage, whereas it is possible to integrate AR tools within the whole medical work ow and even to further stages of the disease treatment, including surgery planning and training activities. Additionally, the possibility to connect a multitude of HMD devices together that are able to display the same scene from di erent angles, depending on each own position, opens up to a great variety of collaborative working or learning situations. Although there is still a lot of scope for improvements, the paper details the potential of AR for a medical implementation, outlining speci cations needed to evolve into something actually usable in a real-life scenario.

[1]  E Viirre,et al.  The virtual retinal display: a new technology for virtual reality and augmented vision in medicine. , 1998, Studies in health technology and informatics.

[2]  Umberto Cugini,et al.  Integrating Scents Simulation in Virtual Reality Multisensory Environment for Industrial Products Evaluation , 2015 .

[3]  Caterina Rizzi,et al.  Mixed Reality to Design Lower Limb Prosthesis , 2015 .

[4]  Giorgio Colombo,et al.  Spatial Augmented Reality and Simulations to Improve Abdominal Aortic Aneurysm Diagnosis and Monitoring , 2014 .

[5]  M. Schijven,et al.  Systematic review on the effectiveness of augmented reality applications in medical training , 2016, Surgical Endoscopy.

[6]  Noor Christoph,et al.  Augmented reality in medical education? , 2014, Perspectives on Medical Education.

[7]  Lars Konge,et al.  Using virtual reality simulation to assess competence in video-assisted thoracoscopic surgery (VATS) lobectomy , 2017, Surgical Endoscopy.

[8]  Monica Bordegoni,et al.  Investigating the effects of odours integration in reading and learning experiences , 2017, IxD&A.

[9]  Borko Furht,et al.  Handbook of Augmented Reality , 2011 .

[10]  Yasin Ozarslan,et al.  Augmented Reality in Education: Current Technologies and the Potential for Education , 2012 .

[11]  Jp Tom Djajadiningrat,et al.  Changing your Hammer: The Implications of Paradigmatic Innovation for Design Practice , 2014 .

[12]  Egui Zhu,et al.  Augmented reality in healthcare education: an integrative review , 2014, PeerJ.

[13]  D. W. F. van Krevelen,et al.  A Survey of Augmented Reality Technologies, Applications and Limitations , 2010, Int. J. Virtual Real..

[14]  Eleni Mangina,et al.  Augmented reality EVAR training in mixed reality educational space , 2017, 2017 IEEE Global Engineering Education Conference (EDUCON).

[15]  A Wagner,et al.  [Computer-assisted intraoperative visualization of dental implants. Augmented reality in medicine]. , 1995, Der Radiologe.

[16]  William R. Sherman,et al.  Understanding Virtual Reality , 2003 .

[17]  Sandrine de Ribaupierre,et al.  Development of augmented reality training simulator systems for neurosurgery using model-driven software engineering , 2017, 2017 IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE).

[18]  Caterina Rizzi,et al.  An Overview of Open Source Software Systems for Smart Development of Virtual Environments , 2017, HCI.