Review of Microsoft HoloLens Applications over the Past Five Years

Since Microsoft HoloLens first appeared in 2016, HoloLens has been used in various industries, over the past five years. This study aims to review academic papers on the applications of HoloLens in several industries. A review was performed to summarize the results of 44 papers (dated between January 2016 and December 2020) and to outline the research trends of applying HoloLens to different industries. This study determined that HoloLens is employed in medical and surgical aids and systems, medical education and simulation, industrial engineering, architecture, civil engineering and other engineering fields. The findings of this study contribute towards classifying the current uses of HoloLens in various industries and identifying the types of visualization techniques and functions.

[1]  Nikolaos V. Tsekos,et al.  Holographic Interface for three-dimensional Visualization of MRI on HoloLens: A Prototype Platform for MRI Guided Neurosurgeries , 2017, 2017 IEEE 17th International Conference on Bioinformatics and Bioengineering (BIBE).

[2]  Martin Weinmann,et al.  MARKER-BASED LOCALIZATION OF THE MICROSOFT HOLOLENS IN BUILDING MODELS , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[3]  Erich Stark,et al.  Virtual Laboratory Based on Node.js Technology and Visualized in Mixed Reality Using Microsoft HoloLens , 2017, FedCSIS.

[4]  Fridolin Wild,et al.  User Satisfaction in Augmented Reality-Based Training Using Microsoft HoloLens , 2018, Comput..

[5]  Jennifer Herron,et al.  Augmented Reality in Medical Education and Training , 2016 .

[6]  Bernd Engel,et al.  Smart retrofitting of machine tools in the context of industry 4.0 , 2020 .

[7]  Soo-Mi Choi,et al.  A Review on Mixed Reality: Current Trends, Challenges and Prospects , 2020, Applied Sciences.

[8]  Tiago M. Fernández-Caramés,et al.  A Fog Computing and Cloudlet Based Augmented Reality System for the Industry 4.0 Shipyard , 2018, Sensors.

[9]  Mathias Unberath,et al.  Feasibility of image-based augmented reality guidance of total shoulder arthroplasty using microsoft HoloLens 1 , 2020 .

[11]  David Krcmarik,et al.  Efficient Use of Mixed Reality for BIM system using Microsoft HoloLens , 2019, IFAC-PapersOnLine.

[12]  Jiann-Der Lee,et al.  HoloLens-Based AR System with a Robust Point Set Registration Algorithm , 2019, Sensors.

[13]  Florentin Liebmann,et al.  Augmented Reality Navigation for Spinal Pedicle Screw Instrumentation using Intraoperative 3D Imaging. , 2020, The spine journal : official journal of the North American Spine Society.

[14]  Tiago M. Fernández-Caramés,et al.  Analysis, Design and Practical Validation of an Augmented Reality Teaching System Based on Microsoft HoloLens 2 and Edge Computing , 2020, Proceedings of 7th International Electronic Conference on Sensors and Applications.

[15]  Kaj Helin,et al.  User Experience of Augmented Reality System for Astronaut's Manual Work Support , 2018, Front. Robot. AI.

[16]  Sara Condino,et al.  How to Build a Patient-Specific Hybrid Simulator for Orthopaedic Open Surgery: Benefits and Limits of Mixed-Reality Using the Microsoft HoloLens , 2018, Journal of healthcare engineering.

[17]  T. Fernández-Caramés,et al.  Creating Collaborative Augmented Reality Experiences for Industry 4.0 Training and Assistance Applications: Performance Evaluation in the Shipyard of the Future , 2020, Applied Sciences.

[18]  Ana M. Bernardos,et al.  Enhancing Interaction with Augmented Reality through Mid-Air Haptic Feedback: Architecture Design and User Feedback , 2019 .

[19]  Dimitrios Androutsos,et al.  An augmented reality system characterization of placement accuracy in neurosurgery , 2020, Journal of Clinical Neuroscience.

[20]  M. Sugimoto,et al.  Accuracy of Le Fort I osteotomy with combined computer-aided design/computer-aided manufacturing technology and mixed reality. , 2020, International journal of oral and maxillofacial surgery.

[21]  Rod Furlan.  The future of augmented reality: Hololens - Microsoft's AR headset shines despite rough edges [Resources_Tools and Toys] , 2016, IEEE Spectrum.

[22]  Martin Weinmann,et al.  Evaluation of HoloLens Tracking and Depth Sensing for Indoor Mapping Applications , 2020, Sensors.

[23]  Wolfgang Vorraber,et al.  Assessing augmented reality in production: remote-assisted maintenance with HoloLens , 2020 .

[24]  Ronie Salgado,et al.  Toward Agile Situated Visualization: An Exploratory User Study , 2020, CHI Extended Abstracts.

[25]  G. Ampanozi,et al.  Preliminary testing of an augmented reality headset as a DICOM viewer during autopsy , 2020 .

[26]  Norbert Chamier-Gliszczyński,et al.  Assessment of Augmented Reality in Manual Wiring Production Process with Use of Mobile AR Glasses , 2020, Sensors.

[27]  Wei Wang,et al.  Holo3DGIS: Leveraging Microsoft HoloLens in 3D Geographic Information , 2018, ISPRS Int. J. Geo Inf..

[28]  Bert Coolen,et al.  Avoiding 3D Obstacles in Mixed Reality: Does It Differ from Negotiating Real Obstacles? , 2020, Sensors.

[29]  Brian J. Park,et al.  3D Augmented Reality-Assisted CT-Guided Interventions: System Design and Preclinical Trial on an Abdominal Phantom using HoloLens 2 , 2020, ArXiv.

[30]  Ana M. Bernardos,et al.  SARA: A Microservice-Based Architecture for Cross-Platform Collaborative Augmented Reality , 2020, Applied Sciences.

[31]  Sara Condino,et al.  Wearable Augmented Reality Application for Shoulder Rehabilitation , 2019, Electronics.

[32]  Bert Coolen,et al.  Quantifying Spatiotemporal Gait Parameters with HoloLens in Healthy Adults and People with Parkinson’s Disease: Test-Retest Reliability, Concurrent Validity, and Face Validity , 2020, Sensors.

[33]  Huang Jing,et al.  Non-contact Measurement Method Research Based on HoloLens , 2017, 2017 International Conference on Virtual Reality and Visualization (ICVRV).

[34]  David Krcmarik,et al.  Hybrid slam modelling of autonomous vehicle with augmented reality device , 2020 .

[35]  S. Wursthorn,et al.  Voxel-Based Indoor Reconstruction From HoloLens Triangle Meshes , 2020, ArXiv.

[36]  Abdulmotaleb El Saddik,et al.  Visualizing Toronto City Data with HoloLens: Using Augmented Reality for a City Model , 2018, IEEE Consumer Electronics Magazine.

[37]  Lei Hu,et al.  An Online Calibration Method for Microsoft HoloLens , 2019, IEEE Access.

[38]  Paula Fraga-Lamas,et al.  Creating the Internet of Augmented Things: An Open-Source Framework to Make IoT Devices and Augmented and Mixed Reality Systems Talk to Each Other † , 2020, Sensors.

[39]  Dimitris Mourtzis,et al.  Augmented reality visualization of production scheduling and monitoring , 2020 .

[40]  Minna Lanz,et al.  AR-based interaction for human-robot collaborative manufacturing , 2020, Robotics Comput. Integr. Manuf..

[41]  Hwangsoo Chun.  Application of Virtual Reality in the Medical Field , 2019 .

[42]  Max Pfingsthorn,et al.  Mind the ARm: realtime visualization of robot motion intent in head-mounted augmented reality , 2020, Mensch & Computer.

[43]  Jiann-Der Lee,et al.  An Augmented Reality System Using Improved-Iterative Closest Point Algorithm for On-Patient Medical Image Visualization , 2018, Sensors.

[44]  Prokar Dasgupta,et al.  Effectiveness of the HoloLens mixed-reality headset in minimally invasive surgery: a simulation-based feasibility study , 2019, Surgical Endoscopy.

[45]  Liron Pantanowitz,et al.  Augmented Reality Technology Using Microsoft HoloLens in Anatomic Pathology. , 2018, Archives of pathology & laboratory medicine.

[46]  Alessandro Ceruti,et al.  An Interactive Real-Time Cutting Technique for 3D Models in Mixed Reality , 2020, Technologies.

[47]  Rahul Prasanna Kumar,et al.  Use of mixed reality for surgery planning: Assessment and development workflow. , 2020, Journal of biomedical informatics.

[48]  Graham Lawton,et al.  Through the HoloLens™ looking glass: augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels , 2018, European Radiology Experimental.

[49]  Junhui He,et al.  Combining HoloLens and Leap-Motion for Free Hand-Based 3D Interaction in MR Environments , 2020, AVR.

[50]  Eun-Young Lee,et al.  A Novel Head Mounted Display Based Methodology for Balance Evaluation and Rehabilitation , 2019, Sustainability.

[51]  Mafkereseb Kassahun Bekele,et al.  Walkable Mixed Reality Map as interaction interface for Virtual Heritage , 2019, Digit. Appl. Archaeol. Cult. Heritage.

[52]  Oscar Meruvia Pastor,et al.  Augmented Reality as a Telemedicine Platform for Remote Procedural Training , 2017, Sensors.

[53]  Petrea Redmond,et al.  HoloLens and mobile augmented reality in medical and health science education: A randomised controlled trial , 2020, Br. J. Educ. Technol..

[54]  Tiago M. Fernández-Caramés,et al.  Wireless Channel Assessment of Auditoriums for the Deployment of Augmented Reality Systems for Enhanced Show Experience of Impaired Persons , 2019 .

[55]  David Krcmarik,et al.  Autonomous Vehicle Control based on HoloLens Technology and Raspberry Pi Platform: an Educational Perspective , 2019, IFAC-PapersOnLine.

[56]  Yuqi Wang,et al.  HoloLens-Based Vascular Localization System: Precision Evaluation Study With a Three-Dimensional Printed Model , 2019, Journal of medical Internet research.

[57]  M. Ostanin,et al.  Interactive Robot Programing Using Mixed Reality , 2018, SyRoCo.

[58]  Francesco Osti,et al.  Real Time Shadow Mapping for Augmented Reality Photorealistic Rendering , 2019 .

[59]  Abdulmotaleb El-Saddik,et al.  Technical Evaluation of HoloLens for Multimedia: A First Look , 2018, IEEE MultiMedia.

[60]  Bernard C. Kress,et al.  11‐1: Invited Paper: Towards the Ultimate Mixed Reality Experience: HoloLens Display Architecture Choices , 2017 .

[61]  Jean-François Lalonde,et al.  Real-Time High Resolution 3D Data on the HoloLens , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct).

[62]  Floris Ernst,et al.  Towards X-ray free endovascular interventions – using HoloLens for on-line holographic visualisation , 2017, Healthcare technology letters.

[63]  Ahmad Y. Javaid,et al.  Facial Emotion Recognition: A Survey and Real-World User Experiences in Mixed Reality , 2018, Sensors.

[64]  Davide Scaramuzza,et al.  Pedicle screw navigation using surface digitization on the Microsoft HoloLens , 2019, International Journal of Computer Assisted Radiology and Surgery.

[65]  Chenguang Yang,et al.  Mixed Reality Enhanced User Interactive Path Planning for Omnidirectional Mobile Robot , 2020, Applied Sciences.

[66]  Soonchul Kwon,et al.  A Novel Real-Time Match-Moving Method with HoloLens , 2019 .

[67]  Inki Kim,et al.  The effects of augmented reality on improving spatial problem solving for object assembly , 2018, Adv. Eng. Informatics.

[68]  Rafael Radkowski,et al.  Augmented Reality System Calibration for Assembly Support With the Microsoft HoloLens , 2018 .

[69]  P. Lukowicz,et al.  Augmenting the thermal flux experiment: A mixed reality approach with the HoloLens , 2017, 1709.01342.

[70]  Wolfgang Prinz,et al.  Tango vs. HoloLens: A Comparison of Collaborative Indoor AR Visualisations Using Hand-Held and Hands-Free Devices , 2019, Multimodal Technol. Interact..

[71]  FlexiVision: Teleporting the Surgeon’s Eyes via Robotic Flexible Endoscope and Head-Mounted Display , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).