A Medical Image Visualization Technique Assisted with AI-Based Haptic Feedback for Robotic Surgery and Healthcare

A lesson learned during the pandemic is that social distancing saves lives. As it was shown recently, the healthcare industry is structured in a way that cannot protect medical staff from possible infectious diseases, such as COVID-19. Today’s healthcare services seem anachronistic and not convenient for both doctors and patients. Although there have been several advances in recent years, especially in developed countries, the need for a holistic change is imperative. Evidently, future technologies should be introduced in the health sector, where Virtual Reality, Augmented Reality, Artificial Intelligence, and Tactile Internet can have vast applications. Thus, the healthcare industry could take advantage of the great evolution of pervasive computing. In this paper, we point out the challenges from the current visualization techniques and present a novel visualization technique assisted with haptics which is enhanced with artificial intelligent algorithms in order to offer remote patient examination and treatment through robotics. Such an approach provides a more detailed method of medical image data visualization and eliminates the possibility of diseases spreading, while reducing the workload of the medical staff.

[1]  M. V. A. Raju Bahubalendruni,et al.  Challenges and opportunities on AR/VR technologies for manufacturing systems in the context of industry 4.0: A state of the art review , 2022, Journal of Manufacturing Systems.

[2]  Konstantinos E. Psannis,et al.  Exploitation of Emerging Technologies and Advanced Networks for a Smart Healthcare System , 2022, Applied Sciences.

[3]  Radek Kolecki,et al.  Assessment of the utility of mixed reality in medical education , 2022, Translational Research in Anatomy.

[4]  Philip Smit,et al.  Noncontact Respiratory Monitoring Using Depth Sensing Cameras: A Review of Current Literature , 2021, Sensors.

[5]  Juan Antonio Juanes Méndez,et al.  Nextmed: Automatic Imaging Segmentation, 3D Reconstruction, and 3D Model Visualization Platform Using Augmented and Virtual Reality , 2020, Sensors.

[6]  F. Chast,et al.  Qualification of a chemotherapy-compounding robot , 2020, Journal of oncology pharmacy practice : official publication of the International Society of Oncology Pharmacy Practitioners.

[7]  Selen Türkay,et al.  Shape Recognition and Selection in Medical Volume Visualisation with Haptic Gloves , 2019, OZCHI.

[8]  Michael I. Jordan,et al.  Artificial Intelligence—The Revolution Hasn’t Happened Yet , 2019, Issue 1.

[9]  Georgios Minopoulos,et al.  A Survey on Haptic Data Over 5G Networks , 2019, International Journal of Future Generation Communication and Networking.

[10]  Joe Cecil,et al.  An advanced simulator for orthopedic surgical training , 2018, International Journal of Computer Assisted Radiology and Surgery.

[11]  David B. Douglas,et al.  Augmented Reality: Advances in Diagnostic Imaging , 2017, Multimodal Technol. Interact..

[12]  Long Chen,et al.  Real-time geometry-aware augmented reality in minimally invasive surgery , 2017, Healthcare technology letters.

[13]  A. Meola,et al.  A new head-mounted display-based augmented reality system in neurosurgical oncology: a study on phantom , 2017, Computer assisted surgery.

[14]  C. Law,et al.  Using a depth-sensing infrared camera system to access and manipulate medical imaging from within the sterile operating field. , 2013, Canadian journal of surgery. Journal canadien de chirurgie.

[15]  S. Lee,et al.  Augmented reality intravenous injection simulator based 3D medical imaging for veterinary medicine. , 2013, Veterinary journal.

[16]  Philip R. O. Payne,et al.  Questions for Artificial Intelligence in Health Care. , 2019, JAMA.