A Wearable Augmented Reality Platform for Telemedicine

This paper describes the development of the prototype of an Augmented Reality based tele-consultation platform settled with a wearable video see through Head Mounted Display (HMD) with the aim to provide specialist consult to low specialist remote area without the need to move the patient. The platform prototype has the donning advantage that gives the user an immersive experience, moreover the video see through HMD allows for intrinsic coherence of the scenes shared between the users (the mentor and the proctored clinician). The platform has been preliminarily evaluated from a technical point of view and two different scenarios were identified for future clinical testing: ambulatorial (gynecologic) and surgical (orthopaedic).

[1]  B. Guthrie,et al.  Virtual Interactive Presence and Augmented Reality (VIPAR) for Remote Surgical Assistance , 2011, Neurosurgery.

[2]  V Ferrari,et al.  How to build patient‐specific synthetic abdominal anatomies. An innovative approach from physical toward hybrid surgical simulators , 2011, The international journal of medical robotics + computer assisted surgery : MRCAS.

[3]  Craig Locatis,et al.  Mobile Videoconferencing Apps for Telemedicine. , 2016, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[4]  Fabrizio Cutolo,et al.  Augmented reality visualization of deformable tubular structures for surgical simulation , 2016, The international journal of medical robotics + computer assisted surgery : MRCAS.

[5]  T. Scalea,et al.  External Fixation as a Bridge to Intramedullary Nailing for Patients with Multiple Injuries and with Femur Fractures : Damage Control Orthopedics , 2004 .

[6]  Franco Tecchia,et al.  Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks , 2015, Interact. Learn. Environ..

[7]  Alex Olwal,et al.  Spatial augmented reality on industrial CNC-machines , 2008, Electronic Imaging.

[8]  Fabrizio Cutolo,et al.  Video see through AR head-mounted display for medical procedures , 2014, International Symposium on Mixed and Augmented Reality.

[9]  Fabrizio Cutolo,et al.  [Poster] HMD Video see though AR with unfixed cameras vergence , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[10]  Timo Engelke,et al.  An augmented reality training platform for assembly and maintenance skills , 2013, Robotics Auton. Syst..

[11]  Laura Sesma,et al.  Doctors mobility covered by TraumaStation , 2010, Proceedings of the 10th IEEE International Conference on Information Technology and Applications in Biomedicine.

[12]  Ben H. Boedeker,et al.  Telemedicine Using Free Voice over Internet Protocol (VoIP) Technology , 2011, MMVR.

[13]  E G Shifrin,et al.  Laparoscopic assisted aortic surgery. A review. , 2006, The Journal of cardiovascular surgery.

[14]  S. Tsuda,et al.  Augmented reality telementoring (ART) platform: a randomized controlled trial to assess the efficacy of a new surgical education technology , 2014, Surgical Endoscopy.

[15]  Yue Lu,et al.  Measurement Study of Multi-party Video Conferencing , 2010, Networking.

[16]  Anton V Vladzymyrskyy,et al.  Four Years’ Experience of Teleconsultations in Daily Clinical Practice , 2005, Journal of telemedicine and telecare.

[17]  Robert S. Allison.  The camera convergence problem revisited , 2004, IS&T/SPIE Electronic Imaging.

[18]  Greg Herlein.  The OpenPhone Project--Internet Telephony for Everyone! , 2000 .

[19]  J. Borrelli,et al.  Teleradiology in Orthopaedic Surgery: Impact on Clinical Decision Making for Acute Fracture Management , 2002, Journal of Orthopaedics and Trauma.

[20]  Prashant Kulkarni,et al.  Effectiveness of SIP messages on SIP server , 2013, 2013 IEEE CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGIES.