Experimental Evaluation of Extended Reality Technologies in the Development of Individualized Three-Dimensionally Printed Upper Limb Prostheses

This paper presents results from experimental studies that assess the utilization of virtual, augmented, and mixed reality (VR, AR, MR) at different stages of developing personalized 3D printed upper limb prostheses for adult patients. The prostheses are designed automatically using the AutoMedPrint system, leveraging 3D scans as described in various prior publications. Various stages of development of the prosthesis are made as applications of different extended reality technologies. An assembly instruction is implemented as an immersive VR application, a configurator is designed as AR application and a configurator and try-on application is prepared and deployed in MR. The applications are tested by an international group of experts during a scheduled experiment. The experts then participate to surveys and comparatively evaluate the potential of all the XR technologies. The paper presents the development of these applications, provides a detailed account of the experimental process, including the rankings of XR technologies for different applications throughout the lifecycle of a prosthetic device.

[1]  Shengfeng Qin,et al.  An Interdisciplinary Approach and Advanced Techniques for Enhanced 3D-Printed Upper Limb Prosthetic Socket Design: A Literature Review , 2023, Actuators.

[2]  Konstantinos E. Psannis,et al.  A Medical Image Visualization Technique Assisted with AI-Based Haptic Feedback for Robotic Surgery and Healthcare , 2023, Applied Sciences.

[3]  Vinay Krishna Sharma,et al.  A comparison study between XR interfaces for driver assistance in take over request , 2023, Transportation Engineering.

[4]  M. V. A. Raju Bahubalendruni,et al.  Challenges and opportunities on AR/VR technologies for manufacturing systems in the context of industry 4.0: A state of the art review , 2022, Journal of Manufacturing Systems.

[5]  M. Żukowska,et al.  Risk Assessment of Individualized 3D Printed Prostheses Using Failure Mode and Effect Analysis , 2022, Advances in Science and Technology Research Journal.

[6]  M. Żukowska,et al.  Automated Design and Rapid Manufacturing of Low-Cost Customized Upper Limb Prostheses , 2022, Journal of Physics: Conference Series.

[7]  Frédéric Noël,et al.  A Comparative Study of Interaction Time and Usability of Using Controllers and Hand Tracking in Virtual Reality Training , 2021, Informatics.

[8]  M. Żukowska,et al.  Study on Properties of Automatically Designed 3D-Printed Customized Prosthetic Sockets , 2021, Materials.

[9]  J. Mathews.  Purposes , 2021, Examinations.

[10]  Filip Gorski,et al.  Use of Virtual Mirror in Design of Individualized Orthopedic Supplies , 2021, Lecture Notes in Mechanical Engineering.

[11]  J. Duarte,et al.  Augmented Reality in Education: An Overview of Twenty-Five Years of Research , 2021, Contemporary Educational Technology.

[12]  Rosanna Maria Viglialoro,et al.  Augmented Reality, Mixed Reality, and Hybrid Approach in Healthcare Simulation: A Systematic Review , 2021, Applied Sciences.

[13]  M. Minoufekr.  Holo Study – Mixed Reality Framework for Industrial Engineering Education and Training , 2020, Trends in Technical & Scientific Research.

[14]  Fillia Makedon,et al.  A Review of Extended Reality (XR) Technologies for Manufacturing Training , 2020, Technologies.

[15]  Sarah Day,et al.  3D-Printing and upper-limb prosthetic sockets; promises and pitfalls , 2020, bioRxiv.

[16]  Filip Górski,et al.  Experimental Studies on 3D Printing of Automatically Designed Customized Wrist-Hand Orthoses , 2020, Materials.

[17]  J. Fergason,et al.  Technological Advances in Prosthesis Design and Rehabilitation Following Upper Extremity Limb Loss , 2020, Current Reviews in Musculoskeletal Medicine.

[18]  Tariq Masood,et al.  Augmented reality in support of intelligent manufacturing - A systematic literature review , 2020, Comput. Ind. Eng..

[19]  David Rodríguez Salgado,et al.  Advances in Orthotic and Prosthetic Manufacturing: A Technology Review , 2020, Materials.

[20]  Jens T Verhey,et al.  Virtual, augmented, and mixed reality applications in orthopedic surgery , 2019, The international journal of medical robotics + computer assisted surgery : MRCAS.

[21]  Andrzej A. Kononowicz,et al.  Virtual Reality for Health Professions Education: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration , 2019, Journal of medical Internet research.

[22]  Nitish V. Thakor,et al.  A Mixed-Reality Training Environment for Upper Limb Prosthesis Control , 2018, 2018 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[23]  Claudio Pacchierotti,et al.  A Wearable Haptic System for the Health Monitoring of Elderly People in Smart Cities , 2018, Int. J. Online Eng..

[24]  Mark S Thompson,et al.  Three-dimensional printed upper-limb prostheses lack randomised controlled trials: A systematic review , 2017, Prosthetics and orthotics international.

[25]  Gerwin Smit,et al.  3D-printed upper limb prostheses: a review , 2017, Disability and rehabilitation. Assistive technology.

[26]  Przemysław Zawadzki,et al.  Smart product design and production control for effective mass customization in the Industry 4.0 concept , 2016 .

[27]  Bijan Pesaran,et al.  A training platform for many-dimensional prosthetic devices using a virtual reality environment , 2015, Journal of Neuroscience Methods.

[28]  Chris Roast,et al.  Exploring virtual reality and prosthetic training , 2015, 2015 IEEE Virtual Reality (VR).

[29]  E. Biddiss,et al.  Multivariate prediction of upper limb prosthesis acceptance or rejection , 2008, Disability and rehabilitation. Assistive technology.

[30]  M. Hauschild,et al.  A Virtual Reality Environment for Designing and Fitting Neural Prosthetic Limbs , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[32]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[33]  F. Sanfilippo,et al.  A Fully-Immersive Hapto-Audio-Visual Framework for Remote Touch , 2015 .