论文信息 - 3D Model Generation of Human Musculoskeletal System Based on Image Processing: An Intermediary Step while Developing a Learning Solution Using Virtual and Augmented Reality

3D Model Generation of Human Musculoskeletal System Based on Image Processing: An Intermediary Step while Developing a Learning Solution Using Virtual and Augmented Reality

The aim of this paper is to describe the methods used for obtaining the 3D models of the human musculoskeletal system based on image processing. The resulted models are integrated into a system based on emerging technologies, such as VR (Virtual Reality) and AR (Augmented Reality), aimed to aid the learning process in the study of the human movement biomechanics. The constructed system is designed to be more interactive to capture the users' attention and, to achieve this, the avatar of the musculoskeletal system is animated using full body skeletal tracking of an observed user. We are presenting the software solutions used in the model generation pipeline and the benefits and drawbacks of the selected methods. Also, the early results of the system implementation are showcased along the described pipeline.

Florica Moldoveanu | Alin Moldoveanu | Alexandra Voinea

[1] François Faure,et al. Interactive Visualization of Muscle Activity During Limb Movements: Towards Enhanced Anatomy Learning , 2014, VCBM.

[2] Simon Weidert,et al. Kinect for interactive AR anatomy learning , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[3] Khaled F. Hussain,et al. Augmented Reality Applications to Traffic Operations , 2006 .

[4] Mehdi Mekni,et al. Augmented Reality : Applications , Challenges and Future Trends , 2014 .

[5] Florica Moldoveanu,et al. EFFICIENT LEARNING TECHNIQUE IN MEDICAL EDUCATION BASED ON VIRTUAL AND AUGMENTED REALITY , 2016 .

[6] Florica Moldoveanu,et al. Motion detection and rendering for upper limb post-stroke rehabilitation: Multimedia applications for medical and healthcare education and learning; Rehabilitative and assistive technologies , 2015, 2015 E-Health and Bioengineering Conference (EHB).