RGB-D-Based Method for Measuring the Angular Range of Hip and Knee Joints during Home Care Rehabilitation

Home-based rehabilitation is becoming a gold standard for patient who have undergone knee arthroplasty or full knee replacement, as it helps healthcare costs to be minimized. Nevertheless, there is a chance of increasing adverse health effects in case of home care, primarily due to the patients’ lack of motivation and the doctors’ difficulty in carrying out rigorous supervision. The development of devices to assess the efficient recovery of the operated joint is highly valued both for the patient, who feels encouraged to perform the proper number of activities, and for the doctor, who can track him/her remotely. Accordingly, this paper introduces an interactive approach to angular range calculation of hip and knee joints based on the use of low-cost devices which can be operated at home. First, the patient’s body posture is estimated using a 2D acquisition method. Subsequently, the 3D posture is evaluated by using the depth information coming from an RGB-D sensor. Preliminary results show that the proposed method effectively overcomes many limitations by fusing the results obtained by the state-of-the-art robust 2D pose estimation algorithms with the 3D data of depth cameras by allowing the patient to be correctly tracked during rehabilitation exercises.

[1]  Haidawati Nasir,et al.  Accurate Shoulder Joint Angle Estimation Using Single RGB camera for Rehabilitation , 2019, 2019 IEEE International Instrumentation and Measurement Technology Conference (I2MTC).

[2]  A. Nilsdotter,et al.  Fast-Track Programs in Total Hip and Knee Replacement at Swedish Hospitals—Influence on 2-Year Risk of Revision and Mortality , 2021, Journal of clinical medicine.

[3]  Margaret Ansell,et al.  Managing osteoarthritis pain with smart technology: a narrative review , 2021, Rheumatology advances in practice.

[4]  Z. Stjepanovic,et al.  Study Regarding the Kinematic 3D Human-Body Model Intended for Simulation of Personalized Clothes for a Sitting Posture , 2021, Materials.

[5]  Hyun Myung,et al.  Real-Time Human Pose Estimation and Gesture Recognition from Depth Images Using Superpixels and SVM Classifier , 2015, Sensors.

[6]  K. Aminian,et al.  Ambulatory measurement of 3D knee joint angle. , 2008, Journal of biomechanics.

[7]  A. Malviya,et al.  Reduced short-term complications and mortality following Enhanced Recovery primary hip and knee arthroplasty: results from 6,000 consecutive procedures , 2014, Acta orthopaedica.

[8]  Björn Krüger,et al.  An Efficient 3D Human Pose Retrieval and Reconstruction from 2D Image-Based Landmarks , 2021, Sensors.

[9]  Thomas Seel,et al.  IMU-Based Joint Angle Measurement for Gait Analysis , 2014, Sensors.

[10]  Noel E. O'Connor,et al.  Evaluating a dancer's performance using kinect-based skeleton tracking , 2011, ACM Multimedia.

[11]  M. Di Monaco,et al.  Rehabilitation after total hip arthroplasty: a systematic review of controlled trials on physical exercise programs. , 2009, European journal of physical and rehabilitation medicine.

[12]  Petros Daras,et al.  DeepMoCap: Deep Optical Motion Capture Using Multiple Depth Sensors and Retro-Reflectors , 2019, Sensors.

[13]  M. Tyrakowski,et al.  Shaft Fractures in Patients Requiring Primary or Revision Total Knee Arthroplasty Can Be Successfully Treated with Long-Stemmed Implants without Additional Fixation , 2021, Journal of clinical medicine.

[14]  J. Coughlin,et al.  PERSPECTIVE: Older Adults' Adoption of Technology: An Integrated Approach to Identifying Determinants and Barriers , 2015 .

[15]  M. Al-Amri,et al.  Applications of Wearable Technology in a Real-Life Setting in People with Knee Osteoarthritis: A Systematic Scoping Review , 2021, Journal of clinical medicine.

[16]  V. Denaro,et al.  Preoperative and Perioperative Predictors of Length of Hospital Stay after Primary Total Hip Arthroplasty—Our Experience on 743 Cases , 2021, Journal of clinical medicine.

[17]  Marko Munih,et al.  Estimation of Joint Forces and Moments for the In-Run and Take-Off in Ski Jumping Based on Measurements with Wearable Inertial Sensors , 2015, Sensors.

[18]  N. Bachl,et al.  Physical Activity, Exercise Prescription for Health and Home-Based Rehabilitation , 2020 .

[19]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Monica Carfagni,et al.  A Preliminary 3D Depth Camera-Based System to Assist Home Physiotherapy Rehabilitation , 2019, DSMIE-2019.

[21]  Ioannis Vourganas,et al.  Evaluation of Home-Based Rehabilitation Sensing Systems with Respect to Standardised Clinical Tests , 2019, Sensors.

[22]  Lapo Governi,et al.  A RGB-D based instant body-scanning solution for compact box installation , 2017 .