Automatic Functional Shoulder Task Identification and Sub-Task Segmentation Using Wearable Inertial Measurement Units for Frozen Shoulder Assessment

Advanced sensor technologies have been applied to support frozen shoulder assessment. Sensor-based assessment tools provide objective, continuous and quantitative information for evaluation and diagnosis. However, the current tools for assessment of functional shoulder tasks mainly rely on manual operation. It may cause several technical issues to the reliability and usability of the assessment tool, including manual bias during the recording and additional efforts for data labeling. To tackle these issues, this pilot study aims to propose an automatic functional shoulder task identification and sub-task segmentation system using inertial measurement units to provide reliable shoulder task labeling and sub-task information for clinical professionals. The proposed method combines machine learning models and rule-based modification to identify shoulder tasks and segment sub-tasks accurately. A hierarchical design is applied to enhance the efficiency and performance of the proposed approach. Nine healthy subjects and nine frozen shoulder patients are invited to perform five common shoulder tasks in the lab-based and clinical environments, respectively. The experimental results show that the proposed method can achieve 87.11% F-score for shoulder task identification, and 83.23% F-score and 427 mean absolute time errors (milliseconds) for sub-task segmentation. The proposed approach demonstrates the feasibility of the proposed method to support reliable evaluation for clinical assessment.

[1]  M. Meeus,et al.  Current evidence on physical therapy in patients with adhesive capsulitis: what are we missing? , 2014, Clinical Rheumatology.

[2]  Yujie Dong,et al.  Detecting Periods of Eating During Free-Living by Tracking Wrist Motion , 2014, IEEE Journal of Biomedical and Health Informatics.

[3]  Diego Torricelli,et al.  Quantitative assessment based on kinematic measures of functional impairments during upper extremity movements: A review. , 2014, Clinical biomechanics.

[4]  Paul Lukowicz,et al.  Performance metrics for activity recognition , 2011, TIST.

[5]  Xiaohui Peng,et al.  Deep Learning for Sensor-based Activity Recognition: A Survey , 2017, Pattern Recognit. Lett..

[6]  Lauren Beaupre,et al.  Evaluating change in clinical status: reliability and measures of agreement for the assessment of glenohumeral range of motion. , 2010, North American journal of sports physical therapy : NAJSPT.

[7]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[8]  Kamiar Aminian,et al.  Estimating dominant upper-limb segments during daily activity. , 2008, Gait & posture.

[9]  Peter I Sallay,et al.  The measurement of normative American Shoulder and Elbow Surgeons scores. , 2003, Journal of shoulder and elbow surgery.

[10]  Montse Ferrer,et al.  Evaluation of shoulder-specific patient-reported outcome measures: a systematic and standardized comparison of available evidence. , 2014, Journal of shoulder and elbow surgery.

[11]  Ashraf A Ragab,et al.  Validity of self-assessment outcome questionnaires: patient-physician discrepancy in outcome interpretation. , 2003, Biomedical sciences instrumentation.

[12]  Bernt Schiele,et al.  A tutorial on human activity recognition using body-worn inertial sensors , 2014, CSUR.

[13]  Björn Eskofier,et al.  Timed Up-and-Go phase segmentation in Parkinson's disease patients using unobtrusive inertial sensors , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[14]  A. Carr,et al.  The use of a patient-based questionnaire (the Oxford Shoulder Score) to assess outcome after rotator cuff repair. , 2008, Annals of the Royal College of Surgeons of England.

[15]  A. Weiss,et al.  Adhesive capsulitis of the shoulder. , 1993, Orthopaedic review.

[16]  Hongnian Yu,et al.  Elderly activities recognition and classification for applications in assisted living , 2013, Expert Syst. Appl..

[17]  Jonathan Feng-Shun Lin,et al.  Online Segmentation of Human Motion for Automated Rehabilitation Exercise Analysis , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Pablo Aqueveque,et al.  Use of a Single Wireless IMU for the Segmentation and Automatic Analysis of Activities Performed in the 3-m Timed Up & Go Test , 2019, Sensors.

[19]  Kamiar Aminian,et al.  Outcome evaluation in shoulder surgery using 3D kinematics sensors. , 2007, Gait & posture.

[20]  Luckshman Bavan,et al.  Instrumented assessment of shoulder function: A study of inertial sensor based methods. , 2019, Clinical biomechanics.

[21]  Paula M Ludewig,et al.  Shoulder kinematics in subjects with frozen shoulder. , 2003, Archives of physical medicine and rehabilitation.

[22]  Erik Scheme,et al.  Automation of the Timed-Up-and-Go Test Using a Conventional Video Camera , 2020, IEEE Journal of Biomedical and Health Informatics.

[23]  Héctor Pomares,et al.  Window Size Impact in Human Activity Recognition , 2014, Sensors.

[24]  P H Veltink,et al.  Ambulatory measurement of arm orientation. , 2007, Journal of biomechanics.

[25]  Koushik Maharatna,et al.  Rehab-Net: Deep Learning Framework for Arm Movement Classification Using Wearable Sensors for Stroke Rehabilitation , 2019, IEEE Transactions on Biomedical Engineering.

[26]  Gina Sprint,et al.  Toward Automating Clinical Assessments: A Survey of the Timed Up and Go , 2015, IEEE Reviews in Biomedical Engineering.

[27]  Barry R. Greene,et al.  Assessment of Cognitive Decline Through Quantitative Analysis of the Timed Up and Go Test , 2012, IEEE Transactions on Biomedical Engineering.

[28]  Steffen Ortmann,et al.  Recognizing upper limb movements with wrist worn inertial sensors using k-means clustering classification. , 2015, Human movement science.

[29]  Kamiar Aminian,et al.  Heightened clinical utility of smartphone versus body-worn inertial system for shoulder function B-B score , 2017, PloS one.

[30]  Andrew Sexton,et al.  Convergent Validity of a Wearable Sensor System for Measuring Sub-Task Performance during the Timed Up-and-Go Test , 2017, Sensors.

[31]  Barry R. Greene,et al.  Quantitative Falls Risk Assessment Using the Timed Up and Go Test , 2010, IEEE Transactions on Biomedical Engineering.

[32]  J. McAuley,et al.  Shoulder Pain and Disability Index (SPADI). , 2011, Journal of physiotherapy.

[33]  Agnès Roby-Brami,et al.  Relationship of glenohumeral elevation and 3-dimensional scapular kinematics with disability in patients with shoulder disorders. , 2008, Journal of rehabilitation medicine.

[34]  Evangelos Kalogerakis,et al.  RisQ: recognizing smoking gestures with inertial sensors on a wristband , 2014, MobiSys.

[35]  B Grimm,et al.  Inertia based functional scoring of the shoulder in clinical practice. , 2014, Physiological measurement.

[36]  Jean-Sébastien Roy,et al.  Measuring shoulder function: a systematic review of four questionnaires. , 2009, Arthritis and rheumatism.

[37]  P. McClure,et al.  Frozen shoulder: evidence and a proposed model guiding rehabilitation. , 2009, The Journal of orthopaedic and sports physical therapy.

[38]  L. Chiari,et al.  Quantification of Motor Impairment in Parkinson's Disease Using an Instrumented Timed Up and Go Test , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[39]  Rob van der Straaten,et al.  Assessment of Scapulothoracic, Glenohumeral, and Elbow Motion in Adhesive Capsulitis by Means of Inertial Sensor Technology: A Within-Session, Intra-Operator and Inter-Operator Reliability and Agreement Study , 2020, Sensors.

[40]  Amee L. Seitz,et al.  Shoulder pain and mobility deficits: adhesive capsulitis. , 2013, The Journal of orthopaedic and sports physical therapy.