Development of a Wearable Human-Machine Interface to Track Forearm Rotation via an Optical Sensor

The goal of this research was to develop an intuitive wearable human-machine interface (HMI), utilizing an optical sensor. The proposed system quantifies wrist pronation and supination using an optical displacement sensor. Compared with existing systems, this HMI ensures intuitiveness by relying on direct measurement of forearm position, minimizes involved sensors, and is expected to be long-lasting. To test for feasibility, the developed HMI was implemented to control a prosthetic wrist based on forearm rotation of able-bodied subjects. Performance of optical sensor system (OSS) prosthesis control was compared to electromyography (EMG) based direct control, for six able-bodied individuals, using a clothespin relocation task. Results showed that the performance of OSS control was comparable to direct control, therefore validating the feasibility of the OSS HMI.

[1]  Fan Zhang,et al.  Application of Cognitive Task Performance Modeling for Assessing Usability of Transradial Prostheses , 2019, IEEE Transactions on Human-Machine Systems.

[2]  Lizhi Pan,et al.  Myoelectric Control Based on a Generic Musculoskeletal Model: Toward a Multi-User Neural-Machine Interface , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Blair A. Lock,et al.  Adaptive Pattern Recognition of Myoelectric Signals: Exploration of Conceptual Framework and Practical Algorithms , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  Han Gil Seo,et al.  Inertial Measurement Unit Based Upper Extremity Motion Characterization for Action Research Arm Test and Activities of Daily Living , 2019, Sensors.

[5]  Xingchen Yang,et al.  A Wearable Ultrasound System for Sensing Muscular Morphological Deformations , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[6]  Aitor Cazón-Martín,et al.  Wearable Design Requirements Identification and Evaluation , 2020, Sensors.

[7]  Dennis C. Tkach,et al.  Study of stability of time-domain features for electromyographic pattern recognition , 2010, Journal of NeuroEngineering and Rehabilitation.

[8]  Futoshi Kobayashi,et al.  Hand/Arm Robot Teleoperation by Inertial Motion Capture , 2013, 2013 Second International Conference on Robot, Vision and Signal Processing.

[9]  Jörn Hurtienne,et al.  Intuitive Use of User Interfaces: Defining a Vague Concept , 2007, HCI.

[10]  Fan Zhang,et al.  Design of a robust EMG sensing interface for pattern classification , 2010, Journal of neural engineering.

[11]  Luke Roberts,et al.  Slip detection and grip adjustment using optical tracking in prosthetic hands , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Matthew M. Wernke.  Quantification of transhumeral prosthetic socket residual limb interface movement using motion capture and a slip detection sensor , 2013 .

[13]  Marcel Tresanchez,et al.  The optical mouse sensor as an incremental rotary encoder , 2009 .

[14]  Carme Torras,et al.  Development and Pilot Evaluation of the ArmTracker: A Wearable System to Monitor Arm Kinematics During Daily Life , 2020, 2020 8th IEEE RAS/EMBS International Conference for Biomedical Robotics and Biomechatronics (BioRob).

[15]  Win Tun Latt,et al.  Drift-Free Position Estimation of Periodic or Quasi-Periodic Motion Using Inertial Sensors , 2011, Sensors.

[16]  Anna T. Winslow,et al.  Evaluation of EMG pattern recognition for upper limb prosthesis control: a case study in comparison with direct myoelectric control , 2018, Journal of NeuroEngineering and Rehabilitation.

[17]  S. K. Wee,et al.  Effects of a robot-assisted training of grasp and pronation/supination in chronic stroke: a pilot study , 2011, Journal of NeuroEngineering and Rehabilitation.

[18]  David B. Kaber,et al.  Usability Comparison of Conventional Direct Control Versus Pattern Recognition Control of Transradial Prostheses , 2017, IEEE Transactions on Human-Machine Systems.

[19]  Jong-Hoon Kim,et al.  Interface for Human Machine Interaction for assistant devices: A Review , 2020, 2020 10th Annual Computing and Communication Workshop and Conference (CCWC).

[20]  Koji Nakamaru,et al.  Three-dimensional motion of the upper extremity joints during various activities of daily living. , 2010, Journal of biomechanics.

[21]  M. O'Malley.  Principles of Human-Machine Interfaces and Interactions , 2018 .

[22]  Hamidreza N. Sani,et al.  Characterizing the performance of an optical slip sensor for grip control in a prosthesis , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Brian D Lowe,et al.  Accuracy and validity of observational estimates of wrist and forearm posture , 2004, Ergonomics.

[24]  Philipp Beckerle,et al.  A Sensor Array for the Measurement of Relative Motion in Lower Limb Prosthetic Sockets , 2019, Sensors.

[25]  Fan Zhang,et al.  Cognitive workload in conventional direct control vs. pattern recognition control of an upper-limb prosthesis , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[26]  Yinfeng Fang,et al.  Simultaneous Prediction of Wrist/Hand Motion via Wearable Ultrasound Sensing , 2020, IEEE Transactions on Neural Systems and Rehabilitation Engineering.