Development of a Learning-Based Intention Detection Framework for Power-Assisted Manual Wheelchair Users

Pushrim-activated power-assisted wheels (PAPAWs) are assistive technologies that provide on-demand assistance to wheelchair users. PAPAWs operate based on a collaborative control scheme. Therefore, they rely on accurate interpretation of the user’s intent to provide effective propulsion assistance. This paper presents a learning-based approach to predict wheelchair users’ intention when performing a variety of wheelchair activities. We obtained kinematic and kinetic data from manual wheelchair users when performing standard wheelchair activities such as turns and ascents. Our measurements revealed variability in physical capabilities and propulsion habits of different users, therefore, highlighting the need for the development of personalized intention inference models. We used Gaussian Mixture models to label different phases of user-pushrim interactions based on individual user’s wheeling behaviour. Supervised classifiers were trained with each user’s data and these models were used to predict the user’s intentions during different propulsion activities. We found random forest classifiers had high accuracy (>92%) in predicting different states of individual-specific wheelchair propulsion and user intent for 2 participants. This proposed framework is computationally efficient and can be used for real-time prediction of wheelchair users’ intention. The outcome of this clustering-classification pipeline provides relevant information for designing user-specific and adaptive PAPAW controllers.

[1]  William C Mann,et al.  Variable-ratio pushrim-activated power-assist wheelchair eases wheeling over a variety of terrains for elders. , 2004, Archives of physical medicine and rehabilitation.

[2]  Kanghyun Nam,et al.  Two-dimensional assist control for power-assisted wheelchair considering straight and rotational motion decomposition , 2012, IECON 2012 - 38th Annual Conference on IEEE Industrial Electronics Society.

[3]  Johan S Rietman,et al.  A systematic review on the pros and cons of using a pushrim-activated power-assisted wheelchair , 2013, Clinical rehabilitation.

[4]  R.A. Cooper,et al.  Electric powered wheelchairs , 2005, IEEE Control Systems.

[5]  Rory A Cooper,et al.  SMARTWheel: From Concept to Clinical Practice , 2009, Prosthetics and orthotics international.

[6]  Rory A Cooper,et al.  A kinetic analysis of manual wheelchair propulsion during start-up on select indoor and outdoor surfaces. , 2005, Journal of rehabilitation research and development.

[7]  H. Seki,et al.  Straight and circular road driving control of power assisted wheelchair based on balanced assisted torque , 2005, 31st Annual Conference of IEEE Industrial Electronics Society, 2005. IECON 2005..

[8]  Kevin Ta,et al.  Development of A Learning-Based Terrain Classification Framework for Pushrim-Activated Power-Assisted Wheelchairs* , 2020, 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC).

[9]  Alicia M Koontz,et al.  Filter frequency selection for manual wheelchair biomechanics. , 2002, Journal of rehabilitation research and development.

[10]  Hendrik Van Brussel,et al.  Assessing the user's intent using bayes' rule : application to wheelchair control , 2003 .

[11]  Krista L Best,et al.  The wheelchair skills test (version 2.4): measurement properties. , 2004, Archives of physical medicine and rehabilitation.

[12]  H. F. Machiel Van der Loos,et al.  Towards the Development of a Learning-Based Intention Classification Framework for Pushrim-Activated Power-Assisted Wheelchairs , 2019, 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR).

[13]  Rory A. Cooper,et al.  Performance assessment of a pushrim-activated power-assisted wheelchair control system , 2002, IEEE Trans. Control. Syst. Technol..

[14]  Martin Buss,et al.  An HMM approach to realistic haptic human-robot interaction , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[15]  Datong Qin,et al.  Driving Intention Identification Based on Long Short-Term Memory and A Case Study in Shifting Strategy Optimization , 2019, IEEE Access.

[16]  Thierry Marie Guerra,et al.  Observer-Based Assistive Control Design Under Time-Varying Sampling for Power-Assisted Wheelchairs , 2018 .

[17]  Alicia M Koontz,et al.  Relationship between linear velocity and tangential push force while turning to change the direction of the manual wheelchair , 2017, Biomedizinische Technik. Biomedical engineering.

[18]  Jaime Valls Miró,et al.  POMDP-based long-term user intention prediction for wheelchair navigation , 2008, 2008 IEEE International Conference on Robotics and Automation.

[19]  John W Chow,et al.  Wheelchair Users' Perceptions of and Experiences with Power Assist Wheels , 2010, American journal of physical medicine & rehabilitation.

[20]  Pingzhi Fan,et al.  A Driving Intention Prediction Method Based on Hidden Markov Model for Autonomous Driving , 2019, Comput. Commun..

[21]  Tae-Ho Choi,et al.  Torque balancing for power assisted wheelchair based on torque and temporal similarity , 2015 .

[22]  H. F. M. Van der Loos,et al.  An overview of power-assisted pushrim-activated wheelchair control strategies , 2019 .

[23]  Rory C. Flemmer,et al.  A review of manual wheelchairs , 2016, Disability and rehabilitation. Assistive technology.

[24]  K. Kosuge,et al.  A New Control Approach for a Robotic Walking Support System in Adapting User Characteristics , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[25]  Carl E. Rasmussen,et al.  The Infinite Gaussian Mixture Model , 1999, NIPS.

[26]  Yskandar Hamam,et al.  A Driving Behaviour Model of Electrical Wheelchair Users , 2016, Comput. Intell. Neurosci..

[27]  Michael L Boninger,et al.  Redefining the manual wheelchair stroke cycle: identification and impact of nonpropulsive pushrim contact. , 2009, Archives of physical medicine and rehabilitation.

[28]  Ioannis A. Kakadiaris,et al.  A Review of Human Activity Recognition Methods , 2015, Front. Robot. AI.

[29]  Hendrik Van Brussel,et al.  Adaptable navigational assistance for intelligent wheelchairs by means of an implicit personalized user model , 2010, Robotics Auton. Syst..