An adaptive self-organizing fuzzy logic controller in a serious game for motor impairment rehabilitation

Rehabiliation robotics combined with video game technology provides a means of assisting in the rehabilitation of patients with neuromuscular disorders by performing various facilitation movements. The current work presents ReHabGame, a serious game using a fusion of implemented technologies that can be easily used by patients and therapists to assess and enhance sensorimotor performance and also increase the activities in the daily lives of patients. The game allows a player to control avatar movements through a Kinect Xbox, Myo armband and rudder foot pedal, and involves a series of reach-grasp-collect tasks whose difficulty levels are learnt by a fuzzy interface. The orientation, angular velocity, head and spine tilts and other data generated by the player are monitored and saved, whilst the task completion is calculated by solving an inverse kinematics algorithm which orientates the upper limb joints of the avatar. The different values in upper body quantities of movement provide fuzzy input from which crisp output is determined and used to generate an appropriate subsequent rehabilitation game level. The system can thus provide personalised, autonomously-learnt rehabilitation programmes for patients with neuromuscular disorders with superior predictions to guide the development of improved clinical protocols compared to traditional theraputic activities.

[1]  Piotr Czekalski,et al.  EVOLUTION-FUZZY RULE BASED SYSTEM WITH PARAMETERIZED CONSEQUENCES , 2006 .

[2]  Chul Seung Kim,et al.  Control configuration for upper limb rehabilitation robotic systems , 2015, 2015 15th International Conference on Control, Automation and Systems (ICCAS).

[3]  Eleni Stroulia,et al.  Serious games: Rehabilitation fuzzy grammar for exercise and therapy compliance , 2015, 2015 IEEE Games Entertainment Media Conference (GEM).

[4]  J. Buckley,et al.  Fuzzy expert systems and fuzzy reasoning , 2004 .

[5]  Nicolae Dumitru,et al.  Analysis of Human Arm Joints and Extension of the Study to Robot Manipulator , 2009 .

[6]  Derek J. Lura,et al.  The Creation of a Robotics Based Human Upper Body Model for Predictive Simulation of Prostheses Performance , 2012 .

[7]  Natalia Dounskaia,et al.  Control of Human Limb Movements: The Leading Joint Hypothesis and Its Practical Applications , 2010, Exercise and sport sciences reviews.

[8]  Marimuthu Palaniswami,et al.  Computational Intelligence in Gait Research: A Perspective on Current Applications and Future Challenges , 2009, IEEE Transactions on Information Technology in Biomedicine.

[9]  Z. Moussavi,et al.  Formation of an Internal Model of Environment Dynamics During Upper Limb Reaching Movements: A Fuzzy Approach , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  John H. Lilly,et al.  Fuzzy Control and Identification , 2010 .

[11]  M. F. Zarandi,et al.  Reinforcement Learning for Fuzzy Control with Linguistic States , 2007 .

[12]  Erin D. Bigler,et al.  Mild traumatic brain injury: The elusive timing of “recovery” , 2012, Neuroscience Letters.

[13]  Alex Mihailidis,et al.  Development of a fuzzy logic based intelligent system for autonomous guidance of post-stroke rehabilitation exercise , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[14]  Chunyan Miao,et al.  A fuzzy logic based Parkinson's Disease risk predictor , 2014, 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[15]  Abdulmotaleb El-Saddik,et al.  A Fuzzy-Based Adaptive Rehabilitation Framework for Home-Based Wrist Training , 2014, IEEE Transactions on Instrumentation and Measurement.

[16]  Lotfi A. Zadeh,et al.  The role of fuzzy logic in modeling, identification and control , 1996 .

[17]  Sheng Quan Xie,et al.  An iterative fuzzy controller for pneumatic muscle driven rehabilitation robot , 2011, Expert Syst. Appl..

[18]  Agata Nawrocka,et al.  Fuzzy logic controller for rehabilitation robot manipulator , 2014, Proceedings of the 2014 15th International Carpathian Control Conference (ICCC).

[19]  Tsan-Hsiu Yuan,et al.  Experimental Implementations of Adaptive Self-Organizing Fuzzy Slide Mode Control to a 3-DOF Rehabilitation Robot , 2008, 2008 3rd International Conference on Innovative Computing Information and Control.

[20]  Jan Kalina,et al.  The estimation of the joint angles of upper limb during walking using fuzzy logic system and relation maps , 2015, 2015 IEEE 13th International Symposium on Applied Machine Intelligence and Informatics (SAMI).

[21]  Chris Welman,et al.  INVERSE KINEMATICS AND GEOMETRIC CONSTRAINTS FOR ARTICULATED FIGURE MANIPULATION , 1993 .

[22]  Norman I. Badler,et al.  Real-Time Inverse Kinematics of the Human Arm , 1996, Presence: Teleoperators & Virtual Environments.

[23]  Abdulmotaleb El-Saddik,et al.  Haptic rehabilitation exercises performance evaluation using automated inference systems , 2009, Int. J. Adv. Media Commun..

[24]  Brian R. Gaines,et al.  The learning of perceptual-motor skills by men and machines and its relationship to training , 1972 .

[25]  E. Guglielmelli,et al.  An inverse kinematics algorithm for upper-limb joint reconstruction during robot-aided motor therapy , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[26]  Jacek M. Leski,et al.  Fuzzy and Neuro-Fuzzy Intelligent Systems , 2000, Studies in Fuzziness and Soft Computing.

[27]  Ming-Kun Chang,et al.  An adaptive self-organizing fuzzy sliding mode controller for a 2-DOF rehabilitation robot actuated by pneumatic muscle actuators , 2010 .

[28]  Li-Xin Wang,et al.  A Course In Fuzzy Systems and Control , 1996 .

[29]  Harpreet Singh,et al.  Real-Life Applications of Fuzzy Logic , 2013, Adv. Fuzzy Syst..

[30]  Pier Luca Lanzi,et al.  Self-adaptive games for rehabilitation at home , 2012, 2012 IEEE Conference on Computational Intelligence and Games (CIG).

[31]  Rafael Alcalá,et al.  Techniques for Learning and Tuning Fuzzy Rule-Based Systems for Linguistic Modeling and their Application , 2000 .

[32]  Shabnam Sadeghi Esfahlani,et al.  Intelligent Physiotherapy Through Procedural Content Generation , 2018, ArXiv.

[33]  Mark Griffiths,et al.  Video games and health , 2005, BMJ : British Medical Journal.

[34]  Francisco Herrera,et al.  Applicability of the fuzzy operators in the design of fuzzy logic controllers , 1997, Fuzzy Sets Syst..