A Game-Based Learning Framework For Controlling Brain-Actuated Wheelchairs

Paraplegia is a disability caused by impairment in motor or sensory functions of the lower limbs. Most paraplegic subjects use mechanical wheelchairs for their movement, however, patients with reduced upper limb functionality may benefit from the use of motorised, electric wheelchairs. Depending on the patient, learning how to control these wheelchairs can be hard (if at all possible), timeconsuming, demotivating, and to some extent dangerous. This paper proposes a game-based learning framework for training these patients in a safe, virtual environment. Specifically, the framework utilises the Emotiv EPOC EEG headset to enable brain wave control of a virtual electric wheelchair in a realistic virtual world game environment created with the Unity 3D game engine.

[1]  B. Yegnanarayana,et al.  Artificial Neural Networks , 2004 .

[2]  M. Nuttin,et al.  Asynchronous non-invasive brain-actuated control of an intelligent wheelchair , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  F. Sanfilippo,et al.  A mapping approach for controlling different maritime cranes and robots using ANN , 2014, 2014 IEEE International Conference on Mechatronics and Automation.

[4]  G. Vanacker,et al.  Adaptive Shared Control of a Brain-Actuated Simulated Wheelchair , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[5]  D. Craig,et al.  Adaptive EEG Thought Pattern Classifier for Advanced Wheelchair Control , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  Filippo Sanfilippo,et al.  Optimisation Of Boids Swarm Model Based On Genetic Algorithm And Particle Swarm Optimisation Algorithm (Comparative Study) , 2014, ECMS.

[7]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[8]  J. D. Fletcher,et al.  Game-Based Learning , 2014 .

[9]  Birger Skogeng Pedersen,et al.  A computer-automated design tool for intelligent virtual prototyping of offshore cranes , 2015 .

[10]  Kristin Ytterstad Pettersen,et al.  Integrated Flexible Maritime Crane Architecture for the Offshore Simulation Centre AS (OSC): A Flexible Framework for Alternative Maritime Crane Control Algorithms , 2016, IEEE Journal of Oceanic Engineering.

[11]  Ronald M. Aarts,et al.  A Survey of Stimulation Methods Used in SSVEP-Based BCIs , 2010, Comput. Intell. Neurosci..

[12]  A. Walker Electroencephalography, Basic Principles, Clinical Applications and Related Fields , 1982 .

[13]  Kristin Ytterstad Pettersen,et al.  A universal control architecture for maritime cranes and robots using genetic algorithms as a possible mapping approach , 2013, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[14]  F. Sanfilippo,et al.  A Fully-Immersive Hapto-Audio-Visual Framework for Remote Touch , 2015 .

[15]  T. J. La Vaque,et al.  The History of EEG Hans Berger: Psychophysiologist. A Historical Vignette , 1999 .

[16]  Filippo Sanfilippo,et al.  On Usage Of EEG Brain Control For Rehabilitation Of Stroke Patients , 2016, ECMS.

[17]  W. Klimesch EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[18]  Filippo Sanfilippo,et al.  JIOP: A Java Intelligent Optimisation And Machine Learning Framework , 2014, ECMS.

[19]  Tarja Susi,et al.  Serious Games : An Overview , 2007 .

[20]  Hans Georg Schaathun,et al.  A Simulation Study of Evaluation Heuristics for Tug Fleet Optimisation Algorithms , 2015, ICORES.

[21]  Kazuo Tanaka,et al.  Electroencephalogram-based control of an electric wheelchair , 2005, IEEE Transactions on Robotics.

[22]  Gernot R. Müller-Putz,et al.  Self-Paced (Asynchronous) BCI Control of a Wheelchair in Virtual Environments: A Case Study with a Tetraplegic , 2007, Comput. Intell. Neurosci..

[23]  Thierry Dutoit,et al.  Performance of the Emotiv Epoc headset for P300-based applications , 2013, Biomedical engineering online.