A Novel Approach to EEG Neurofeedback via Reinforcement Learning

Since the invention of EEG brain scanning technology, cognitive response modeling and brain state optimization has been a topic of great interest and value. In particular, applications for improving musical therapy via neurofeedback have shown promise for brain state optimization.Here, we propose a novel Humanistically Intelligent (HI) system where brain waves are interpreted by a real-time deep reinforcement learning agent that controls an audio modulation system in order for the user to achieve a target brain state. The modulated audio is then visualized using a simulated Sequential Wave Imprinting Machine (SWIM). In our tests comparing the proposed system to a conventional neurofeedback system, we found that the proposed system consistently led to a more meditative brain state with p = 0.06.We show that the proposed system is promising for brain state optimization tasks, advancing the intelligent utilization of EEG brain scan data in Humanistically Intelligent feedback loops.

[1]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[2]  Steve Mann Guest Editor's Introduction: Wearable Computing-Toward Humanistic Intelligence , 2001, IEEE Intell. Syst..

[3]  Steve Mann Wearable Computing: Toward Humanistic Intelligence , 2001 .

[4]  James Zou,et al.  The Effects of Memory Replay in Reinforcement Learning , 2017, 2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[5]  Ben J. A. Kröse,et al.  Learning from delayed rewards , 1995, Robotics Auton. Syst..

[6]  Sergio I. Giraldo,et al.  Musical neurofeedback for treating depression in elderly people , 2015, Front. Neurosci..

[7]  Klaus Linkenkaer-Hansen,et al.  Controlling the Temporal Structure of Brain Oscillations by Focused Attention Meditation , 2018, Human brain mapping.

[8]  Steve Mann,et al.  Phenomenologically Augmented Reality With New Wearable LED Sequential Wave Imprinting Machines , 2017, Tangible and Embedded Interaction.

[9]  Steve Mann,et al.  Phenomenological Augmented Reality with the Sequential Wave Imprinting Machine (SWIM) , 2018, 2018 IEEE Games, Entertainment, Media Conference (GEM).

[10]  Steve Mann,et al.  Electrical Engineering Design with the Subconscious Mind , 2020, 2020 IEEE International Conference on Human-Machine Systems (ICHMS).

[11]  René J. Huster,et al.  EEG-Neurofeedback as a Tool to Modulate Cognition and Behavior: A Review Tutorial , 2017, Front. Hum. Neurosci..

[12]  Yaoliang Yu,et al.  Distributional Reinforcement Learning for Efficient Exploration , 2019, ICML.