Wireless Soft Scalp Electronics and Virtual Reality System for Motor Imagery‐Based Brain–Machine Interfaces

Motor imagery offers an excellent opportunity as a stimulus‐free paradigm for brain–machine interfaces. Conventional electroencephalography (EEG) for motor imagery requires a hair cap with multiple wired electrodes and messy gels, causing motion artifacts. Here, a wireless scalp electronic system with virtual reality for real‐time, continuous classification of motor imagery brain signals is introduced. This low‐profile, portable system integrates imperceptible microneedle electrodes and soft wireless circuits. Virtual reality addresses subject variance in detectable EEG response to motor imagery by providing clear, consistent visuals and instant biofeedback. The wearable soft system offers advantageous contact surface area and reduced electrode impedance density, resulting in significantly enhanced EEG signals and classification accuracy. The combination with convolutional neural network‐machine learning provides a real‐time, continuous motor imagery‐based brain–machine interface. With four human subjects, the scalp electronic system offers a high classification accuracy (93.22 ± 1.33% for four classes), allowing wireless, real‐time control of a virtual reality game.

[1]  Shaoyu Liu,et al.  Materials, Devices, and Systems of On‐Skin Electrodes for Electrophysiological Monitoring and Human–Machine Interfaces , 2020, Advanced science.

[2]  W. Yeo,et al.  Printed, Wireless, Soft Bioelectronics and Deep Learning Algorithm for Smart Human-Machine Interfaces. , 2020, ACS applied materials & interfaces.

[3]  Wei Li,et al.  Motor imagery EEG recognition based on conditional optimization empirical mode decomposition and multi-scale convolutional neural network , 2020, Expert Syst. Appl..

[4]  Jonathan R Wolpaw,et al.  Breathable, large-area epidermal electronic systems for recording electromyographic activity during operant conditioning of H-reflex. , 2020, Biosensors & bioelectronics.

[5]  Dongchu Chen,et al.  Towards emerging EEG applications: a novel printable flexible Ag/AgCl dry electrode array for robust recording of EEG signals at forehead sites , 2020, Journal of neural engineering.

[6]  Kaushik Parida,et al.  Emerging Soft Conductors for Bioelectronic Interfaces , 2019, Advanced Functional Materials.

[7]  Zong Qun,et al.  A novel hybrid deep learning scheme for four-class motor imagery classification , 2019, Journal of neural engineering.

[8]  Woon-Hong Yeo,et al.  Fully portable and wireless universal brain–machine interfaces enabled by flexible scalp electronics and deep learning algorithm , 2019, Nature Machine Intelligence.

[9]  T. Someya,et al.  Highly Stretchable Metallic Nanowire Networks Reinforced by the Underlying Randomly Distributed Elastic Polymer Nanofibers via Interfacial Adhesion Improvement , 2019, Advanced materials.

[10]  Jae‐Woong Jeong,et al.  Advanced Soft Materials, Sensor Integrations, and Applications of Wearable Flexible Hybrid Electronics in Healthcare, Energy, and Environment , 2019, Advanced materials.

[11]  Abdulkadir Sengur,et al.  Convolutional Neural Network Based Approach Towards Motor Imagery Tasks EEG Signals Classification , 2019, IEEE Sensors Journal.

[12]  O. Olatunji,et al.  Production of Hydrogel Microneedles from Fish Scale Biopolymer , 2019, Journal of Polymers and the Environment.

[13]  Shan Zhang,et al.  Silk‐Enabled Conformal Multifunctional Bioelectronics for Investigation of Spatiotemporal Epileptiform Activities and Multimodal Neural Encoding/Decoding , 2019, Advanced science.

[14]  Jinchang Ren,et al.  EEG-Based Brain-Computer Interfaces Using Motor-Imagery: Techniques and Challenges , 2019, Sensors.

[15]  Timothy Bretl,et al.  Large-area MRI-compatible epidermal electronic interfaces for prosthetic control and cognitive monitoring , 2019, Nature Biomedical Engineering.

[16]  Wei Guo,et al.  Matrix-Independent Highly Conductive Composites for Electrodes and Interconnects in Stretchable Electronics. , 2019, ACS applied materials & interfaces.

[17]  Reza Abiri,et al.  A comprehensive review of EEG-based brain–computer interface paradigms , 2019, Journal of neural engineering.

[18]  Christofer Hierold,et al.  Skin Conformal Polymer Electrodes for Clinical ECG and EEG Recordings , 2018, Advanced healthcare materials.

[19]  Woon-Hong Yeo,et al.  Soft Material-Enabled, Flexible Hybrid Electronics for Medicine, Healthcare, and Human-Machine Interfaces , 2018, Materials.

[20]  Guangli Li,et al.  Towards gel-free electrodes: A systematic study of electrode-skin impedance , 2017 .

[21]  Wolfram Burgard,et al.  Deep learning with convolutional neural networks for EEG decoding and visualization , 2017, Human brain mapping.

[22]  Ugur Halici,et al.  A novel deep learning approach for classification of EEG motor imagery signals , 2017, Journal of neural engineering.

[23]  Shouqian Sun,et al.  Single-trial EEG classification of motor imagery using deep convolutional neural networks , 2017 .

[24]  Kaspar Althoefer,et al.  Soft and Stretchable Sensor Using Biocompatible Electrodes and Liquid for Medical Applications , 2015, Soft robotics.

[25]  James J. S. Norton,et al.  Soft, curved electrode systems capable of integration on the auricle as a persistent brain–computer interface , 2015, Proceedings of the National Academy of Sciences.

[26]  Cwj Cees Oomens,et al.  Monitoring the penetration process of single microneedles with varying tip diameters. , 2014, Journal of the mechanical behavior of biomedical materials.

[27]  Daniel Sánchez Morillo,et al.  Dry EEG Electrodes , 2014, Sensors.

[28]  J. Contreras-Vidal,et al.  Applications of Brain–Machine Interface Systems in Stroke Recovery and Rehabilitation , 2014, Current Physical Medicine and Rehabilitation Reports.

[29]  Yonggang Huang,et al.  Multifunctional Epidermal Electronics Printed Directly Onto the Skin , 2013, Advanced materials.

[30]  Pietro Salvo,et al.  A 3D printed dry electrode for ECG/EEG recording , 2012 .

[31]  Li-Wei Ko,et al.  Review of Wireless and Wearable Electroencephalogram Systems and Brain-Computer Interfaces – A Mini-Review , 2009, Gerontology.

[32]  Valer Jurcak,et al.  10/20, 10/10, and 10/5 systems revisited: Their validity as relative head-surface-based positioning systems , 2007, NeuroImage.