A fully-wearable non-invasive SSVEP-based BCI system enabled by AR techniques for daily use in real environment.

This thesis aims to explore the design and implementation of Brain Computer Interfaces (BCIs) specifically for non medical scenarios, and therefore to propose a solution that overcomes typical drawbacks of existing systems such as long and uncomfortable setup time, scarce or nonexistent mobility, and poor real-time performance. The research starts from the design and implementation of a plug-and-play wearable low-power BCI that is capable of decoding up to eight commands displayed on a LCD screen, with about 2 seconds of latency. The thesis also addresses the issues emerging from the usage of the BCI during a walk in a real environment while tracking the subject via indoor positioning system. Furthermore, the BCI is then enhanced with a smart glasses device that projects the BCI visual interface with augmented reality (AR) techniques, unbinding the system usage from the need of infrastructures in the surrounding environment.

[1]  Christian Laugier,et al.  Controlling a Wheelchair Indoors Using Thought , 2007, IEEE Intelligent Systems.

[2]  Jenq-Shiou Leu,et al.  Implementation and analysis of Hybrid Wireless Indoor Positioning with iBeacon and Wi-Fi , 2016, 2016 8th International Congress on Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT).

[3]  Xiaorong Gao,et al.  An online multi-channel SSVEP-based brain–computer interface using a canonical correlation analysis method , 2009, Journal of neural engineering.

[4]  Francesco Piccione,et al.  User adaptive BCIs: SSVEP and P300 based interfaces , 2003, PsychNology J..

[5]  Arne Robben,et al.  Sampled sinusoidal stimulation profile and multichannel fuzzy logic classification for monitor-based phase-coded SSVEP brain–computer interfacing , 2013, Journal of neural engineering.

[6]  G. Pfurtscheller,et al.  EEG-based discrimination between imagination of right and left hand movement. , 1997, Electroencephalography and clinical neurophysiology.

[7]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[8]  Di Guo,et al.  Hankel Matrix Nuclear Norm Regularized Tensor Completion for $N$-dimensional Exponential Signals , 2016, IEEE Transactions on Signal Processing.

[9]  Yijun Wang,et al.  Lead selection for SSVEP-based brain-computer interface , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  Gene H. Golub,et al.  Numerical methods for computing angles between linear subspaces , 1971, Milestones in Matrix Computation.

[11]  Xiaorong Gao,et al.  A high-ITR SSVEP-based BCI speller , 2014 .

[12]  Naveed Iqbal Rao,et al.  Towards a Brain Computer Interface using wavelet transform with averaged and time segmented adapted wavelets , 2009, 2009 2nd International Conference on Computer, Control and Communication.

[13]  Tzyy-Ping Jung,et al.  High-speed spelling with a noninvasive brain–computer interface , 2015, Proceedings of the National Academy of Sciences.

[14]  Michele Rossi,et al.  Boosting the Battery Life of Wearables for Health Monitoring Through the Compression of Biosignals , 2017, IEEE Internet of Things Journal.

[15]  G.F. Inbar,et al.  An improved P300-based brain-computer interface , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  José Rouillard,et al.  SSVEP-based BCIs: study of classifier stability over time and effects of human learning on classification accuracy , 2014 .

[17]  Jzau-Sheng Lin,et al.  A Wireless BCI-Controlled Integration System in Smart Living Space for Patients , 2016, Wirel. Pers. Commun..

[18]  R. Homan,et al.  Cerebral location of international 10-20 system electrode placement. , 1987, Electroencephalography and clinical neurophysiology.

[19]  Toshihisa Tanaka,et al.  SSVEP-Based Brain–Computer Interfaces Using FSK-Modulated Visual Stimuli , 2013, IEEE Transactions on Biomedical Engineering.

[20]  B. Rockstroh,et al.  Biofeedback of slow cortical potentials. I. , 1980, Electroencephalography and clinical neurophysiology.

[21]  Yunhao Liu,et al.  LANDMARC: Indoor Location Sensing Using Active RFID , 2004, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[22]  Yuechun Chu,et al.  A UWB-based 3D location system for indoor environments , 2005, 2nd International Conference on Broadband Networks, 2005..

[23]  Hubert Cecotti,et al.  A Self-Paced and Calibration-Less SSVEP-Based Brain–Computer Interface Speller , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  L. Benini,et al.  A wearable EEG-based drowsiness detection system with blink duration and alpha waves analysis , 2017, 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER).

[25]  Yijun Wang,et al.  Enhancing Detection of SSVEPs for a High-Speed Brain Speller Using Task-Related Component Analysis , 2018, IEEE Transactions on Biomedical Engineering.

[26]  Enrique Mario Spinelli,et al.  An Embedded Hybrid BCI Speller , 2017 .

[27]  Andrew G. Dempster,et al.  Indoor localization using FM radio signals: A fingerprinting approach , 2011, 2011 International Conference on Indoor Positioning and Indoor Navigation.

[28]  Christoph Guger,et al.  A Brain-Computer Interface Based on Steady State Visual Evoked Potentials for Controlling a Robot , 2009, IWANN.

[29]  W. Perlstein,et al.  Steady-state visual evoked potentials reveal frontally-mediated working memory activity in humans , 2003, Neuroscience Letters.

[30]  C. Herrmann Human EEG responses to 1–100 Hz flicker: resonance phenomena in visual cortex and their potential correlation to cognitive phenomena , 2001, Experimental Brain Research.

[31]  T. Jung,et al.  Dry and Noncontact EEG Sensors for Mobile Brain–Computer Interfaces , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  Jiří Kárník,et al.  Summary of available indoor location techniques , 2016 .

[33]  Xiaorong Gao,et al.  A BCI-based environmental controller for the motion-disabled. , 2003, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[34]  Leire Muguira,et al.  An environment adaptive ZigBee-based indoor positioning algorithm , 2010, 2010 International Conference on Indoor Positioning and Indoor Navigation.

[35]  Ronald M. Aarts,et al.  A Survey of Stimulation Methods Used in SSVEP-Based BCIs , 2010, Comput. Intell. Neurosci..

[36]  Amr Mohamed,et al.  EEG-Based Transceiver Design With Data Decomposition for Healthcare IoT Applications , 2018, IEEE Internet of Things Journal.

[37]  Aaron Striegel,et al.  Face-to-Face Proximity EstimationUsing Bluetooth On Smartphones , 2014, IEEE Transactions on Mobile Computing.

[38]  Xuewen Liao,et al.  A hybrid indoor positioning algorithm based on WiFi fingerprinting and pedestrian dead reckoning , 2016, 2016 IEEE 27th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC).

[39]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[40]  Luca Benini,et al.  Multiple Biopotentials Acquisition System for Wearable Applications , 2015, BIODEVICES.

[41]  Richard M. Leahy,et al.  Electromagnetic brain mapping , 2001, IEEE Signal Process. Mag..

[42]  Ig-Jae Kim,et al.  Indoor location sensing using geo-magnetism , 2011, MobiSys '11.

[43]  H. Flor,et al.  The thought translation device (TTD) for completely paralyzed patients. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[44]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[45]  J. Odom VISUAL EVOKED POTENTIALS STANDARD , 2004 .

[46]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[47]  Martin Spüler,et al.  A high-speed brain-computer interface (BCI) using dry EEG electrodes , 2017, PloS one.

[48]  Toby P. Breckon,et al.  On the Classification of SSVEP-Based Dry-EEG Signals via Convolutional Neural Networks , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[49]  Luca Benini,et al.  Towards a Novel HMI Paradigm Based on Mixed EEG and Indoor Localization Platforms , 2017, 2017 New Generation of CAS (NGCAS).

[50]  Li Zhao,et al.  Research on SSVEP-Based Controlling System of Multi-DoF Manipulator , 2009, ISNN.

[51]  G. Golub MATRIX DECOMPOSITIONS AND STATISTICAL CALCULATIONS , 1969 .

[52]  M. Slater,et al.  Control of a Smart Home with a Brain-Computer Interface , 2008 .

[53]  Luca Benini,et al.  A sensor fusion approach for drowsiness detection in wearable ultra-low-power systems , 2018, Inf. Fusion.

[54]  Kwang Suk Park,et al.  Eliciting dual-frequency SSVEP using a hybrid SSVEP-P300 BCI , 2016, Journal of Neuroscience Methods.

[55]  S. Coyle,et al.  Brain–computer interfaces: a review , 2003 .

[56]  Yijun Wang,et al.  Developing a one-channel BCI system using a dry claw-like electrode , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[57]  D. Regan,et al.  Recent advances in electrical recording from the human brain , 1975, Nature.

[58]  T Klingeberg,et al.  Mobile wearable device for long term monitoring of vital signs , 2012, Comput. Methods Programs Biomed..

[59]  Rajesh Singla,et al.  Comparison of SSVEP Signal Classification Techniques Using SVM and ANN Models for BCI Applications , 2014 .

[60]  Dae-Hyeong Kim,et al.  Multifunctional wearable devices for diagnosis and therapy of movement disorders. , 2014, Nature nanotechnology.

[61]  Sungho Jo,et al.  Hybrid-BCI smart glasses for controlling electrical devices , 2015, 2015 54th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE).

[62]  Luca Benini,et al.  PULP: A parallel ultra low power platform for next generation IoT applications , 2015, 2015 IEEE Hot Chips 27 Symposium (HCS).

[63]  F. L. D. Silva,et al.  EEG signal processing , 2000, Clinical Neurophysiology.

[64]  Luca Benini,et al.  Power Line Interference Removal for High-Quality Continuous Biosignal Monitoring With Low-Power Wearable Devices , 2016, IEEE Sensors Journal.

[65]  Mihaly Benda,et al.  SSVEP-Based BCI in a Smart Home Scenario , 2017, IWANN.

[66]  José del R. Millán,et al.  Plug&Play Brain–Computer Interfaces for effective Active and Assisted Living control , 2017, Medical & Biological Engineering & Computing.

[67]  David E Thompson,et al.  Performance assessment in brain-computer interface-based augmentative and alternative communication , 2013, BioMedical Engineering OnLine.

[68]  Wei Wu,et al.  Frequency recognition based on canonical correlation analysis for SSVEP-based BCIs , 2007, IEEE Transactions on Biomedical Engineering.

[69]  Luca Benini,et al.  A Minimally Invasive Low-Power Platform for Real-Time Brain Computer Interaction Based on Canonical Correlation Analysis , 2019, IEEE Internet of Things Journal.

[70]  V. Sinha,et al.  Event-related potential: An overview , 2009, Industrial psychiatry journal.

[71]  P. Suffczynski,et al.  On the Quantification of SSVEP Frequency Responses in Human EEG in Realistic BCI Conditions , 2013, PloS one.

[72]  Frederick C. Harris,et al.  An Overview of Brain Computer Interfaces , 2015 .

[73]  Xiaorong Gao,et al.  Design and implementation of a brain-computer interface with high transfer rates , 2002, IEEE Transactions on Biomedical Engineering.

[74]  Gernot R. Müller-Putz,et al.  Control of an Electrical Prosthesis With an SSVEP-Based BCI , 2008, IEEE Transactions on Biomedical Engineering.

[75]  M. Shamim Hossain,et al.  Cloud-Supported Cyber–Physical Localization Framework for Patients Monitoring , 2017, IEEE Systems Journal.

[76]  Huai-Rong Shao,et al.  WiFi-based indoor positioning , 2015, IEEE Communications Magazine.

[77]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[78]  Pablo F. Diez,et al.  Asynchronous BCI control using high-frequency SSVEP , 2011, Journal of NeuroEngineering and Rehabilitation.

[79]  Brendan Z. Allison,et al.  The Hybrid BCI , 2010, Frontiers in Neuroscience.

[80]  Cuntai Guan,et al.  Brain-computer interface-based robotic end effector system for wrist and hand rehabilitation: results of a three-armed randomized controlled trial for chronic stroke , 2014, Front. Neuroeng..

[81]  Parikshit Shah,et al.  Compressed Sensing Off the Grid , 2012, IEEE Transactions on Information Theory.