High performance computation of human computer interface for neurodegenerative individuals using eye movements and deep learning technique

Disabilities due to neurodegenerative disease are rapidly increasing in number. The need for rehabilitative devices to achieve a normal and comfortable life in the absence of biochannels has also increased. The activities of biochannels can be easily replaced by implementing rehabilitative devices. The electrooculography (EOG)-based human–computer interface (HCI) is one of the most important techniques for enabling disabled persons to enjoy a normal life. The technique of measuring the cornea-retina potential difference is called EOG. The technology for converting thoughts to different control patterns to activate external devices is called the HCI. In this paper, we carried out a study on ten subjects aged 20–30 years using a five-electrode signal acquisition system (AD T26). The subject performances were experimentally verified by implementing periodogram features with a feedforward neural network trained on a nature-inspired algorithm. The analysis was conducted offline and online to evaluate the achievement of the developed HCI. The study showed an average classification accuracy of 93.93% for four tasks, with 95% accuracy for the offline mode and 90.12% for the online mode. The participating subjects drove the mobile robot in all directions frequently and quickly with a recognition accuracy of 98.12%. The study confirmed that the four tasks (related to driving the external device) performed by the subjects were convenient to perform in real time.

[1]  Dinesh Mavaluru,et al.  Brain–computer interface for amyotrophic lateral sclerosis patients using deep learning network , 2020, Neural Computing and Applications.

[2]  D Saravanakumar,et al.  A Novel EOG based Synchronous and Asynchronous Visual Keyboard System , 2019, 2019 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[3]  Kai Li,et al.  Optimized artificial neural network based performance analysis of wheelchair movement for ALS patients , 2020, Artif. Intell. Medicine.

[4]  Yangyang Li,et al.  The Improved Antlion Optimizer and Artificial Neural Network for Chinese Influenza Prediction , 2019, Complex..

[5]  Tae Seon Kim,et al.  Development of EOG-Based Human Computer Interface (HCI) System Using Piecewise Linear Approximation (PLA) and Support Vector Regression (SVR) , 2018 .

[6]  Serkan Gurkan,et al.  Design of a Novel Efficient Human–Computer Interface: An Electrooculagram Based Virtual Keyboard , 2010, IEEE Transactions on Instrumentation and Measurement.

[7]  G. Emayavaramban,et al.  OFFLINE STUDY FOR IMPLEMENTING HUMAN COMPUTER INTERFACE FOR ELDERLY PARALYZED PATIENTS USING ELECTROOCULOGRAPHY AND NEURAL NETWORKS , 2019, International Journal of Intelligent Enterprise.

[8]  Yuanqing Li,et al.  An EOG-Based Human–Machine Interface to Control a Smart Home Environment for Patients With Severe Spinal Cord Injuries , 2019, IEEE Transactions on Biomedical Engineering.

[9]  Revati Shriram,et al.  Coherence Analysis of EEG Signal Using Power Spectral Density , 2014, 2014 Fourth International Conference on Communication Systems and Network Technologies.

[10]  Huosheng Hu,et al.  Use of forehead bio-signals for controlling an Intelligent Wheelchair , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[11]  Seyed Mohammad Mirjalili,et al.  The Ant Lion Optimizer , 2015, Adv. Eng. Softw..

[12]  G. Emayavaramban,et al.  Nine States HCI using Electrooculogram and Neural Networks , 2016 .

[13]  Prionjit Sarker,et al.  Hardware and software implementation of real time electrooculogram (EOG) acquisition system to control computer cursor with eyeball movement , 2017, 2017 4th International Conference on Advances in Electrical Engineering (ICAEE).

[14]  M. Kemal Kiymik,et al.  Application of Periodogram and AR Spectral Analysis to EEG Signals , 2000, Journal of Medical Systems.

[15]  Chun-Liang Hsu,et al.  EOG-based Human-Computer Interface system development , 2010, Expert Syst. Appl..

[16]  Wei Li,et al.  An Improved Ant Lion Optimization Algorithm and Its Application* , 2018, 2022 IEEE International Conference on Networking, Sensing and Control (ICNSC).

[17]  Radeep Krishna Radhakrishnan Nair,et al.  Signal identification system for developing rehabilitative device using deep learning algorithms , 2020, Artif. Intell. Medicine.

[18]  Serkan Gurkan,et al.  A novel electrooculogram-based human computer interface and its application as a virtual keyboard , 2009, 2009 14th National Biomedical Engineering Meeting.

[19]  Lian Li,et al.  Design and Implementation of Multimedia Control System Based on Bluetooth and Electrooculogram (EOG) , 2011, 2011 5th International Conference on Bioinformatics and Biomedical Engineering.

[20]  S Ramkumar,et al.  Design and Development of Human Computer Interface Using Electrooculogram with Deep Learning , 2020, Artif. Intell. Medicine.

[21]  Zhijun Zhang,et al.  An EOG-based wheelchair robotic arm system for assisting patients with severe spinal cord injuries , 2019, Journal of neural engineering.

[22]  Jing Xiao,et al.  An Electrooculogram-Based Interaction Method and Its Music-on-Demand Application in a Virtual Reality Environment , 2019, IEEE Access.

[23]  T. Charoenpong,et al.  Directional eye movement detection system for virtual keyboard controller , 2012, The 5th 2012 Biomedical Engineering International Conference.

[24]  Monotosh Talukder,et al.  EOG Based Home Automation System by Cursor Movement Using a Graphical User Interface (GUI) , 2018, 2018 IEEE International WIE Conference on Electrical and Computer Engineering (WIECON-ECE).

[25]  G. Emayavaramban,et al.  Offline Analysis for Designing Electrooculogram Based Human Computer Interface Control for Paralyzed Patients , 2018, IEEE Access.

[26]  Luo Bin,et al.  Electroencephalogram based communication system for locked in state person using mentally spelled tasks with optimized network model , 2020, Artif. Intell. Medicine.

[27]  Rafael Barea Navarro,et al.  EOG-based wheelchair control , 2018 .

[28]  Juan Manuel Górriz,et al.  Periodogram Connectivity of EEG Signals for the Detection of Dyslexia , 2019, IWINAC.

[29]  K. Sathesh Kumar,et al.  A feasibility study on eye movements using electrooculogram based HCI , 2017, 2017 International Conference on Intelligent Sustainable Systems (ICISS).

[30]  Amit Sharma,et al.  Electrooculogram-based virtual reality game control using blink detection and gaze calibration , 2016, 2016 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[31]  Chang-Hwan Im,et al.  Real-Time “Eye-Writing” Recognition Using Electrooculogram , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  Nitin Chandrachoodan,et al.  EOG based virtual keyboard , 2015, 2015 41st Annual Northeast Biomedical Engineering Conference (NEBEC).

[33]  D. N. Tibarewala,et al.  Electro-oculogram based digit recognition to design assitive communication system for speech disabled patients , 2016, 2016 International Conference on Microelectronics, Computing and Communications (MicroCom).

[34]  Takefumi Hiraguri,et al.  Collision Detection Method Using Self Interference Cancelation for Random Access Multiuser MIMO , 2017 .

[35]  Chin-Teng Lin,et al.  A wireless Electrooculography-based human-computer interface for baseball game , 2013, 2013 9th International Conference on Information, Communications & Signal Processing.

[36]  Yongqiang Cheng,et al.  Patient-Specific Coronary Artery 3D Printing Based on Intravascular Optical Coherence Tomography and Coronary Angiography , 2019, Complex..

[37]  Fuming Fang,et al.  Electrooculography-based continuous eye-writing recognition system for efficient assistive communication systems , 2018, PloS one.

[38]  P PaulrajM,et al.  Idendifying Eye Movements using Neural Networks for Human Computer Interaction , 2014 .

[39]  Chenwu Xu,et al.  Combined bulked segregant sequencing and traditional linkage analysis for identification of candidate gene for purple leaf sheath in maize , 2018, PloS one.