Eigen Values Features for the Classification of Brain Signals corresponding to 2D and 3D Educational Contents

In this paper, we have proposed a brain signal classification method, which uses eigenvalues of the covariance matrix as features to classify images (topomaps) created from the brain signals. The signals are recorded during the answering of 2D and 3D questions. The system is used to classify the correct and incorrect answers for both 2D and 3D questions. Using the classification technique, the impacts of 2D and 3D multimedia educational contents on learning, memory retention and recall will be compared. The subjects learn similar 2D and 3D educational contents. Afterwards, subjects are asked 20 multiple-choice questions (MCQs) associated with the contents after thirty minutes (Short-Term Memory) and two months (Long-Term Memory). Eigenvalues features extracted from topomaps images are given to K-Nearest Neighbor (KNN) and Support Vector Machine (SVM) classifiers, in order to identify the states of the brain related to incorrect and correct answers. Excellent accuracies obtained by both classifiers and by applying statistical analysis on the results, no significant difference is indicated between 2D and 3D multimedia educational contents on learning, memory retention and recall in both STM and LTM.

[1]  Warren H. Meck,et al.  Oscillatory multiplexing of neural population codes for interval timing and working memory , 2015, Neuroscience & Biobehavioral Reviews.

[2]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[3]  Aamir Saeed Malik,et al.  Brain Behavior in Learning and Memory Recall Process: A High-Resolution EEG Analysis , 2014 .

[4]  Raja Parasuraman,et al.  Battery powered thought: Enhancement of attention, learning, and memory in healthy adults using transcranial direct current stimulation , 2014, NeuroImage.

[5]  Riaza Mohd Rias,et al.  Animation and prior knowledge in a multimedia application: A case study on undergraduate computer science students in learning , 2012, 2012 Second International Conference on Digital Information and Communication Technology and it's Applications (DICTAP).

[6]  Mats Lind,et al.  2D vs 3D, implications on spatial memory , 2001, IEEE Symposium on Information Visualization, 2001. INFOVIS 2001..

[7]  Larry D. Rosen,et al.  Pathways for Learning from 3D Technology. , 2012, International journal of environmental and science education : IJESE.

[8]  Yoshio Yamagishi,et al.  Effects of Stereoscopic 3D Contents on the Process of Learning to Build a Handmade PC , 2011 .

[9]  Charan Ranganath,et al.  Frontal midline theta oscillations during working memory maintenance and episodic encoding and retrieval , 2014, NeuroImage.

[10]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[11]  A. S. Malik,et al.  Investigating brain activation with respect to playing video games on large screens , 2012, 2012 4th International Conference on Intelligent and Advanced Systems (ICIAS2012).

[12]  Hee-Sun Lee,et al.  The Effect of Two-dimensional and Stereoscopic Presentation on Middle School Students’ Performance of Spatial Cognition Tasks , 2010 .

[13]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[14]  Robert T Knight,et al.  Intracranial recordings and human memory , 2015, Current Opinion in Neurobiology.

[15]  Muhammad Ghulam,et al.  A system based on 3D and 2D educational contents for true and false memory prediction using EEG signals , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[16]  N. Badruddin,et al.  Brain activation during cognitive tasks: An overview of EEG and fMRI studies , 2012, 2012 IEEE-EMBS Conference on Biomedical Engineering and Sciences.

[17]  Muhammad Ghulam,et al.  A System for True and False Memory Prediction Based on 2D and 3D Educational Contents and EEG Brain Signals , 2015, Comput. Intell. Neurosci..

[18]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[19]  Andy Cockburn,et al.  Evaluating spatial memory in two and three dimensions , 2004, Int. J. Hum. Comput. Stud..

[20]  Thorsten Joachims,et al.  Text Categorization with Support Vector Machines: Learning with Many Relevant Features , 1998, ECML.

[21]  E Donchin,et al.  A new method for off-line removal of ocular artifact. , 1983, Electroencephalography and clinical neurophysiology.

[22]  Chun-Yen Chang,et al.  The comparative efficacy of 2D- versus 3D-based media design for influencing spatial visualization skills , 2007, Comput. Hum. Behav..

[23]  Thomas Huk,et al.  Computer-Animations In Education: The Impact Of Graphical Quality (3D / 2D) And Signals , 2003 .

[24]  Richard E. Mayer,et al.  A Cognitive Theory of Multimedia Learning: Implications for Design Principles , 2001 .

[25]  Wu Dong-yu.  Application of EEG Non-linear Analysis in Vision Memory Study , 2006 .

[26]  A. Walker.  Electroencephalography, Basic Principles, Clinical Applications and Related Fields , 1982 .

[27]  W. Klimesch.  EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[28]  Hassan Mathkour,et al.  Studying the Effects of 2D and 3D Educational Contents on Memory Recall Using EEG Signals, PCA and Statistical Features , 2014, 2014 2nd International Conference on Artificial Intelligence, Modelling and Simulation.

[29]  Francisco Lopez Perez,et al.  Evaluation of learning processes applying 3D models for constructive processes from solutions to problems , 2010, 2010 2nd International Conference on Education Technology and Computer.

[30]  Jian Yang,et al.  Nuclear Norm-Based 2-DPCA for Extracting Features From Images , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[31]  A. S. Malik,et al.  Disparity in brain dynamics for video games played on small and large displays , 2012, 2012 IEEE Symposium on Humanities, Science and Engineering Research.

[32]  Patrick Haffner,et al.  Support vector machines for histogram-based image classification , 1999, IEEE Trans. Neural Networks.

[33]  S. Rossi,et al.  Human cortical responses during one-bit short-term memory. A high-resolution EEG study on delayed choice reaction time tasks , 2004, Clinical Neurophysiology.