Deep Learning for EEG-Based Preference Classification in Neuromarketing

The traditional marketing methodologies (e.g., television commercials and newspaper advertisements) may be unsuccessful at selling products because they do not robustly stimulate the consumers to purchase a particular product. Such conventional marketing methods attempt to determine the attitude of the consumers toward a product, which may not represent the real behavior at the point of purchase. It is likely that the marketers misunderstand the consumer behavior because the predicted attitude does not always reflect the real purchasing behaviors of the consumers. This research study was aimed at bridging the gap between traditional market research, which relies on explicit consumer responses, and neuromarketing research, which reflects the implicit consumer responses. The EEG-based preference recognition in neuromarketing was extensively reviewed. Another gap in neuromarketing research is the lack of extensive data-mining approaches for the prediction and classification of the consumer preferences. Therefore, in this work, a deep-learning approach is adopted to detect the consumer preferences by using EEG signals from the DEAP dataset by considering the power spectral density and valence features. The results demonstrated that, although the proposed deep-learning exhibits a higher accuracy, recall, and precision compared with the k-nearest neighbor and support vector machine algorithms, random forest reaches similar results to deep learning on the same dataset.

[1]  Tiago H. Falk,et al.  Deep learning-based electroencephalography analysis: a systematic review , 2019, Journal of neural engineering.

[2]  Raghupathy Sivakumar,et al.  Cerebro: A Wearable Solution to Detect and Track User Preferences using Brainwaves , 2019, WearSys@MobiSys.

[3]  T. Ramsøy,et al.  Frontal Brain Asymmetry and Willingness to Pay , 2018, Front. Neurosci..

[4]  Bor-Shyh Lin,et al.  Emotion recognition of EEG underlying favourite music by support vector machine , 2013, 2013 1st International Conference on Orange Technologies (ICOT).

[5]  T. Daugherty,et al.  Research in reverse: Ad testing using an inductive consumer neuroscience approach , 2016 .

[6]  M. Murugappan,et al.  Wireless EEG signals based Neuromarketing system using Fast Fourier Transform (FFT) , 2014, 2014 IEEE 10th International Colloquium on Signal Processing and its Applications.

[7]  Stephan G.H. Meyerding,et al.  Can neuromarketing add value to the traditional marketing research? An exemplary experiment with functional near-infrared spectroscopy (fNIRS) , 2020 .

[8]  Tanusree Dutta,et al.  Neuromarketing and consumer neuroscience: current understanding and the way forward , 2015 .

[9]  Fabio Babiloni,et al.  Neurophysiological Tools to Investigate Consumer's Gender Differences during the Observation of TV Commercials , 2014, Comput. Math. Methods Medicine.

[10]  Ale Smidts,et al.  Brain Responses to Movie Trailers Predict Individual Preferences for Movies and Their Population-Wide Commercial Success , 2015 .

[11]  Abeer Al-Nafjan,et al.  Classification of Human Emotions from Electroencephalogram (EEG) Signal using Deep Neural Network , 2017 .

[12]  Rafaela Q. Barros,et al.  Analysis of Product Use by Means of Eye Tracking and EEG: A Study of Neuroergonomics , 2016, HCI.

[13]  Leontios J. Hadjileontiadis,et al.  EEG-Based Classification of Music Appraisal Responses Using Time-Frequency Analysis and Familiarity Ratings , 2013, IEEE Transactions on Affective Computing.

[14]  Jordan J. Louviere,et al.  Consumer neuroscience: Assessing the brain response to marketing stimuli using electroencephalogram (EEG) and eye tracking , 2013, Expert Syst. Appl..

[15]  A. Choromańska,et al.  Application of frontal EEG asymmetry to advertising research , 2010 .

[16]  Seung-Eun Lee,et al.  Measuring Neural Responses to Apparel Product Attractiveness , 2017 .

[17]  Doron Friedman,et al.  Pathways to Consumers’ Minds: Using Machine Learning and Multiple EEG Metrics to Increase Preference Prediction Above and Beyond Traditional Measurements , 2018, bioRxiv.

[18]  Chang-Hwan Im,et al.  EEG-Based Brain-Computer Interfaces: A Thorough Literature Survey , 2013, Int. J. Hum. Comput. Interact..

[19]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update , 2018, Journal of neural engineering.

[20]  Oliver J. Hulme,et al.  Modulation of aesthetic value by semantic context: An fMRI study , 2009, NeuroImage.

[21]  Qingguo Ma,et al.  N400 as an index of uncontrolled categorization processing in brand extension , 2012, Neuroscience Letters.

[22]  Fabio Babiloni,et al.  Neurophysiological Responses to Different Product Experiences , 2018, Comput. Intell. Neurosci..

[23]  F. Cincotti,et al.  Changes in Brain Activity During the Observation of TV Commercials by Using EEG, GSR and HR Measurements , 2010, Brain Topography.

[24]  Fabio Babiloni,et al.  Electroencephalographic, Heart Rate, and Galvanic Skin Response Assessment for an Advertising Perception Study: Application to Antismoking Public Service Announcements , 2017, Journal of visualized experiments : JoVE.

[25]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[26]  A. Choromańska,et al.  Analysis of Neurophysiological Reactions to Advertising Stimuli by Means of EEG and Galvanic Skin Response Measures , 2009 .

[27]  P. Walla,et al.  Established liked versus disliked brands: Brain activity, implicit associations and explicit responses , 2016 .

[28]  Jakub Berčík,et al.  The impact of parameters of store illumination on food shopper response , 2016, Appetite.

[29]  P. Kenning,et al.  The Application of Mobile fNIRS in Marketing Research—Detecting the “First-Choice-Brand” Effect , 2018, Front. Hum. Neurosci..

[30]  G. Loewenstein,et al.  Neural Predictors of Purchases , 2007, Neuron.

[31]  Olga Sourina,et al.  Real-time EEG-based user's valence monitoring , 2015, 2015 10th International Conference on Information, Communications and Signal Processing (ICICS).

[32]  Scott A. Huettel,et al.  Consumer Neuroscience: Applications, Challenges, and Possible Solutions , 2015 .

[33]  Cuntai Guan,et al.  Common frequency pattern for music preference identification using frontal EEG , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[34]  James Mountstephens,et al.  Deep learning for EEG-Based preference classification , 2017 .

[35]  Debi Prosad Dogra,et al.  Analysis of EEG signals and its application to neuromarketing , 2017, Multimedia Tools and Applications.

[36]  Aboul Ella Hassanien,et al.  Brain-Computer Interfaces - Current Trends and Applications , 2014, rain-Computer Interfaces.

[37]  Lei Wang,et al.  The influence of negative emotion on brand extension as reflected by the change of N2: A preliminary study , 2010, Neuroscience Letters.

[38]  Xue Li Lim,et al.  Neural signals of selective attention are modulated by subjective preferences and buying decisions in a virtual shopping task , 2017, Biological Psychology.

[39]  Efthymios Constantinides,et al.  Towards a Better Understanding of Consumer Behaviour: Marginal Utility as a Parameter in Neuromarketing Research , 2017 .

[40]  Terry L. Childers,et al.  The shopping brain: Math anxiety modulates brain responses to buying decisions , 2012, Biological Psychology.

[41]  Athanasios V. Vasilakos,et al.  Brain computer interface: control signals review , 2017, Neurocomputing.

[42]  M. Riediger,et al.  Tune Yourself In: Valence and Arousal Preferences in Music-Listening Choices From Adolescence to Old Age , 2017, Developmental psychology.

[43]  Jing Wang,et al.  The impact of perceived quality on online buying decisions: an event-related potentials perspective , 2014, Neuroreport.

[44]  Terry L. Childers,et al.  Applying EEG in consumer neuroscience , 2018 .

[45]  Changseok Bae,et al.  Preference Measurement Using User Response Electroencephalogram , 2015 .

[46]  Laura Astolfi,et al.  Spectral EEG frontal asymmetries correlate with the experienced pleasantness of TV commercial advertisements , 2011, Medical & Biological Engineering & Computing.

[47]  Jason Teo,et al.  Classification of Affective States via EEG and Deep Learning , 2018 .

[48]  Ayman Atia,et al.  Brain computer interfacing: Applications and challenges , 2015 .

[49]  Qingguo Ma,et al.  P300 and categorization in brand extension , 2008, Neuroscience Letters.

[50]  Lin Hou Chew,et al.  Aesthetic preference recognition of 3D shapes using EEG , 2015, Cognitive Neurodynamics.

[51]  Leontios J. Hadjileontiadis,et al.  Toward an EEG-Based Recognition of Music Liking Using Time-Frequency Analysis , 2012, IEEE Transactions on Biomedical Engineering.

[52]  T. Ramsøy,et al.  A study of unconscious emotional and cognitive responses to tourism images using a neuroscience method , 2019, Journal of Islamic Marketing.

[53]  Christophe Morin,et al.  Neuromarketing: The New Science of Consumer Behavior , 2011 .

[54]  Wan Chul Yoon,et al.  Extraction of User Preference for Video Stimuli Using EEG‐Based User Responses , 2013 .

[55]  Ariel Telpaz,et al.  Using EEG to Predict Consumers’ Future Choices , 2015 .

[56]  T. Ramsøy,et al.  Effects of Perceptual Uncertainty on Arousal and Preference Across Different Visual Domains , 2012 .

[57]  Khalid Ait Hammou,et al.  The Contributions of Neuromarketing in Marketing Research , 2013 .