Curvature manipulation of the spectrum of Valence-Arousal-related fMRI dataset using Gaussian-shaped Fast Fourier Transform and its application to fuzzy KANSEI adjectives modeling

ValenceArousal is regarded as a reflection of KANSEI adjectives, which is the core concept in the theory of emotional dimensions for brain recognition. This paper presents a novel method for determining the characteristics of Valence-Arousal-based timing signals using Power Spectrum Density (PSD) of fMRI images, and Gaussian filtering, segmenting, and Gaussian-shaped Fast Fourier Transform (FFT) will be applied for reprocessing fMRI images; the timing characteristics of the fMRI image signals were extracted under short-term emotional picture stimuli (within 6s). To reduce the computational complexity, a cubic curve fitting method was used to smooth the ValenceArousal timing curve, and the coefficients of the fitted curve, the mean, and the standard deviation were derived from the Gaussian-shaped Affective Norm English Words (ANEW) system, subsequently, these parameters were selected to create a 4-INPUT 2-OUTPUT TakagiSugeno (TS) type Adaptive Neuro Fuzzy Inference System (ANFIS). In the experimental study, an fMRI data-set was acquired for KANSEI-kindness picture stimuli and the FIS prediction was 0.05 less than the Root Mean Square Error (RMSE) after 24/18 iteration epochs for Valence/Arousal. These experiments showed that the proposed method effectively simplified high complexity when calculating fMRI images. The cubic curve fitting method extracted the characteristics of the ValenceArousal time series-based curves effectively and established the KANSEI adjective content more accurately by comparing with the ANEW system of ValenceArousal values. The proposed curve generation methods for the ValenceArousal response of KANSEI adjectives will be a potential application for attention-oriented product design fields.

[1]  D. Rowe,et al.  Signal and noise of Fourier reconstructed fMRI data , 2007, Journal of Neuroscience Methods.

[2]  Junqing Yu,et al.  Fast terrain mapping from low altitude digital imagery , 2015, Neurocomputing.

[3]  Karoly Hercegfi,et al.  Heart Rate Variability Monitoring during Human-Computer Interaction , 2011 .

[4]  Isao Shimizu,et al.  Detection of image differences by Fourier transformed magnitude subtraction , 2012 .

[5]  Christian M Kerskens,et al.  Quantitative Functional Magnetic Resonance Imaging of Brain Activity Using Bolus-Tracking Arterial Spin Labeling , 2010, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[6]  Junqing Yu,et al.  On-Device Mobile Visual Location Recognition by Integrating Vision and Inertial Sensors , 2013, IEEE Transactions on Multimedia.

[7]  Yutaka Hata,et al.  Automated segmentation of human brain MR images aided by fuzzy information granulation and fuzzy inference , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[8]  Lucas J. van Vliet,et al.  A nonlinear laplace operator as edge detector in noisy images , 1989, Comput. Vis. Graph. Image Process..

[9]  M. Bradley,et al.  Affective Norms for English Words (ANEW): Instruction Manual and Affective Ratings , 1999 .

[10]  R Baumgartner,et al.  Comparison of two exploratory data analysis methods for fMRI: fuzzy clustering vs. principal component analysis. , 2000, Magnetic resonance imaging.

[11]  J. Leon-Carrion,et al.  A lasting post-stimulus activation on dorsolateral prefrontal cortex is produced when processing valence and arousal in visual affective stimuli , 2007, Neuroscience Letters.

[12]  Jiang Xu,et al.  Employing rough sets and association rule mining in KANSEI knowledge extraction , 2012, Inf. Sci..

[13]  Junqing Yu,et al.  Efficient BOF Generation and Compression for On-Device Mobile Visual Location Recognition , 2014, IEEE MultiMedia.

[14]  Junqing Yu,et al.  Wide area localization and tracking on camera phones for mobile augmented reality systems , 2015, Multimedia Systems.

[15]  Shing-Chung Ngan,et al.  Investigating the enhancement of template-free activation detection of event-related fMRI data using wavelet shrinkage and figures of merit , 2011, Artif. Intell. Medicine.

[16]  Tony Lindeberg,et al.  Segmentation and Classification of Edges Using Minimum Description Length Approximation and Complementary Junction Cues , 1996, Comput. Vis. Image Underst..

[17]  J. Russell,et al.  An approach to environmental psychology , 1974 .

[18]  Peter Meer,et al.  Edge Detection with Embedded Confidence , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  H. Critchley,et al.  Neural correlates of processing valence and arousal in affective words. , 2006, Cerebral cortex.

[20]  Tom Michael Mitchell,et al.  Predicting Human Brain Activity Associated with the Meanings of Nouns , 2008, Science.

[21]  Liu Changjiang,et al.  Neuroeconomics: Decision science for brain science. , 2007 .

[22]  Jouni Kaartinen,et al.  Quantification of human brain metabolites from in vivo 1H NMR magnitude spectra using automated artificial neural network analysis. , 2002, Journal of magnetic resonance.

[23]  Gaël Varoquaux,et al.  A supervised clustering approach for fMRI-based inference of brain states , 2011, Pattern Recognit..

[24]  S. Corkin,et al.  Two routes to emotional memory: distinct neural processes for valence and arousal. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Rainer Goebel,et al.  Dissecting cognitive stages with time-resolved fMRI data: a comparison of fuzzy clustering and independent component analysis. , 2007, Magnetic resonance imaging.

[26]  Jean Gotman,et al.  Detection of epileptic activity in fMRI without recording the EEG , 2012, NeuroImage.

[27]  Andrew M. White,et al.  Tracking Epileptogenesis Progressions with Layered Fuzzy K-means and K-medoid Clustering , 2012, ICCS.

[28]  Thomas E. Nichols,et al.  Nonparametric permutation tests for functional neuroimaging: A primer with examples , 2002, Human brain mapping.

[29]  M. Bradley,et al.  Remembering pictures: pleasure and arousal in memory. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[30]  Wen-Ming Luh,et al.  Differentiating BOLD and non-BOLD signals in fMRI time series using multi-echo EPI , 2012, NeuroImage.

[31]  Maximilien Vermandel,et al.  From MIP image to MRA segmentation using fuzzy set theory , 2007, Comput. Medical Imaging Graph..

[32]  Gamini Dissanayake,et al.  Choice modeling and the brain: A study on the Electroencephalogram (EEG) of preferences , 2012, Expert Syst. Appl..

[33]  M. Banaji,et al.  Words high and low in pleasantness as rated by male and female college students , 1986 .

[34]  Martin Ebner,et al.  Emotion Detection: Application of the Valence Arousal Space for Rapid Biological Usability Testing to Enhance Universal Access , 2009, HCI.

[35]  Alan C. Evans,et al.  A Three-Dimensional Statistical Analysis for CBF Activation Studies in Human Brain , 1992, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[36]  Guillaume Chanel,et al.  Emotion Assessment: Arousal Evaluation Using EEG's and Peripheral Physiological Signals , 2006, MRCS.

[37]  Ray L. Somorjai,et al.  Exploring regions of interest with cluster analysis (EROICA) using a spectral peak statistic for selecting and testing the significance of fMRI activation time-series , 2002, Artif. Intell. Medicine.

[38]  Sridha Sridharan,et al.  The use of phase in complex spectrum subtraction for robust speech recognition , 2011, Comput. Speech Lang..

[39]  Ottmar V. Lipp,et al.  An increase in stimulus arousal has differential effects on the processing speed of pleasant and unpleasant stimuli , 2009 .

[40]  Vince D. Calhoun,et al.  SimTB, a simulation toolbox for fMRI data under a model of spatiotemporal separability , 2012, NeuroImage.

[41]  J. Russell,et al.  Evidence for a three-factor theory of emotions , 1977 .

[42]  Lijun Zhang,et al.  Determining functional connectivity using fMRI data with diffusion-based anatomical weighting , 2009, NeuroImage.

[43]  Claus Lamm,et al.  Fuzzy cluster analysis of high-field functional MRI data , 2003, Artif. Intell. Medicine.

[44]  Sadık Kara,et al.  Medical diagnosis of rheumatoid arthritis disease from right and left hand Ulnar artery Doppler signals using adaptive network based fuzzy inference system (ANFIS) and MUSIC method , 2010, Adv. Eng. Softw..

[45]  Sabine Van Huffel,et al.  Frequency-selective quantitation of short-echo time 1H magnetic resonance spectra. , 2007, Journal of magnetic resonance.

[46]  Toshio Tsuji,et al.  A log-linearized Gaussian mixture network and its application to EEG pattern classification , 1999, IEEE Trans. Syst. Man Cybern. Part C.

[47]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[48]  Elif Derya Übeyli,et al.  Adaptive neuro-fuzzy inference system for classification of EEG signals using wavelet coefficients , 2005, Journal of Neuroscience Methods.

[49]  D. Schacter,et al.  Processing emotional pictures and words: Effects of valence and arousal , 2006, Cognitive, affective & behavioral neuroscience.

[50]  Junqing Yu,et al.  Projected Residual Vector Quantization for ANN Search , 2014, IEEE MultiMedia.

[51]  Bhavin R. Sheth,et al.  How emotional arousal and valence influence access to awareness , 2008, Vision Research.

[52]  Jan Menke,et al.  Viewing the effective k-space coverage of MR images: phantom experiments with fast Fourier transform. , 2010, Magnetic resonance imaging.

[53]  A. Tellegen Structures of Mood and Personality and Their Relevance to Assessing Anxiety, With an Emphasis on Self-Report , 2019, Anxiety and the Anxiety Disorders.

[54]  J. Russell A circumplex model of affect. , 1980 .

[55]  Janaina Mourão Miranda,et al.  Contributions of stimulus valence and arousal to visual activation during emotional perception , 2003, NeuroImage.

[56]  Hunter G Hoffman,et al.  Circumplex Model of Affect: A Measure of Pleasure and Arousal During Virtual Reality Distraction Analgesia. , 2016, Games for health journal.

[57]  Fuqian Shi,et al.  Emotional Cellular-Based Multi- Class Fuzzy Support Vector Machines on Product's KANSEI Extraction , 2012 .