Addressing the problems of data-centric physiology-affect relations modeling

Data-centric affect modeling may render itself restrictive in practical applications for three reasons, namely, it falls short of feature optimization, infers discrete affect classes, and deals with relatively small to average sized datasets. Though it seems practical to use the feature combinations already associated to commonly investigated sensors, there may be other potentially optimal features that can lead to new relations. Secondly, although it seems more realistic to view affect as continuous, it requires using continuous labels that will increase the difficulty of modeling. Lastly, although a large scale dataset reflects a more precise range of values for any given feature, it severely hinders computational efficiency. We address these problems when inferring physiology-affect relations from datasets that contain 2-3 million feature vectors, each with 49 features and labelled with continuous affect values. We employ automatic feature selection to acquire near optimal feature subsets and a fast approximate kNN algorithm to solve the regression problem and cope with the challenge of a large scale dataset. Our results show that high estimation accuracy may be achieved even when the selected feature subset is only about 7% of the original features. May the results here motivate the HCI community to pursue affect modeling without being deterred by large datasets and further the discussions on acquiring optimal features for accurate continuous affect approximation.

[1]  Lluís A. Belanche Muñoz,et al.  Feature selection algorithms: a survey and experimental evaluation , 2002, 2002 IEEE International Conference on Data Mining, 2002. Proceedings..

[2]  S. Inoué,et al.  A short daytime nap modulates levels of emotions objectively evaluated by the emotion spectrum analysis method , 2000, Psychiatry and clinical neurosciences.

[3]  K. Scherer,et al.  Emotions evoked by the sound of music: characterization, classification, and measurement. , 2008, Emotion.

[4]  Filippo Menczer,et al.  Feature selection in data mining , 2003 .

[6]  Mark A. Hall,et al.  Correlation-based Feature Selection for Discrete and Numeric Class Machine Learning , 1999, ICML.

[7]  Giovanni Felici,et al.  Feature Selection for Data Mining , 2006 .

[8]  Iven Van Mechelen,et al.  Individual differences in core affect reactivity , 2009 .

[9]  Toshimitsu Musha,et al.  Feature extraction from EEGs associated with emotions , 1997, Artificial Life and Robotics.

[10]  Fatma Nasoz,et al.  Emotion Recognition from Physiological Signals for Presence Technologies , 2004 .

[11]  Masayuki Numao,et al.  Modelling affective-based music compositional intelligence with the aid of ANS analyses , 2007, Knowl. Based Syst..

[12]  Jian-xiong Dong,et al.  Fast SVM training algorithm with decomposition on very large data sets , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Johannes Wagner,et al.  From Physiological Signals to Emotions: Implementing and Comparing Selected Methods for Feature Extraction and Classification , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[14]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  K. Moriyama,et al.  An empathy learning problem for HSI: To be empathic, self-improving and ambient , 2008, 2008 Conference on Human System Interactions.

[16]  Cristina Conati,et al.  Empirically building and evaluating a probabilistic model of user affect , 2009, User Modeling and User-Adapted Interaction.

[17]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[18]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[19]  Ivor W. Tsang,et al.  Core Vector Machines: Fast SVM Training on Very Large Data Sets , 2005, J. Mach. Learn. Res..

[20]  Hanan Samet,et al.  A fast all nearest neighbor algorithm for applications involving large point-clouds , 2007, Comput. Graph..

[21]  Frank H. Wilhelm,et al.  Continuous electronic data capture of physiology, behavior and experience in real life: towards ecological momentary assessment of emotion , 2006, Interact. Comput..

[22]  Margrit Betke,et al.  Empathic painting: interactive stylization through observed emotional state , 2006, NPAR.

[23]  Lloyd A. Smith,et al.  Feature Selection for Machine Learning: Comparing a Correlation-Based Filter Approach to the Wrapper , 1999, FLAIRS.

[24]  Sunil Arya,et al.  An optimal algorithm for approximate nearest neighbor searching fixed dimensions , 1998, JACM.

[25]  Yi-Ping Hung,et al.  Fast and versatile algorithm for nearest neighbor search based on a lower bound tree , 2007, Pattern Recognit..

[26]  K. H. Kim,et al.  Emotion recognition system using short-term monitoring of physiological signals , 2004, Medical and Biological Engineering and Computing.

[27]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[28]  Andrew W. Moore,et al.  New Algorithms for Efficient High-Dimensional Nonparametric Classification , 2006, J. Mach. Learn. Res..

[29]  Anil K. Jain,et al.  Feature Selection: Evaluation, Application, and Small Sample Performance , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Xindong Wu,et al.  The Top Ten Algorithms in Data Mining , 2009 .

[31]  Jason Williams,et al.  Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System , 2004, ADS.

[32]  Dario L. Sancho-Pradel,et al.  Probabilistic Multisensory Emotion Estimation Framework for Assistive Robotic Applications , 2008, AAAI Fall Symposium: AI in Eldercare: New Solutions to Old Problems.

[33]  Rosalind W. Picard,et al.  Evaluating affective interactions: Alternatives to asking what users feel , 2005 .

[34]  Kristina Höök,et al.  Evaluating affective interfaces: innovative approaches , 2005, CHI EA '05.

[35]  Paul S. Bradley,et al.  Scaling Clustering Algorithms to Large Databases , 1998, KDD.

[36]  Andrew W. Moore,et al.  An Investigation of Practical Approximate Nearest Neighbor Algorithms , 2004, NIPS.

[37]  Mitsuru Ishizuka,et al.  Symmetric Multimodality Revisited: Unveiling Users' Physiological Activity , 2007, IEEE Transactions on Industrial Electronics.

[38]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[39]  Shin Kimura,et al.  Emotion Spectrum Analysis Method (ESAM) for Monitoring the Effects of Art Therapy Applied on Demented Patients , 2000, Cyberpsychology Behav. Soc. Netw..

[40]  Volker Tresp,et al.  Scaling Kernel-Based Systems to Large Data Sets , 2001, Data Mining and Knowledge Discovery.

[41]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[42]  Björn W. Schuller,et al.  Abandoning emotion classes - towards continuous emotion recognition with modelling of long-range dependencies , 2008, INTERSPEECH.

[43]  Konstantin Zakharov,et al.  Affect Recognition and Support in Intelligent Tutoring Systems , 2007 .

[44]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.