Autonomous emotion development using incremental modified adaptive neuro-fuzzy inference system

In this paper, we propose an autonomous emotion development system with incremental learning for interacting with human subjects, and autonomously understanding the emotional status of humans. For the understanding of human emotion the proposed system needs human-like visual senses perceiving natural scenes as stimuli. According to the relationship between emotional factors and characteristics of an image, we incorporate the fuzzy concept to extract emotional features using [email protected][email protected][email protected]? color and orientation information. Additionally, it can sense inputs that have no analog in human senses-reading brain signals in human subjects. We consider the electroencephalography (EEG) signals which are stimulated by natural stimuli to form the semantic emotional features as well. We develop a novel adaptive neuro-fuzzy inference system (ANFIS) based on an incremental learning algorithm to autonomously develop the capability of understanding complex emotions. The proposed incremental modified ANFIS needs only the newly arrived data to adjust the shape of Gaussian membership functions with full covariance matrix, to generate new membership functions or new rules for labeling emotion according to the characteristics of the new data. Utilizing the developmental process, the proposed system can autonomously develop the mental ability to understand more complex human emotions by mining the characteristics of emotional features and interacting with human subjects.

[1]  Matthias M. Müller,et al.  Processing of affective pictures modulates right-hemispheric gamma band EEG activity , 1999, Clinical Neurophysiology.

[2]  L. Ou,et al.  A study of colour emotion and colour preference. Part I: Colour emotions for single colours , 2004 .

[3]  Qing Zhang,et al.  Fuzzy-GIST for emotion recognition in natural scene images , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[4]  Rosalind W. Picard Affective Computing , 1997 .

[5]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[7]  R. French,et al.  Catastrophic Forgetting in Connectionist Networks: Causes, Consequences and Solutions , 1994 .

[8]  Qing Zhang,et al.  Emotion development system by interacting with human EEG and natural scene understanding , 2012, Cognitive Systems Research.

[9]  J. Odom VISUAL EVOKED POTENTIALS STANDARD , 2004 .

[10]  Hugues Bersini,et al.  Now comes the time to defuzzify neuro-fuzzy models , 1997, Fuzzy Sets Syst..

[11]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[12]  Rodney M. Goodman,et al.  Incremental learning with rule-based neural networks , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[13]  Rosalind W. Picard Toward computers that recognize and respond to user emotion , 2000, IBM Syst. J..

[14]  Didier Dubois,et al.  Possibility Theory, Probability Theory and Multiple-Valued Logics: A Clarification , 2001, Annals of Mathematics and Artificial Intelligence.

[15]  J. Russell A circumplex model of affect. , 1980 .

[16]  Li Xu,et al.  An emotion-based approach to decision making and self learning in autonomous robot control , 2004, Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No.04EX788).

[17]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[18]  P. Lang The emotion probe. Studies of motivation and attention. , 1995, The American psychologist.

[19]  M. Paradiso,et al.  Neuroscience: Exploring the Brain , 1996 .

[20]  James L. McClelland,et al.  Autonomous Mental Development by Robots and Animals , 2001, Science.

[21]  M. Sugeno,et al.  Derivation of Fuzzy Control Rules from Human Operator's Control Actions , 1983 .

[22]  Antonio Torralba,et al.  Building the gist of a scene: the role of global image features in recognition. , 2006, Progress in brain research.

[23]  Qing Zhang,et al.  Analysis of positive and negative emotions in natural scene using brain activity and GIST , 2009, Neurocomputing.

[24]  Minho Lee,et al.  Adaptive object recognition model using incremental feature representation and hierarchical classification , 2012, Neural Networks.

[25]  Yu Ying-lin,et al.  Image Retrieval by Emotional Semantics: A Study of Emotional Space and Feature Extraction , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[26]  D. Heeger,et al.  Reliability of cortical activity during natural stimulation , 2010, Trends in Cognitive Sciences.

[27]  R. Held,et al.  MOVEMENT-PRODUCED STIMULATION IN THE DEVELOPMENT OF VISUALLY GUIDED BEHAVIOR. , 1963, Journal of comparative and physiological psychology.

[28]  Alberto Del Bimbo,et al.  Semantics in Visual Information Retrieval , 1999, IEEE Multim..

[29]  M. Sugeno,et al.  Structure identification of fuzzy model , 1988 .

[30]  M. Erb,et al.  Brain activity underlying emotional valence and arousal: A response‐related fMRI study , 2004, Human brain mapping.

[31]  Didier Dubois,et al.  Possibility theory is not fully compositional! A comment on a short note by H.J. Greenberg , 1998, Fuzzy Sets Syst..

[32]  P. Lang International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[33]  L. C. Sellin,et al.  Wavelet and Wavelet Packet Decomposition of RR and RT/sub MAX/ Interval Time Series , 1997, Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 'Magnificent Milestones and Emerging Opportunities in Medical Engineering' (Cat. No.97CH36136).

[34]  E. Hudlicka Increaing Sia Architecture Realism by Modeling and Adapting to Affect and Personality , 2002 .