Automated Destructive Behavior State Detection on the 1D CNN-Based Voice Analysis

The article considers one of the approaches to the solution of the problem of finding the effect of a user on the Internet through media files including acoustic materials. The solution to the given problem is a part of the project on the development of a uniform socio-cyberphysical control system of the Internet content to identify the destructive materials and protect Internet users. Authors developed an algorithm including a classification model based on an artificial neural network (1D CNN-based) with the application of deep learning and the further application of the statistical probability approach to the solution of the problem of identification of the destructive type of emotion with the accuracy of 74%. The article considers one of the approaches to solving the problem of identifying the impact on the Internet of a user through media files, including acoustic materials. The solution to this problem is an integral part of the project to create a unified socio-cyberphysical system for managing Internet content in order to identify destructive materials and protect network users.

[1]  Matthias Hein,et al.  Variants of RMSProp and Adagrad with Logarithmic Regret Bounds , 2017, ICML.

[2]  Ayoub Al-Hamadi,et al.  “BioVid Emo DB”: A multimodal database for emotion analyses validated by subjective ratings , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[3]  Astrid Paeschke,et al.  A database of German emotional speech , 2005, INTERSPEECH.

[4]  Maja J. Mataric,et al.  A Framework for Automatic Human Emotion Classification Using Emotion Profiles , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[5]  P. Jackson,et al.  Multimodal Emotion Recognition , 2010 .

[6]  Carlos Busso,et al.  IEMOCAP: interactive emotional dyadic motion capture database , 2008, Lang. Resour. Evaluation.

[7]  Aman Jantan,et al.  Comprehensive Review of Artificial Neural Network Applications to Pattern Recognition , 2019, IEEE Access.

[8]  Dmitrii Malov,et al.  Methods for Determination of Psychophysiological Condition of User Within Smart Environment Based on Complex Analysis of Heterogeneous Data , 2020 .

[9]  Margaret Lech,et al.  Towards real-time Speech Emotion Recognition using deep neural networks , 2015, 2015 9th International Conference on Signal Processing and Communication Systems (ICSPCS).

[10]  Kosai Raoof,et al.  Speech Emotion Recognition: Methods and Cases Study , 2018, ICAART.

[11]  Yong Peng,et al.  EEG-based emotion classification using deep belief networks , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[12]  Mark A Gregory,et al.  A novel approach for MFCC feature extraction , 2010, 2010 4th International Conference on Signal Processing and Communication Systems.

[13]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[14]  A. Iskhakova,et al.  Research of the estimated emotional components for the content analysis , 2019, Journal of Physics: Conference Series.

[15]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[16]  Dong Yu,et al.  Speech emotion recognition using deep neural network and extreme learning machine , 2014, INTERSPEECH.