Methods for Determination of Psychophysiological Condition of User Within Smart Environment Based on Complex Analysis of Heterogeneous Data

Smart Environments (SE)’ implementation provides great possibilities and services for users. But also such systems can be potentially harmful in terms of destructive behavior that can be met in this kind of informational space. In this case, it is important to prevent such information from users, especially from children. To solve this problem, it is necessary to analyze all available information in such systems: video (images), text, and audio. In this paper, the review of state-of-the-art methods of data analysis from different modalities is presented. Also the way of transfer learning technique implementation of heterogeneous data analysis is proposed.