OBJECT-ORIENTED LOGIC PROGRAMMING OF 3D INTELLIGENT VIDEO SURVEILLANCE SYSTEMS: THE PROBLEM STATEMENT

An approach to the 3D intelligent video surveillance based on the means of the objectoriented logic programming is proposed. In contrast to the conventional 2D video surveillance, the methods of 3D vision provide reliable recognition of parts of the human body that makes possible a new statement of the problem and efficient practical application of methods of people behaviour analysis in the video surveillance systems. The logic-based approach to the intelligent video surveillance allows easy definition of people complex behaviour in terms of simpler activities and postures. The goal of this work is to implement the advantages of the logic programming approach in the area of 3D intelligent video surveillance.

[1]  Yaser Mowafi,et al.  Anatomical-plane-based representation for human-human interactions analysis , 2015, Pattern Recognit..

[2]  Suya You,et al.  3D video surveillance with Augmented Virtual Environments , 2003, IWVS '03.

[3]  Gerald M. Knapp,et al.  Aggressive actions and anger detection from multiple modalities using Kinect , 2016, ArXiv.

[4]  Hong Wei,et al.  A survey of human motion analysis using depth imagery , 2013, Pattern Recognit. Lett..

[5]  S. Naveen,et al.  RGB-D Face Recognition System Verification Using Kinect and FRAV3D Databases☆ , 2015 .

[6]  Pietro Siciliano,et al.  Human posture recognition with a time-of-flight 3D sensor for in-home applications , 2013, Expert Syst. Appl..

[7]  Larry S. Davis,et al.  VidMAP: video monitoring of activity with Prolog , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[8]  Larry S. Davis,et al.  Predicate Logic Based Image Grammars for Complex Pattern Recognition , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[9]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[10]  Alexander Artikis,et al.  A logic programming approach to activity recognition , 2009, EiMM '10.

[11]  José A. Rodríguez-Serrano,et al.  Robust abandoned object detection integrating wide area visual surveillance and social context , 2013, Pattern Recognit. Lett..

[12]  Wenbing Zhao,et al.  A Survey of Applications and Human Motion Recognition with Microsoft Kinect , 2015, Int. J. Pattern Recognit. Artif. Intell..

[13]  Stephen O'Hara.  VERSA- Video event recognition for surveillance applications , 2008 .

[14]  Deb Roy,et al.  An immersive system for browsing and visualizing surveillance video , 2010, ACM Multimedia.

[15]  Hong Liu,et al.  Unusual events detection based on multi-dictionary sparse representation using kinect , 2013, 2013 IEEE International Conference on Image Processing.

[16]  Angelos Barmpoutis,et al.  Tensor Body: Real-Time Reconstruction of the Human Body and Avatar Synthesis From RGB-D , 2013, IEEE Transactions on Cybernetics.

[17]  Claudia Linnhoff-Popien,et al.  Gait Recognition with Kinect , 2012 .

[18]  M.J.T. Veltmaat.  Recognizing Activities with the Kinect: a logic-based approach for the support room , 2013 .

[19]  A. A. Morozov.  Logic Object-Oriented Model of Asynchronous Concurrent Computations 1 , 2003 .

[20]  Max Mignotte,et al.  Fall Detection from Depth Map Video Sequences , 2011, ICOST.

[21]  Fabio Roli,et al.  Real-time Appearance-based Person Re-identification Over Multiple KinectTM Cameras , 2013, VISAPP.

[22]  Alexei A. Morozov,et al.  An Approach to the Intelligent Monitoring of Anomalous Human Behaviour Based on the Actor Prolog Object-Oriented Logic Language , 2015, Challenge+DC@RuleML.

[23]  Fei Han,et al.  Space-Time Representation of People Based on 3D Skeletal Data: A Review , 2016, Comput. Vis. Image Underst..

[24]  Alexandros André Chaaraoui,et al.  Abnormal gait detection with RGB-D devices using joint motion history features , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[25]  Larry S. Davis,et al.  W/sup 4/: Who? When? Where? What? A real time system for detecting and tracking people , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[26]  Léon J. M. Rothkrantz,et al.  Kinect Sensing of Shopping Related Actions , 2011, AmI Workshops.

[27]  Marcelo R. Campo,et al.  Easy gesture recognition for Kinect , 2014, Adv. Eng. Softw..

[28]  Michael Beetz,et al.  Perception for Everyday Human Robot Interaction , 2015, KI - Künstliche Intelligenz.

[29]  Edward Y. Chang,et al.  First ACM SIGMM international workshop on Video surveillance , 2003 .

[30]  Wan-Young Chung,et al.  Visual Sensor Based Abnormal Event Detection with Moving Shadow Removal in Home Healthcare Applications , 2012, Sensors.

[31]  Kingshuk Chakravarty,et al.  Person Identification using Skeleton Information from Kinect , 2013, ACHI 2013.

[32]  Rasmus Larsen,et al.  Cluster tracking with Time-of-Flight cameras , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[33]  Andrea Cavallaro,et al.  Video-Based Human Behavior Understanding: A Survey , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Alexei A. Morozov,et al.  Development of the Logic Programming Approach to the Intelligent Monitoring of Anomalous Human Behaviour , 2015, IMTA.

[35]  Ling Shao,et al.  Enhanced Computer Vision With Microsoft Kinect Sensor: A Review , 2013, IEEE Transactions on Cybernetics.

[36]  A. A. Morozov,et al.  REAL-TIME ANALYSIS OF VIDEO BY MEANS OF THE ACTOR PROLOG LANGUAGE , 2016 .

[37]  Ching-Tang Hsieh,et al.  A Kinect-based people-flow counting system , 2012, 2012 International Symposium on Intelligent Signal Processing and Communications Systems.

[38]  Alexei A. Morozov,et al.  Development of Concurrent Object-Oriented Logic Programming Platform for the Intelligent Monitoring of Anomalous Human Activities , 2014, BIOSTEC.

[39]  Moi Hoon Yap,et al.  Sensing Behaviour using the Kinect : Identifying Characteristic Features of Instability and Poor Performance during Challenging Balancing Tasks , 2016 .

[40]  Jake K. Aggarwal,et al.  Human activity recognition from 3D data: A review , 2014, Pattern Recognit. Lett..

[41]  Roger Stettner,et al.  THREE DIMENSIONAL FLASH LADAR FOCAL PLANES AND TIME DEPENDENT IMAGING , 2008 .

[42]  Csaba Benedek,et al.  3D people surveillance on range data sequences of a rotating Lidar , 2014, Pattern Recognit. Lett..

[43]  Daniel Thalmann,et al.  Advanced virtual reality technologies for surveillance and security applications , 2006, VRCIA '06.

[44]  Alexei A. Morozov.  Operational Approach to the Modified Reasoning , Based on the Concept of Repeated Proving and Logical Actors , 2007 .

[45]  A. A. Morozov.  Development of a method for intelligent video monitoring of abnormal behavior of people based on parallel object-oriented logic programming , 2015, Pattern Recognition and Image Analysis.

[46]  Lau Bee Theng,et al.  Non-invasive monitoring of people with disabilities via motion detection , 2014 .

[47]  A. Morozov,et al.  Actor Prolog: an Object-Oriented Language with the Classical Declarative Semantics , 1999 .

[48]  Takeo Kanade,et al.  Dynamic seethroughs: Synthesizing hidden views of moving objects , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[49]  Alexander Artikis,et al.  Event Recognition for Unobtrusive Assisted Living , 2014, SETN.

[50]  Ankit Chaudhary,et al.  Robust gesture recognition using Kinect: A comparison between DTW and HMM , 2015 .

[51]  Bernhard Rinner,et al.  Real time complex event detection for resource-limited multimedia sensor networks , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[52]  Alexander Artikis,et al.  A probabilistic logic programming event calculus , 2012, Theory and Practice of Logic Programming.

[53]  Eugenio Di Sciascio,et al.  Semantic Matchmaking for Kinect-Based Posture and Gesture Recognition , 2014, 2014 IEEE International Conference on Semantic Computing.

[54]  Alexei A. Morozov,et al.  A Translator of Actor Prolog to Java , 2015, Challenge+DC@RuleML.

[55]  Peter H. N. de With,et al.  Flexible Human Behavior Analysis Framework for Video Surveillance Applications , 2010, Int. J. Digit. Multim. Broadcast..

[56]  Marco La Cascia,et al.  3D skeleton-based human action classification: A survey , 2016, Pattern Recognit..

[57]  Nathan Clarke,et al.  Multimodal Biometric Surveillance using a Kinect Sensor , 2013 .

[58]  Dimitrios Makris,et al.  Fall detection system using Kinect’s infrared sensor , 2014, Journal of Real-Time Image Processing.