Object-oriented logic programming of 3D intelligent video surveillance: The problem statement

An approach to the 3D intelligent video surveillance based on the means of the object-oriented logic programming is proposed. In contrast to the conventional 2D video surveillance, the methods of 3D vision provide reliable recognition of parts of the human body that makes possible a new statement of the problem and efficient practical application of methods of people behaviour analysis in the video surveillance systems. The logic-based approach to the intelligent video surveillance allows easily definition of people complex behaviour in terms of simpler activities and postures. The goal of this work is to implement the advantages of the logic programming approach in the area of 3D intelligent video surveillance.

[1]  Alexander Artikis,et al.  A logic programming approach to activity recognition , 2009, EiMM '10.

[2]  A. Morozov,et al.  Actor Prolog: an Object-Oriented Language with the Classical Declarative Semantics , 1999 .

[3]  José A. Rodríguez-Serrano,et al.  Robust abandoned object detection integrating wide area visual surveillance and social context , 2013, Pattern Recognit. Lett..

[4]  Wenbing Zhao,et al.  A Survey of Applications and Human Motion Recognition with Microsoft Kinect , 2015, Int. J. Pattern Recognit. Artif. Intell..

[5]  Takeo Kanade,et al.  Dynamic seethroughs: Synthesizing hidden views of moving objects , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[6]  Alexander Artikis,et al.  Event Recognition for Unobtrusive Assisted Living , 2014, SETN.

[7]  PeopleIsmail,et al.  W 4 : Who ? When ? Where ? What ? A Real Time System for Detecting and Tracking , 1998 .

[8]  MakrisDimitrios,et al.  Fall detection system using Kinect's infrared sensor , 2014 .

[9]  Fabio Roli,et al.  Real-time Appearance-based Person Re-identification Over Multiple KinectTM Cameras , 2013, VISAPP.

[10]  Rasmus Larsen,et al.  Cluster tracking with Time-of-Flight cameras , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[11]  Max Mignotte,et al.  Fall Detection from Depth Map Video Sequences , 2011, ICOST.

[12]  Alexei A. Morozov,et al.  Development of the Logic Programming Approach to the Intelligent Monitoring of Anomalous Human Behaviour , 2015, IMTA.

[13]  A. A. Morozov.  Development of a method for intelligent video monitoring of abnormal behavior of people based on parallel object-oriented logic programming , 2015, Pattern Recognition and Image Analysis.

[14]  Roger Stettner,et al.  THREE DIMENSIONAL FLASH LADAR FOCAL PLANES AND TIME DEPENDENT IMAGING , 2008 .

[15]  Alexei A. Morozov,et al.  An Approach to the Intelligent Monitoring of Anomalous Human Behaviour Based on the Actor Prolog Object-Oriented Logic Language , 2015, Challenge+DC@RuleML.

[16]  Fei Han,et al.  Space-Time Representation of People Based on 3D Skeletal Data: A Review , 2016, Comput. Vis. Image Underst..

[17]  Alexandros André Chaaraoui,et al.  Abnormal gait detection with RGB-D devices using joint motion history features , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[18]  Marcelo R. Campo,et al.  Easy gesture recognition for Kinect , 2014, Adv. Eng. Softw..

[19]  Larry S. Davis,et al.  W/sup 4/: Who? When? Where? What? A real time system for detecting and tracking people , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[20]  Ankit Chaudhary,et al.  Robust gesture recognition using Kinect: A comparison between DTW and HMM , 2015 .

[21]  Léon J. M. Rothkrantz,et al.  Kinect Sensing of Shopping Related Actions , 2011, AmI Workshops.

[22]  Alexei A. Morozov,et al.  A Translator of Actor Prolog to Java , 2015, Challenge+DC@RuleML.

[23]  Peter H. N. de With,et al.  Flexible Human Behavior Analysis Framework for Video Surveillance Applications , 2010, Int. J. Digit. Multim. Broadcast..

[24]  Marco La Cascia,et al.  3D skeleton-based human action classification: A survey , 2016, Pattern Recognit..

[25]  Nathan Clarke,et al.  Multimodal Biometric Surveillance using a Kinect Sensor , 2013 .

[26]  Dimitrios Makris,et al.  Fall detection system using Kinect’s infrared sensor , 2014, Journal of Real-Time Image Processing.

[27]  Yaser Mowafi,et al.  Anatomical-plane-based representation for human-human interactions analysis , 2015, Pattern Recognit..

[28]  Hong Liu,et al.  Unusual events detection based on multi-dictionary sparse representation using kinect , 2013, 2013 IEEE International Conference on Image Processing.

[29]  Angelos Barmpoutis,et al.  Tensor Body: Real-Time Reconstruction of the Human Body and Avatar Synthesis From RGB-D , 2013, IEEE Transactions on Cybernetics.

[30]  Claudia Linnhoff-Popien,et al.  Gait Recognition with Kinect , 2012 .

[31]  M.J.T. Veltmaat.  Recognizing Activities with the Kinect: a logic-based approach for the support room , 2013 .

[32]  A. A. Morozov.  Logic Object-Oriented Model of Asynchronous Concurrent Computations 1 , 2003 .

[33]  Pietro Siciliano,et al.  Human posture recognition with a time-of-flight 3D sensor for in-home applications , 2013, Expert Syst. Appl..

[34]  Larry S. Davis,et al.  Predicate Logic Based Image Grammars for Complex Pattern Recognition , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[35]  Wan-Young Chung,et al.  Visual Sensor Based Abnormal Event Detection with Moving Shadow Removal in Home Healthcare Applications , 2012, Sensors.

[36]  Lau Bee Theng,et al.  Non-invasive monitoring of people with disabilities via motion detection , 2014 .

[37]  A. A. Morozov,et al.  REAL-TIME ANALYSIS OF VIDEO BY MEANS OF THE ACTOR PROLOG LANGUAGE , 2016 .

[38]  Kingshuk Chakravarty,et al.  Person Identification using Skeleton Information from Kinect , 2013, ACHI 2013.

[39]  Csaba Benedek,et al.  3D people surveillance on range data sequences of a rotating Lidar , 2014, Pattern Recognit. Lett..

[40]  Daniel Thalmann,et al.  Advanced virtual reality technologies for surveillance and security applications , 2006, VRCIA '06.

[41]  Alexei A. Morozov.  Operational Approach to the Modified Reasoning , Based on the Concept of Repeated Proving and Logical Actors , 2007 .

[42]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[43]  Alexei A. Morozov,et al.  Development of Concurrent Object-Oriented Logic Programming Platform for the Intelligent Monitoring of Anomalous Human Activities , 2014, BIOSTEC.

[44]  Moi Hoon Yap,et al.  Sensing Behaviour using the Kinect : Identifying Characteristic Features of Instability and Poor Performance during Challenging Balancing Tasks , 2016 .

[45]  Jake K. Aggarwal,et al.  Human activity recognition from 3D data: A review , 2014, Pattern Recognit. Lett..

[46]  Ling Shao,et al.  Enhanced Computer Vision With Microsoft Kinect Sensor: A Review , 2013, IEEE Transactions on Cybernetics.

[47]  Andrea Cavallaro,et al.  Video-Based Human Behavior Understanding: A Survey , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[48]  Gerald M. Knapp,et al.  Aggressive actions and anger detection from multiple modalities using Kinect , 2016, ArXiv.

[49]  Hong Wei,et al.  A survey of human motion analysis using depth imagery , 2013, Pattern Recognit. Lett..

[50]  Bernhard Rinner,et al.  Real time complex event detection for resource-limited multimedia sensor networks , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[51]  Alexander Artikis,et al.  A probabilistic logic programming event calculus , 2012, Theory and Practice of Logic Programming.

[52]  Michael Beetz,et al.  Perception for Everyday Human Robot Interaction , 2015, KI - Künstliche Intelligenz.

[53]  Edward Y. Chang,et al.  First ACM SIGMM international workshop on Video surveillance , 2003 .

[54]  Ching-Tang Hsieh,et al.  A Kinect-based people-flow counting system , 2012, 2012 International Symposium on Intelligent Signal Processing and Communications Systems.

[55]  Eugenio Di Sciascio,et al.  Semantic Matchmaking for Kinect-Based Posture and Gesture Recognition , 2014, 2014 IEEE International Conference on Semantic Computing.

[56]  Suya You,et al.  3D video surveillance with Augmented Virtual Environments , 2003, IWVS '03.

[57]  S. Naveen,et al.  RGB-D Face Recognition System Verification Using Kinect and FRAV3D Databases☆ , 2015 .

[58]  Larry S. Davis,et al.  VidMAP: video monitoring of activity with Prolog , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[59]  Stephen O'Hara.  VERSA- Video event recognition for surveillance applications , 2008 .

[60]  Deb Roy,et al.  An immersive system for browsing and visualizing surveillance video , 2010, ACM Multimedia.