Coupling Fall Detection and Tracking in Omnidirectional Cameras

Omnidirectional cameras have many advantages for action and activity detection in indoor scenarios, but computer vision approaches that are developed for conventional cameras require extension and modification to work with such cameras. In this paper we use multiple omnidirectional cameras to observe the inhabitants of a room, and use Hierarchical Hidden Markov Models for detecting falls. To track the people in the room, we extend a generative approach that uses probabilistic occupancy maps to omnidirectional cameras. To speed up computation, we also propose a novel method to approximate the integral image over non-rectangular shapes. The resulting system is tested successfully on a database with severe noise and frame loss conditions.

[1]  Pascal Fua,et al.  Multicamera People Tracking with a Probabilistic Occupancy Map , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Bogdan Kwolek,et al.  Fall Detection Using Kinect Sensor and Fall Energy Image , 2013, HAIS.

[3]  Albert Ali Salah,et al.  Feature-based tracking on a multi-omnidirectional camera dataset , 2012, 2012 5th International Symposium on Communications, Control and Signal Processing.

[4]  Paul Lukowicz,et al.  Collecting complex activity datasets in highly rich networked sensor environments , 2010, 2010 Seventh International Conference on Networked Sensing Systems (INSS).

[5]  Stephen J. McKenna,et al.  Activity summarisation and fall detection in a supportive home environment , 2004, ICPR 2004.

[6]  Rita Cucchiara,et al.  A multi‐camera vision system for fall detection and alarm generation , 2007, Expert Syst. J. Knowl. Eng..

[7]  Ling Shao,et al.  A survey on fall detection: Principles and approaches , 2013, Neurocomputing.

[8]  A. Enis Çetin,et al.  HMM Based Falling Person Detection Using Both Audio and Video , 2005, 2006 IEEE 14th Signal Processing and Communications Applications.

[9]  Sung-Bae Cho,et al.  Hybrid Artificial Intelligent Systems , 2015, Lecture Notes in Computer Science.

[10]  A K Bourke,et al.  Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm. , 2007, Gait & posture.

[11]  Vittorio Ferrari,et al.  Appearance Sharing for Collective Human Pose Estimation , 2012, ACCV.

[12]  Nicolas Thome,et al.  A Real-Time, Multiview Fall Detection System: A LHMM-Based Approach , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Jean Meunier,et al.  Fall Detection from Human Shape and Motion History Using Video Surveillance , 2007, 21st International Conference on Advanced Information Networking and Applications Workshops (AINAW'07).

[14]  Nicu Sebe,et al.  Computer Vision in Human-Computer Interaction , 2004, Lecture Notes in Computer Science.

[15]  Roland Siegwart,et al.  A Toolbox for Easily Calibrating Omnidirectional Cameras , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Peter H. N. de With,et al.  Video-Based Fall Detection in the Home Using Principal Component Analysis , 2008, ACIVS.

[17]  Shaou-Gang Miaou,et al.  A Human Fall Detection System Using an Omni-Directional Camera in Practical Environments for Health Care Applications , 2009, MVA.

[18]  A. Bourke,et al.  Fall detection - Principles and Methods , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[19]  Jr. G. Forney,et al.  The viterbi algorithm , 1973 .

[20]  Luc Van Gool,et al.  Exploiting simple hierarchies for unsupervised human behavior analysis , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Rainer Stiefelhagen,et al.  Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics , 2008, EURASIP J. Image Video Process..

[22]  Yasushi Yagi,et al.  Omnidirectional Sensing and Its Applications , 1999 .

[23]  S. Miaou,et al.  A Customized Human Fall Detection System Using Omni-Camera Images and Personal Information , 2006, 1st Transdisciplinary Conference on Distributed Diagnosis and Home Healthcare, 2006. D2H2..

[24]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[25]  Nicu Sebe,et al.  Computer vision for ambient intelligence , 2011, J. Ambient Intell. Smart Environ..

[26]  Anthony G. Cohn,et al.  Egocentric Activity Monitoring and Recovery , 2012, ACCV.