Tracking People across Multiple Non-overlapping RGB-D Sensors

This work presents the development of a surveillance system for monitoring wide area indoor spaces using multiple Kinect devices. The data from these sensors, configured with the widest possible coverage, is integrated into a single coordinate system using a novel calibration technique for non-overlapping range sensors. Moving 3D pixels from each Kinect are transformed into a "plan view" map of activity where the detection and tracking of people is executed. The detection of people is a two step process, data binning and non maxima suppression. The tracking of people is based on the mean-shift algorithm optimized with the prediction step of the Kalman Filter.

[1]  Kai Oliver Arras,et al.  People detection in RGB-D data , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Michael Harville,et al.  Stereo person tracking with short and long term plan-view appearance models of shape and color , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[3]  Dorin Comaniciu,et al.  Mean shift and optimal prediction for efficient object tracking , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[4]  Luis Salgado,et al.  Robust 3D people tracking and positioning system in a semi-overlapped multi-camera environment , 2008, 2008 15th IEEE International Conference on Image Processing.

[5]  Yoichi Sato,et al.  3D Head Tracking using the Particle Filter with Cascaded Classifiers , 2006, BMVC.

[6]  Luigi di Stefano,et al.  People Tracking Using a Time-of-Flight Depth Sensor , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[7]  Luc Van Gool,et al.  Color-Based Object Tracking in Multi-camera Environments , 2003, DAGM-Symposium.

[8]  Sergio A. Velastin,et al.  People tracking in surveillance applications , 2006, Image Vis. Comput..

[9]  Tim Ellis,et al.  Tracking occluded objects using partial observation , 2003 .

[10]  Yael Moses,et al.  Tracking in a Dense Crowd Using Multiple Cameras , 2010, International Journal of Computer Vision.

[11]  Luc Van Gool,et al.  An adaptive color-based particle filter , 2003, Image Vis. Comput..

[12]  Silvio Savarese,et al.  Detecting and tracking people using an RGB-D camera via multiple detector fusion , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[13]  Sergio A. Velastin,et al.  Occlusion tolerent tracking using hybrid prediction schemes , 2003 .

[14]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[15]  Peter H. N. de With,et al.  Employing a RGB-D sensor for real-time tracking of humans across multiple re-entries in a smart environment , 2012, IEEE Transactions on Consumer Electronics.

[16]  David Kim,et al.  Shake'n'sense: reducing interference for overlapping structured light depth cameras , 2012, CHI.