Multiple people extraction using 3D range sensor

We propose a novel system for extracting multiple people in crowded scenes by employing LED 3D range sensor. This new kind of device can capture depth image at a relatively high frame speed, which makes the extraction of dynamic objects possible. However, it suffers from the strong noise caused by the environment illumination. Here we propose a novel method for multiple people extraction by integrating an improved version of mean-shift clustering algorithm and total variation based denoising technique. When handling the depth image, it is considered both as a point cloud as well as a 2D image. In this way, different properties of the depth image are sufficiently exploited. The proposed method can fully automatically extract multiple people in a cluttered environment, even from a mobile platform. The experiment conducted at the platform of a railway station demonstrates the effectiveness of our proposed algorithm.

[1]  Christian Micheloni,et al.  Video security for ambient intelligence , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[2]  Leonidas J. Guibas,et al.  Counting people in crowds with a real-time network of simple image sensors , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[3]  A. Broggi,et al.  A multi-resolution approach for infrared vision-based pedestrian detection , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[4]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2005, International Journal of Computer Vision.

[5]  Bernt Schiele,et al.  Pedestrian detection in crowded scenes , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Dariu Gavrila,et al.  Multi-cue Pedestrian Detection and Tracking from a Moving Vehicle , 2007, International Journal of Computer Vision.

[7]  N. Sochen,et al.  Texture Preserving Variational Denoising Using an Adaptive Fidelity Term , 2003 .