People Semantic Description and Re-identification from Point Cloud Geometry

The automatic extraction of biometric descriptors of anonymous people is a challenging scenario in camera networks. This task is typically accomplished making use of visual information. Calibrated RGBD sensors make possible the extraction of point cloud information. We present a novel approach for people semantic description and re-identification using the individual point cloud information. The proposal combines the use of simple geometric features with point cloud features based on surface normals. To test the system validity, we have collected a new and challenging dataset using a RGBD sensor in a top view configuration containing up to 63 identities captured in different sessions in different days within a two weeks period. The results achieved outperform the previous literature based exclusively on geometric features for re-identification, providing additionally very promising results in people description related to gender and hair style.

[1]  Nuno Vasconcelos,et al.  Counting People With Low-Level Features and Bayesian Regression , 2012, IEEE Transactions on Image Processing.

[2]  Kai Oliver Arras,et al.  People detection in RGB-D data , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Nuno Vasconcelos,et al.  Privacy preserving crowd monitoring: Counting people without people models or tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Gwenn Englebienne,et al.  Fast Bayesian people detection , 2010 .

[5]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[6]  Antonio Albiol,et al.  3D descriptor for people re-identification , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[7]  Alessio Del Bue,et al.  Re-identification with RGB-D Sensors , 2012, ECCV Workshops.

[8]  Fabio Roli,et al.  Real-time Appearance-based Person Re-identification Over Multiple KinectTM Cameras , 2013, VISAPP.

[9]  Antonio Albiol,et al.  Re-identifying people in the wild , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  James M. Keller,et al.  Histogram of Oriented Normal Vectors for Object Recognition with a Depth Sensor , 2012, ACCV.

[11]  Jörg Stückler,et al.  SURE: Surface Entropy for Distinctive 3D Features , 2012, Spatial Cognition.

[12]  Javier Lorenzo-Navarro,et al.  On the Use of Simple Geometric Descriptors Provided by RGB-D Sensors for Re-Identification , 2013, Sensors.

[13]  Janne Heikkilä,et al.  A real-time system for monitoring of cyclists and pedestrians , 2004, Image Vis. Comput..

[14]  J. M. Mossi,et al.  Who is who at different cameras: people re-identification using depth cameras , 2012 .

[15]  Ling Shao,et al.  Enhanced Computer Vision With Microsoft Kinect Sensor: A Review , 2013, IEEE Transactions on Cybernetics.

[16]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[17]  Gwenn Englebienne,et al.  Person re-identification using height-based gait in colour depth camera , 2013, 2013 IEEE International Conference on Image Processing.