Online RGB-D person re-identification based on metric model update

Abstract Person re-identification (re-id) on robot platform is an important application for human-robot-interaction (HRI), which aims at making the robot recognize the around persons in varying scenes. Although many effective methods have been proposed for surveillance re-id in recent years, re-id on robot platform is still a novel unsolved problem. Most existing methods adapt the supervised metric learning offline to improve the accuracy. However, these methods can not adapt to unknown scenes. To solve this problem, an online re-id framework is proposed. Considering that robotics can afford to use high-resolution RGB-D sensors and clear human face may be captured, face information is used to update the metric model. Firstly, the metric model is pre-trained offline using labeled data. Then during the online stage, we use face information to mine incorrect body matching pairs which are collected to update the metric model online. In addition, to make full use of both appearance and skeleton information provided by RGB-D sensors, a novel feature funnel model (FFM) is proposed. Comparison studies show our approach is more effective and adaptable to varying environments.

[1]  Shengcai Liao,et al.  Salient Color Names for Person Re-identification , 2014, ECCV.

[2]  Antonio Albiol,et al.  3D descriptor for people re-identification , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[3]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[4]  Sergio Escalera,et al.  Tri-modal Person Re-identification with RGB, Depth and Thermal Features , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[5]  Zheng Liu,et al.  Integrated Imaging and Vision Techniques for Industrial Inspection: Advances and Applications , 2015 .

[6]  Xiaogang Wang,et al.  Deep Learning Face Representation by Joint Identification-Verification , 2014, NIPS.

[7]  Fabio Roli,et al.  Multimodal Person Reidentification Using RGB-D Cameras , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Nicoletta Noceti,et al.  Semi-supervised learning of sparse representations to recognize people spatial orientation , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[9]  Matteo Munaro,et al.  A feature-based approach to people re-identification using skeleton keypoints , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Horst Bischof,et al.  Large scale metric learning from equivalence constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Shaogang Gong,et al.  Person Re-Identification , 2014 .

[12]  Jiri Matas,et al.  P-N learning: Bootstrapping binary classifiers by structural constraints , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Bingpeng Ma,et al.  Local Descriptors Encoded by Fisher Vectors for Person Re-identification , 2012, ECCV Workshops.

[14]  Jean-Marc Odobez,et al.  We are not contortionists: Coupled adaptive learning for head and body orientation estimation in surveillance video , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Matti Pietikäinen,et al.  Modeling pixel process with scale invariant local patterns for background subtraction in complex scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Fabio Roli,et al.  Fast person re-identification based on dissimilarity representations , 2012, Pattern Recognit. Lett..

[17]  Luc Van Gool,et al.  One-Shot Person Re-identification with a Consumer Depth Camera , 2014, Person Re-Identification.

[18]  Thomas B. Moeslund,et al.  Multimodal person re-identification using RGB-D sensors and a transient identification database , 2013, 2013 International Workshop on Biometrics and Forensics (IWBF).

[19]  Yasushi Makihara,et al.  Person re-identification using view-dependent score-level fusion of gait and color features , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[20]  Shengcai Liao,et al.  Person re-identification by Local Maximal Occurrence representation and metric learning , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Arun Ross,et al.  Information fusion in biometrics , 2003, Pattern Recognit. Lett..

[22]  Dong Xu,et al.  Distance Metric Learning Using Privileged Information for Face Verification and Person Re-Identification , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Luc Van Gool,et al.  3D reconstruction of freely moving persons for re-identification with a depth sensor , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Rita Cucchiara,et al.  Multi-view people surveillance using 3D information , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).