Multi-view Person Re-identification in a Fisheye Camera Network with Different Viewing Directions

Person re-identification is a crucial component for multi-camera networks in different real-world applications such as surveillance, automation, and business analytics. Despite considerable recent progress, the performance in practice is still not satisfactory due to the high intra-person variation and significant complexity of the task, including differences in scale, viewing direction, and illumination. We propose a novel approach for person re-identification, which exploits multi-view information of a fisheye camera looking downwards from the ceiling. To handle this highly variable multi-view information, we build a generic pipeline for processing fisheye camera imagery based on geometric sensor modelling and deep learning. The proposed approach is evaluated on a re-mapped version of the publicly available Market-1501 dataset, and, in addition, on a new fisheye dataset. Significant improvements are shown in our experiments: our approach achieves more than 97% rank#1 recognition rate if applied on the re-mapped Market-1501 dataset; on the new fisheye dataset we find an improvement of about 12% compared to random-view fusion.

[1]  Albert Ali Salah,et al.  Feature-based tracking on a multi-omnidirectional camera dataset , 2012, 2012 5th International Symposium on Communications, Control and Signal Processing.

[2]  Cheng Deng,et al.  Deep View-Aware Metric Learning for Person Re-Identification , 2018, IJCAI.

[3]  Andreas Eberle.  Pose-Driven Deep Models for Person Re-Identification , 2018, ArXiv.

[4]  Hai Tao,et al.  Evaluating Appearance Models for Recognition, Reacquisition, and Tracking , 2007 .

[5]  Christian Heipke,et al.  BIFOCAL STEREO FOR MULTIPATH PERSON RE-IDENTIFICATION , 2017 .

[6]  Christopher Mei.  Couplage vision omnidirectionnelle et télémétrie laser pour la navigation en robotique , 2007 .

[7]  Rita Cucchiara,et al.  People reidentification in surveillance and forensics , 2013, ACM Comput. Surv..

[8]  Hong Liu,et al.  Orientation Driven Bag of Appearances for Person Re-identification , 2016, ArXiv.

[9]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Jian-Huang Lai,et al.  Robust Depth-Based Person Re-Identification , 2017, IEEE Transactions on Image Processing.

[11]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Helder Araújo,et al.  Issues on the geometry of central catadioptric image formation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  Lucas Beyer,et al.  In Defense of the Triplet Loss for Person Re-Identification , 2017, ArXiv.

[14]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[15]  Xiaogang Wang,et al.  DeepReID: Deep Filter Pairing Neural Network for Person Re-identification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Sebastian Ramos,et al.  The Cityscapes Dataset for Semantic Urban Scene Understanding , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Shishir K. Shah,et al.  A survey of approaches and trends in person re-identification , 2014, Image Vis. Comput..

[18]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[19]  Xiaogang Wang,et al.  Spindle Net: Person Re-identification with Human Body Region Guided Feature Decomposition and Fusion , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Liang Zheng,et al.  Dissecting Person Re-Identification From the Viewpoint of Viewpoint , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Hadi Soltanizadeh,et al.  Person Reidentification Using Local Pattern Descriptors and Anthropometric Measures From Videos of Kinect Sensor , 2016, IEEE Sensors Journal.

[22]  Kuk-Jin Yoon,et al.  Improving Person Re-identification via Pose-Aware Multi-shot Matching , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Julius Ziegler,et al.  Calibrating multiple cameras with non-overlapping views using coded checkerboard targets , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[24]  Stefan Roth,et al.  MOTChallenge 2015: Towards a Benchmark for Multi-Target Tracking , 2015, ArXiv.

[25]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[26]  Dean Brown,et al.  Decentering distortion of lenses , 1966 .

[27]  Stefan Roth,et al.  MOT16: A Benchmark for Multi-Object Tracking , 2016, ArXiv.

[28]  Slawomir Bak,et al.  Domain Adaptation through Synthesis for Unsupervised Person Re-identification , 2018, ECCV.

[29]  Emad Monier Mosaad Ibrahim.  Vision based tracking in team sports , 2011 .

[30]  Qi Tian,et al.  Scalable Person Re-identification: A Benchmark , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[31]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[32]  Takahiro Okabe,et al.  Hierarchical Gaussian Descriptor for Person Re-identification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Zhen Zhou,et al.  See the Forest for the Trees: Joint Spatial and Temporal Recurrent Neural Networks for Video-Based Person Re-identification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Jie Yu,et al.  View-Aware Person Re-identification , 2018, GCPR.

[35]  Christian Heipke,et al.  Semantic Segmentation of Fisheye Images , 2018, ECCV Workshops.

[36]  Kaiqi Huang,et al.  Beyond Triplet Loss: A Deep Quadruplet Network for Person Re-identification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Jesús Martínez del Rincón,et al.  Recurrent Convolutional Network for Video-Based Person Re-identification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Francesco Solera,et al.  Performance Measures and a Data Set for Multi-target, Multi-camera Tracking , 2016, ECCV Workshops.

[39]  Imran Ahmed.  Person detection using wide angle overhead cameras , 2014 .

[40]  Liang Zheng,et al.  Re-ranking Person Re-identification with k-Reciprocal Encoding , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Yao Wang,et al.  Human detection in fish-eye images using HOG-based detectors over rotated windows , 2014, 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[42]  Mang Ye,et al.  A Survey of Open-World Person Re-Identification , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[43]  Wei-Shi Zheng,et al.  Cross-View Asymmetric Metric Learning for Unsupervised Person Re-Identification , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[44]  Horst Bischof,et al.  Large scale metric learning from equivalence constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Yi Yang,et al.  Person Re-identification: Past, Present and Future , 2016, ArXiv.

[46]  Gang Wang,et al.  A Siamese Long Short-Term Memory Architecture for Human Re-identification , 2016, ECCV.

[47]  Ziyan Wu,et al.  A Comprehensive Evaluation and Benchmark for Person Re-Identification: Features, Metrics, and Datasets , 2016, ArXiv.

[48]  Kostas Daniilidis,et al.  A Unifying Theory for Central Panoramic Systems and Practical Applications , 2000, ECCV.

[49]  Li Fei-Fei,et al.  Recurrent Attention Models for Depth-Based Person Identification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[51]  Bingbing Ni,et al.  Person Re-identification via Recurrent Feature Aggregation , 2016, ECCV.

[52]  M. Saquib Sarfraz,et al.  A Pose-Sensitive Embedding for Person Re-identification with Expanded Cross Neighborhood Re-ranking , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[53]  Wei Jiang,et al.  SphereReID: Deep Hypersphere Manifold Embedding for Person Re-Identification , 2018, J. Vis. Commun. Image Represent..

[54]  Xiaoxiao Li,et al.  Video Object Segmentation with Joint Re-identification and Attention-Aware Mask Propagation , 2018, ECCV.