TGC20ReId: A dataset for sport event re-identification in the wild

Abstract Person re-identification (Re-ID) is the task of retrieving a person of interest taken from different cameras or from the same camera in different occasions. To address this challenging task, a large amount of labelled data is required both for testing and for learning. Such high quality annotated data is still rare for many Re-ID applications. In this paper, we introduce a novel dataset to evaluate Re-ID methods in complex real-world scenarios. In this case, we will be using a sporting event as the scenario. For this aim, participants in a 128 km night and day course were captured in five different recording points along the track and later manually identified and annotated. The dataset is evaluated using state-of-the-art techniques and wide array of experimental setups are considered, such as: day vs. night, motion blur, changes in clothing, etc. The evaluation suggests that the features present in the proposed dataset (time difference, unrestricted weather and illumination capture conditions, and the possibility of clothes changes between probe and gallery) pose a challenging scenario for future development in the Re-ID problem.

[1]  Hai Tao,et al.  Viewpoint Invariant Pedestrian Recognition with an Ensemble of Localized Features , 2008, ECCV.

[2]  Xiaoming Liu,et al.  Sports Videos in the Wild (SVW): A video dataset for sports analysis , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[3]  Wei Jiang,et al.  AlignedReID++: Dynamically matching local information for person re-identification , 2019, Pattern Recognit..

[4]  Jiahuan Zhou,et al.  Easy Identification from Better Constraints: Multi-shot Person Re-identification from Reference Constraints , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[5]  Chu-Sing Yang,et al.  Improved local binary pattern for real scene optical character recognition , 2017, Pattern Recognit. Lett..

[6]  Ada Wrońska,et al.  Athlete number detection on the basis of their face images , 2017, 2017 International Conference on Biometrics and Kansei Engineering (ICBAKE).

[7]  Alessandro Perina,et al.  Person re-identification by symmetry-driven accumulation of local features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Shaogang Gong,et al.  The Re-identification Challenge , 2014, Person Re-Identification.

[9]  Shaogang Gong,et al.  Person re-identification by probabilistic relative distance comparison , 2011, CVPR 2011.

[10]  Yukun Yang,et al.  Multi-camera multi-player tracking with deep player identification in sports video , 2020, Pattern Recognit..

[11]  Qi Tian,et al.  MARS: A Video Benchmark for Large-Scale Person Re-Identification , 2016, ECCV.

[12]  Bir Bhanu,et al.  Pose-Guided R-CNN for Jersey Number Recognition in Sports , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[13]  Shaogang Gong,et al.  Towards Open-World Person Re-Identification by One-Shot Group-Based Verification , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Qi Tian,et al.  Scalable Person Re-identification: A Benchmark , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[15]  Adrian Hilton,et al.  Computer Vision in Sports , 2015, Comput. Vis. Image Underst..

[16]  Shaogang Gong,et al.  International Journal of Computer Vision (The original publication is available at www.springerlink.com) Time-Delayed Correlation Analysis for Multi-Camera Activity Understanding , 2009 .

[17]  William Robson Schwartz,et al.  Single-Shot Person Re-Identification Combining Similarity Metrics and Support Vectors , 2018, 2018 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI).

[18]  Yang Yang,et al.  ABD-Net: Attentive but Diverse Person Re-Identification , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[19]  Díbio Leandro Borges,et al.  An Improved Stroke Width Transform to Detect Race Bib Numbers , 2018, MCPR.

[20]  Mang Ye,et al.  A Survey of Open-World Person Re-Identification , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Adrian Hilton,et al.  Computer vision for sports: Current applications and research topics , 2017, Comput. Vis. Image Underst..

[22]  Hsin-Mu Tsai,et al.  LightBib: Marathoner Recognition System with Visible Light Communications , 2015, 2015 IEEE International Conference on Data Science and Data Intensive Systems.

[23]  Pei Xu,et al.  Person Re-identification with End-to-End Scene Text Recognition , 2017, CCCV.

[24]  Cuiping Zhang,et al.  Automatic detection technology of sports athletes based on image recognition technology , 2019, EURASIP Journal on Image and Video Processing.

[25]  Sergio Guadarrama,et al.  Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  James J. Little,et al.  Learning to Track and Identify Players from Broadcast Sports Videos , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Fei-Fei Li,et al.  What, where and who? Classifying events by scene and object recognition , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[28]  Mark Everingham,et al.  Clustered Pose and Nonlinear Appearance Models for Human Pose Estimation , 2010, BMVC.