TGCRBNW: A Dataset for Runner Bib Number Detection (and Recognition) in the Wild

Racing bib number (RBN) detection and recognition is a specific problem related to text recognition in natural scenes. In this paper, we present a novel dataset created after registering participants in a real ultrarunning competition which comprises a wide range of acquisition conditions in five different recording points, including nightlight and daylight. The dataset contains more than 3K samples of over 400 different individuals. The aim is to provide an “in the wild” benchmark for both RBN detection and recognition problems. To illustrate the present difficulties, the dataset is evaluated for RBN detection using different Faster R-CNN specific detection models, filtering its output with heuristics based on body detection to improve the overall detection performance. Initial results are promising, but there is still significant room for improvement. And detection is just the first step to accomplish “in the wild” RBN recognition.

[1]  Matti Pietikäinen,et al.  Deep Learning for Generic Object Detection: A Survey , 2018, International Journal of Computer Vision.

[2]  Yan Wong.  DEEP LEARNING BASED RACING BIB NUMBER DETECTION AND RECOGNITION , 2019 .

[3]  Ada Wrońska,et al.  Athlete number detection on the basis of their face images , 2017, 2017 International Conference on Biometrics and Kansei Engineering (ICBAKE).

[4]  Javier Lorenzo-Navarro,et al.  TGC20ReId: A dataset for sport event re-identification in the wild , 2020, Pattern Recognit. Lett..

[5]  Sergio Guadarrama,et al.  Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[7]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Palaiahnakote Shivakumara,et al.  CRNN Based Jersey-Bib Number/Text Recognition in Sports and Marathon Images , 2019, 2019 International Conference on Document Analysis and Recognition (ICDAR).

[11]  Noppakun Boonsim,et al.  Racing Bib Number Localization on Complex Backgrounds , 2018 .

[12]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[13]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[14]  Díbio Leandro Borges,et al.  An Improved Stroke Width Transform to Detect Race Bib Numbers , 2018, MCPR.

[15]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Shai Avidan,et al.  Racing Bib Number Recognition , 2012 .

[17]  Kai Wang,et al.  Word Spotting in the Wild , 2010, ECCV.

[18]  Dylan Seychell,et al.  Marathon Bib Number Recognition using Deep Learning , 2019, 2019 11th International Symposium on Image and Signal Processing and Analysis (ISPA).

[19]  Palaiahnakote Shivakumara,et al.  A new multi-modal approach to bib number/text detection and recognition in Marathon images , 2017, Pattern Recognit..

[20]  Roland M. Mueller,et al.  Racing Bib Number Recognition Using Deep Learning , 2019, AMCIS.

[21]  Chu-Sing Yang,et al.  Improved local binary pattern for real scene optical character recognition , 2017, Pattern Recognit. Lett..