Scaling up face masks detection with YOLO on a novel dataset

Abstract Face mask detection is a challenging research problem of computer vision because of the small sized area of face mask. The unavailability of proper datasets makes this problem even harder to crack. To address this bottleneck, we propose a novel face masks detection dataset consisting of 52,635 images with more than 50,000 tight bounding boxes and annotations for four different class labels namely, with masks, without masks, masks incorrectly, and mask area, which makes it a novel contribution for variety of face masks classification and detection tasks. Further, this dataset is tested with eight variants of the YOLO algorithm to determine its effectiveness. On the proposed dataset, original YOLO v4 achieved a mAP value of 71.69 % which was highest among all the original YOLO variants, tiny YOLO v4 achieved a mAP value of 57.71 % which was highest among all tiny variants. To propose new face masks detection algorithms that can perform with high accuracy in a limited computational resources environment, we selected four tiny variants of the YOLO algorithm and proposed new architectures modifications in their feature extraction networks that increased the overall performance and specifically, improved mAP by 4.12 % for tiny YOLO v3 and 2.54 % for tiny YOLO v4.

[1]  Zhang Gang,et al.  An improved YOLOv3 algorithm to detect molting in swimming crabs against a complex background , 2020 .

[2]  Ayman Nabil,et al.  MSR-YOLO: Method to Enhance Fish Detection and Tracking in Fish Farms , 2020, ANT/EDI40.

[3]  Sakiko Yoshikawa,et al.  Hyper-realistic face masks: a new challenge in person identification , 2017, Cognitive Research: Principles and Implications.

[4]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[5]  Pei-Yung Hsiao,et al.  A two-stage real-time YOLOv2-based road marking detector with lightweight spatial transformation-invariant classification , 2020, Image Vis. Comput..

[6]  Seho Bae,et al.  A Novel GAN-Based Network for Unmasking of Masked Face , 2020, IEEE Access.

[7]  Dongxiao Li,et al.  Identifying Facemask-Wearing Condition Using Image Super-Resolution with Classification Network to Prevent COVID-19 , 2020, Sensors.

[8]  Hong-Yuan Mark Liao,et al.  YOLOv4: Optimal Speed and Accuracy of Object Detection , 2020, ArXiv.

[9]  Sebastian Nowozin,et al.  Optimal Decisions from Probabilistic Models: The Intersection-over-Union Case , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Shiming Ge,et al.  Detecting Masked Faces in the Wild with LLE-CNNs , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Md. Rabiul Islam,et al.  Implementation of Principal Component Analysis on Masked and Non-masked Face Recognition , 2019, 2019 1st International Conference on Advances in Science, Engineering and Robotics Technology (ICASERT).

[12]  Mingjie Jiang,et al.  RetinaMask: A Face Mask detector , 2020, ArXiv.

[13]  Daniel Tarlow,et al.  Optimizing Expected Intersection-Over-Union with Candidate-Constrained CRFs , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[14]  N. Mehendale,et al.  Real-Time Face Mask Identification Using Facemasknet Deep Learning Network , 2020 .

[15]  Fuquan Zhang,et al.  Flower End-to-End Detection Based on YOLOv4 Using a Mobile Device , 2020, Wirel. Commun. Mob. Comput..

[16]  Zhang Yi,et al.  An improved tiny-yolov3 pedestrian detection algorithm , 2019, Optik.

[17]  Prateek Khandelwal,et al.  Using Computer Vision to enhance Safety of Workforce in Manufacturing in a Post COVID World , 2020, ArXiv.

[18]  P EstherRani,et al.  LittleYOLO-SPP: A Delicate Real-Time Vehicle Detection Algorithm , 2020, Optik.

[19]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Shuang Li,et al.  Multi-angle Head Pose Classification when Wearing the Mask for Face Recognition under the COVID-19 Coronavirus Epidemic , 2020, 2020 International Conference on High Performance Big Data and Intelligent Systems (HPBD&IS).

[21]  Wei Fu,et al.  Faster-YOLO: An accurate and faster object detection method , 2020, Digit. Signal Process..

[22]  Biparnak Roy,et al.  MOXA: A Deep Learning Based Unmanned Approach For Real-Time Monitoring of People Wearing Medical Masks , 2020, Transactions of the Indian National Academy of Engineering.

[23]  Rattapoom Waranusast,et al.  Real-time Bhutanese license plate localization using YOLO , 2020, ICT Express.

[24]  Hendry,et al.  Automatic License Plate Recognition via sliding-window darknet-YOLO deep learning , 2019, Image Vis. Comput..

[25]  Priyam Garg,et al.  Refining Yolov4 for Vehicle Detection , 2020 .

[26]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Hao Wu,et al.  Masked Face Recognition Dataset and Application , 2020, ArXiv.

[28]  Gunasekaran Manogaran,et al.  A hybrid deep transfer learning model with machine learning methods for face mask detection in the era of the COVID-19 pandemic , 2020, Measurement.