A Vision-Based Social Distancing and Critical Density Detection System for COVID-19

Social distancing (SD) is an effective measure to prevent the spread of the infectious Coronavirus Disease 2019 (COVID-19). However, a lack of spatial awareness may cause unintentional violations of this new measure. Against this backdrop, we propose an active surveillance system to slow the spread of COVID-19 by warning individuals in a region-of-interest. Our contribution is twofold. First, we introduce a vision-based real-time system that can detect SD violations and send non-intrusive audio-visual cues using state-of-the-art deep-learning models. Second, we define a novel critical social density value and show that the chance of SD violation occurrence can be held near zero if the pedestrian density is kept under this value. The proposed system is also ethically fair: it does not record data nor target individuals, and no human supervisor is present during the operation. The proposed system was evaluated across real-world datasets.

[1]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[2]  Mohan M. Trivedi,et al.  A track-based human movement analysis and privacy protection system adaptive to environmental contexts , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[3]  Nuno Vasconcelos,et al.  Privacy preserving crowd monitoring: Counting people without people models or tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[5]  Faisal Z. Qureshi,et al.  Object-Video Streams for Preserving Privacy in Video Surveillance , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[6]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[7]  Ian D. Reid,et al.  Stable multi-target tracking in real-time surveillance video , 2011, CVPR 2011.

[8]  Shaogang Gong,et al.  Feature Mining for Localised Crowd Counting , 2012, BMVC.

[9]  Xiaogang Wang,et al.  Understanding collective crowd behaviors: Learning a Mixture model of Dynamic pedestrian-Agents , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Luc Van Gool,et al.  The Pascal Visual Object Classes Challenge: A Retrospective , 2014, International Journal of Computer Vision.

[12]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[13]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[15]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[16]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[17]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Samy Bengio,et al.  Understanding deep learning requires rethinking generalization , 2016, ICLR.

[19]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[20]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Р Ю Чуйков,et al.  Обнаружение транспортных средств на изображениях загородных шоссе на основе метода Single shot multibox Detector , 2017 .

[22]  Hei Law,et al.  CornerNet: Detecting Objects as Paired Keypoints , 2018, ECCV.

[23]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[24]  Stephen Lin,et al.  RepPoints: Point Set Representation for Object Detection , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[25]  Qi Tian,et al.  CenterNet: Keypoint Triplets for Object Detection , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[26]  Xindong Wu,et al.  Object Detection With Deep Learning: A Review , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Jieping Ye,et al.  Object Detection in 20 Years: A Survey , 2019, Proceedings of the IEEE.

[28]  Hao Chen,et al.  FCOS: Fully Convolutional One-Stage Object Detection , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[29]  Sonali Agarwal,et al.  Unleashing the power of disruptive and emerging technologies amid COVID-19: A detailed review , 2020, ArXiv.

[30]  Michael Greenstone,et al.  Does Social Distancing Matter? , 2020 .

[31]  Ting Chen,et al.  Understanding Why Neural Networks Generalize Well Through GSNR of Parameters , 2020, ICLR.

[32]  Sadia Din,et al.  A deep learning-based social distance monitoring framework for COVID-19 , 2020, Sustainable Cities and Society.

[33]  Z. Memish,et al.  The continuing 2019-nCoV epidemic threat of novel coronaviruses to global health — The latest 2019 novel coronavirus outbreak in Wuhan, China , 2020, International Journal of Infectious Diseases.

[34]  Hong-Yuan Mark Liao,et al.  YOLOv4: Optimal Speed and Accuracy of Object Detection , 2020, ArXiv.

[35]  N. Punn,et al.  Monitoring COVID-19 social distancing with person detection and tracking via fine-tuned YOLO v3 and Deepsort techniques , 2020, ArXiv.

[36]  Quoc V. Le,et al.  EfficientDet: Scalable and Efficient Object Detection , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Mahdi Rezaei,et al.  DeepSOCIAL: Social Distancing Monitoring and Infection Risk Assessment in COVID-19 Pandemic , 2020 .

[38]  M. Shamim Hossain,et al.  Towards the sustainable development of smart cities through mass video surveillance: A response to the COVID-19 pandemic , 2020, Sustainable Cities and Society.

[39]  Aaron Yelowitz,et al.  Strong Social Distancing Measures In The United States Reduced The COVID-19 Growth Rate. , 2020, Health affairs.

[40]  Prateek Khandelwal,et al.  Using Computer Vision to enhance Safety of Workforce in Manufacturing in a Post COVID World , 2020, ArXiv.

[41]  Quoc V. Le,et al.  Learning Data Augmentation Strategies for Object Detection , 2019, ECCV.

[42]  P. Torino,et al.  Monitoring COVID-19 prevention measures on CCTV cameras using Deep Learning , 2020 .

[43]  Gerhard P. Hancke,et al.  IoT in the Wake of COVID-19: A Survey on Contributions, Challenges and Evolution , 2020, IEEE Access.

[44]  D. G. Costa,et al.  COVID‐19 pandemic: a review of smart cities initiatives to face new outbreaks , 2020, IET Smart Cities.

[45]  Alessio Del Bue,et al.  The Visual Social Distancing Problem , 2020, IEEE Access.

[46]  Diep N. Nguyen,et al.  Enabling and Emerging Technologies for Social Distancing: A Comprehensive Survey , 2020, 2005.02816.