Pocformer: A Lightweight Transformer Architecture For Detection Of Covid-19 Using Point Of Care Ultrasound

The rapid and seemingly endless expansion of COVID-19 can be traced back to the inefficiency and shortage of testing kits that offer accurate results in a timely manner. An emerging popular technique, which adopts improvements made in mobile ultrasound technology, allows for healthcare professionals to conduct rapid screenings on a large scale. We present an image-based solution that aims at automating the testing process which allows for rapid mass testing to be conducted with or without a trained medical professional that can be applied to rural environments and third world countries. Our contributions towards rapid large-scale testing include a novel deep learning architecture capable of analyzing ultrasound data that can run in real-time and significantly improve the current state-of-the-art detection accuracies using image-based COVID-19 detection.

[1]  J. Goulet,et al.  POCOVID-Net: Automatic Detection of COVID-19 From a New Lung Ultrasound Imaging Dataset (POCUS) , 2020, ArXiv.

[2]  S. Balakrishnan,et al.  Coronavirus Disease 2019 (COVID-19): A Systematic Review of Imaging Findings in 919 Patients. , 2020, AJR. American journal of roentgenology.

[3]  Karsten M. Borgwardt,et al.  Accelerating COVID-19 Differential Diagnosis with Explainable Ultrasound Image Analysis , 2020, ArXiv.

[4]  T. Henry,et al.  Diagnostic Tools for Coronavirus Disease (COVID-19): Comparing CT and RT-PCR Viral Nucleic Acid Testing. , 2020, AJR. American journal of roentgenology.

[5]  Devy M. Emperador,et al.  Antibody tests for identification of current and past infection with SARS‐CoV‐2 , 2020, The Cochrane database of systematic reviews.

[6]  A. Echenique,et al.  Chest X-Ray Findings in 636 Ambulatory Patients with COVID-19 Presenting to an Urgent Care Center: A Normal Chest X-Ray Is no Guarantee , 2020 .

[7]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[8]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[9]  Alexander Wong,et al.  COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images , 2020, Scientific reports.

[10]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[11]  Han Zhang,et al.  Coronavirus Disease 2019 (COVID-19) CT Findings: A Systematic Review and Meta-analysis , 2020, Journal of the American College of Radiology.

[12]  Georg Heigold,et al.  An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale , 2021, ICLR.

[13]  Han Fang,et al.  Linformer: Self-Attention with Linear Complexity , 2020, ArXiv.