Analysis and Evaluation of COVID-19 Web Applications for Health Professionals: Challenges and Opportunities

The multidisciplinary nature of the work required for research in the COVID-19 pandemic has created new challenges for health professionals in the battle against the virus. They need to be equipped with novel tools, applications, and resources—that have emerged during the pandemic—to gain access to breakthrough findings; know the latest developments; and to address their specific needs for rapid data acquisition, analysis, evaluation, and reporting. Because of the complex nature of the virus, healthcare systems worldwide are severely impacted as the treatment and the vaccine for COVID-19 disease are not yet discovered. This leads to frequent changes in regulations and policies by governments and international organizations. Our analysis suggests that given the abundance of information sources, finding the most suitable application for analysis, evaluation, or reporting, is one of such challenges. However, health professionals and policy-makers need access to the most relevant, reliable, trusted, and latest information and applications that can be used in their day-to-day tasks of COVID-19 research and analysis. In this article, we present our analysis of various novel and important web-based applications that have been specifically developed during the COVID-19 pandemic and that can be used by the health professionals community to help in advancing their analysis and research. These applications comprise search portals and their associated information repositories for literature and clinical trials, data sources, tracking dashboards, and forecasting models. We present a list of the minimally essential online, web-based applications to serve a multitude of purposes, from hundreds of those developed since the beginning of the pandemic. A critical analysis is provided for the selected applications based on 17 features that can be useful for researchers and analysts for their evaluations. These features make up our evaluation framework and have not been used previously for analysis and evaluation. Therefore, knowledge of these applications will not only increase productivity but will also allow us to explore new dimensions for using existing applications with more control, better management, and greater outcome of their research. In addition, the features used in our framework can be applied for future evaluations of similar applications and health professionals can adapt them for evaluation of other applications not covered in this analysis.

[1]  Lucile P. A. Neyton,et al.  Robust, reproducible clinical patterns in hospitalised patients with COVID-19 , 2020, medRxiv.

[2]  Robert J. Harris,et al.  Natural Language Processing and Machine Learning for Detection of Respiratory Illness by Chest CT Imaging and Tracking of COVID-19 Pandemic in the US , 2021, Radiology. Cardiothoracic imaging.

[3]  Xiao Guo,et al.  CORD19STS: COVID-19 Semantic Textual Similarity Dataset , 2020, ArXiv.

[4]  C. Rawlings,et al.  KnetMiner - Intelligent search and visualisation of connected data to explain complex traits and diseases , 2020 .

[5]  X. Bai,et al.  The impacts of a COVID-19 epidemic focus and general belief in a just world on individual emotions☆ , 2020, Personality and Individual Differences.

[6]  Yonghwa Choi,et al.  Answering Questions on COVID-19 in Real-Time , 2020, NLP4COVID@EMNLP.

[7]  P. Garg,et al.  Chloroquine and Hydroxychloroquine for the Treatment of COVID-19: a Systematic Review and Meta-analysis , 2020, Journal of General Internal Medicine.

[8]  A. MOSAVI,et al.  COVID-19 Outbreak Prediction with Machine Learning , 2020, medRxiv.

[9]  R. Verganti Overcrowded: Designing Meaningful Products in a World Awash with Ideas , 2017 .

[10]  Keywan Hassani-Pak,et al.  KnetMiner - An integrated data platform for gene mining and biological knowledge discovery , 2017 .

[11]  Dane Cameron A Software Engineer Learns HTML5, JavaScript and jQuery , 2013 .

[12]  Karen G. Mills,et al.  The Servicification of the US Economy: The Role of Startups versus Incumbent Firms , 2020 .

[13]  E. Koonin,et al.  Ongoing Global and Regional Adaptive Evolution of SARS-CoV-2 , 2020, bioRxiv.

[14]  Jaewoo Kang,et al.  Biomedical Entity Representations with Synonym Marginalization , 2020, ACL.

[15]  Manish Kaushik,et al.  Cross-sectional study on the role of public awareness in preventing the spread of COVID-19 outbreak in India , 2020, Postgraduate Medical Journal.

[16]  Zhen Wang,et al.  Challenges and opportunities in mental health services during the COVID-19 pandemic , 2020, General Psychiatry.

[17]  I. Gupta,et al.  COVID-19 and its Modes of Transmission , 2020, SN Comprehensive Clinical Medicine.

[18]  M. Roser,et al.  Coronavirus Pandemic (COVID-19) , 2020 .

[19]  Dhavan V. Shah,et al.  How Can Research Keep Up With eHealth? Ten Strategies for Increasing the Timeliness and Usefulness of eHealth Research , 2014, Journal of medical Internet research.

[20]  S. KEFAYATI,et al.  On Machine Learning-Based Short-Term Adjustment of Epidemiological Projections of COVID-19 in US , 2020, medRxiv.

[21]  Steve Krug,et al.  Don't Make Me Think!: A Common Sense Approach to Web Usability , 2000 .

[22]  Yonghwa Choi,et al.  A Neural Named Entity Recognition and Multi-Type Normalization Tool for Biomedical Text Mining , 2019, IEEE Access.

[23]  G. Wei,et al.  Characterizing SARS-CoV-2 mutations in the United States , 2020, Research square.

[24]  L. Alvarez,et al.  A variational model for computing the effective reproduction number of SARS-CoV-2 , 2020, medRxiv.

[25]  Ahmed Abdeen Hamed,et al.  The Anatomy of the SARS-CoV-2 Biomedical Literature: Introducing the CovidX Network Algorithm for Drug Repurposing Recommendation , 2020, Journal of medical Internet research.

[26]  Zhiyuan Liu,et al.  Topical Word Embeddings , 2015, AAAI.

[27]  Doug Downey,et al.  Construction of the Literature Graph in Semantic Scholar , 2018, NAACL.

[28]  E. Dong,et al.  An interactive web-based dashboard to track COVID-19 in real time , 2020, The Lancet Infectious Diseases.

[29]  F. Galibert,et al.  COVID-19 epidemic phases: Criteria, challenges and issues for the future☆ , 2020, Bulletin de l'Académie Nationale de Médecine.

[30]  J. Spender,et al.  Startups and open innovation: a review of the literature , 2017 .

[31]  Jaehoon Choi,et al.  BEST: Next-Generation Biomedical Entity Search Tool for Knowledge Discovery from Biomedical Literature , 2016, PloS one.

[32]  Oren Etzioni,et al.  CORD-19: The Covid-19 Open Research Dataset , 2020, NLPCOVID19.

[33]  Robert Leaman,et al.  PubTator central: automated concept annotation for biomedical full text articles , 2019, Nucleic Acids Res..

[34]  Ado Adamou Abba Ari,et al.  Mathematical modeling, analysis and numerical simulation of the COVID-19 transmission with mitigation of control strategies used in Cameroon , 2020, Chaos, Solitons & Fractals.

[35]  G. Blashki,et al.  Crisis as opportunity: how COVID‐19 can reshape the Australian health system , 2020, The Medical journal of Australia.

[36]  Trevor Bedford,et al.  Nextstrain: real-time tracking of pathogen evolution , 2017, bioRxiv.

[37]  K. Khunti,et al.  Management of chronic cardiometabolic conditions and mental health during COVID-19 , 2020, Primary Care Diabetes.

[38]  M. Wolkewitz,et al.  Methodological challenges of analysing COVID-19 data during the pandemic , 2020, BMC Medical Research Methodology.

[39]  D. Pieper,et al.  Half of Systematic reviews about pain registered in PROSPERO were not published and the majority had inaccurate status. , 2019, Journal of clinical epidemiology.

[40]  A. Magge,et al.  A Chronological and Geographical Analysis of Personal Reports of COVID-19 on Twitter , 2020, medRxiv.

[41]  D. Moher,et al.  Following Cochrane review protocols to completion 10 years later: a retrospective cohort study and author survey. , 2019, Journal of clinical epidemiology.

[42]  David Garcia,et al.  Dashboard of Sentiment in Austrian Social Media During COVID-19 , 2020, Frontiers in Big Data.

[43]  Marco Brandizi,et al.  KnetMiner: a comprehensive approach for supporting evidence‐based gene discovery and complex trait analysis across species , 2020, bioRxiv.

[44]  L. Salvador-Carulla,et al.  Rapid response to crisis: Health system lessons from the active period of COVID-19 , 2020, Health Policy and Technology.

[45]  E. Koonin,et al.  Ongoing Adaptive Evolution and Globalization of Sars-Cov-2. , 2020, bioRxiv : the preprint server for biology.

[46]  Christopher J. Rawlings,et al.  Towards FAIRer Biological Knowledge Networks Using a Hybrid Linked Data and Graph Database Approach , 2018, J. Integr. Bioinform..

[47]  N. Kaufman,et al.  Using Health Information Technology to Prevent and Treat Diabetes , 2012, International journal of clinical practice. Supplement.

[48]  Trish M. Perl,et al.  An "Infodemic": Leveraging High-Volume Twitter Data to Understand Public Sentiment for the COVID-19 Outbreak , 2020, medRxiv.