Smartphone-based photo analysis for the evaluation of anemia, jaundice and COVID-19

Anemia and jaundice are common health conditions that affect millions of children, adults, and the elderly worldwide. Recently, the pandemic caused by severe acute respiratory syndrome-coronavirus 2 (SARS-CoV-2), the virus that leads to COVID-19, has generated an extreme worldwide concern and a huge impact on public health, education, and economy, reaching all spheres of society. The development of techniques for non-invasive diagnosis and the use of mobile health (mHealth) is reaching more and more space. The analysis of a simple photograph by smartphone can allow an assessment of a person's health status. Image analysis techniques have advanced a lot in a short time. Analyses that were previously done manually, can now be done automatically by methods involving artificial intelligence. The use of smartphones, combined with machine learning techniques for image analysis (preprocessing, extraction of characteristics, classification, or regression), capable of providing predictions with high sensitivity and specificity, seems to be a trend. We presented in this review some highlights of the evaluation of anemia, jaundice, and COVID-19 by photo analysis, emphasizing the importance of using the smartphone, machine learning algorithms, and applications that are emerging rapidly. Soon, this will certainly be a reality. Also, these innovative methods will encourage the incorporation of mHealth technologies in telemedicine and the expansion of people's access to health services and early diagnosis.

[1]  Nawal Soliman ALKolifi ALEnezi,et al.  A Method Of Skin Disease Detection Using Image Processing And Machine Learning , 2019, Procedia Computer Science.

[2]  S. Roche,et al.  Jaundice in the adult patient. , 2004, American family physician.

[3]  Danilo Nogueira Evangelista,et al.  Mobile Health (mHealth) and Advances in Noninvasive Diagnosis of Anemia: An Overview , 2020, International Journal of Nutrology.

[4]  M. He,et al.  A self-adaptive deep learning method for automated eye laterality detection based on color fundus photography , 2019, PloS one.

[5]  Felix Outlaw,et al.  Smartphone screening for neonatal jaundice via ambient-subtracted sclera chromaticity , 2020, PloS one.

[6]  Milagros Díaz Rodríguez,et al.  Oral manifestations associated with COVID‐19 , 2020, Oral diseases.

[7]  E. Guerra,et al.  Oral mucosal lesions in a COVID-19 patient: New signs or secondary manifestations? , 2020, International Journal of Infectious Diseases.

[8]  Pedro Wightman Rojas,et al.  Hemoglobin screening using cloud based mobile photography applications [Online First] , 2019 .

[9]  Christina Thorpe,et al.  Performance Study of Cloud Computing Back-End Solutions for Mobile Applications , 2015, 2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing (UCC).

[10]  Manasi Gyanchandani,et al.  Neural network based non‐invasive method to detect anemia from images of eye conjunctiva , 2020, Int. J. Imaging Syst. Technol..

[11]  E. Halboub,et al.  Orofacial manifestations of COVID-19: a brief review of the published literature. , 2020, Brazilian oral research.

[12]  Q. S. Ringenberg,et al.  The value of the physical examination in the diagnosis of anemia. Correlation of the physical findings and the hemoglobin concentration. , 1988, Archives of internal medicine.

[13]  Ingemar J. Cox,et al.  Digital technologies in the public-health response to COVID-19 , 2020, Nature Medicine.

[14]  E. Carrilho,et al.  Noninvasive Self-monitoring of Blood Glucose at Your Fingertips, Literally!: Smartphone-Based Photoplethysmography , 2020, International Journal of Nutrology.

[15]  Taghi M. Khoshgoftaar,et al.  A survey on Image Data Augmentation for Deep Learning , 2019, Journal of Big Data.

[16]  I. Benseñor,et al.  Accuracy of anemia diagnosis by physical examination , 2007, Sao Paulo medical journal = Revista paulista de medicina.

[17]  Celia Shahnaz,et al.  Non-Invasive Bilirubin Level Quantification and Jaundice Detection by Sclera Image Processing , 2019, 2019 IEEE Global Humanitarian Technology Conference (GHTC).

[18]  Sivachandar Kasiviswanathan,et al.  Ridge regression algorithm based non-invasive anaemia screening using conjunctiva images , 2020 .

[19]  Mohammadhossein Khorraminejad-Shirazi,et al.  Detection of Neonatal Jaundice by Using an Android OS-Based Smartphone Application , 2019, Iranian Journal of Pediatrics.

[20]  E. Carrilho,et al.  Paper-Based Microfluidics Immunoassay for Detection of Canine Distemper Virus , 2018 .

[21]  A. Peters,et al.  A Deep Learning Algorithm for Prediction of Age-Related Eye Disease Study Severity Scale for Age-Related Macular Degeneration from Color Fundus Photography. , 2018, Ophthalmology.

[22]  Geoffrey H. Tison,et al.  A digital biomarker of diabetes from smartphone-based vascular signals , 2020, Nature Medicine.

[23]  David R. Myers,et al.  Smartphone app for non-invasive detection of anemia using only patient-sourced photos , 2018, Nature Communications.