BiliScreen: Smartphone-Based Scleral Jaundice Monitoring for Liver and Pancreatic Disorders

Pancreatic cancer has one of the worst survival rates amongst all forms of cancer because its symptoms manifest later into the progression of the disease. One of those symptoms is jaundice, the yellow discoloration of the skin and sclera due to the buildup of bilirubin in the blood. Jaundice is only recognizable to the naked eye in severe stages, but a ubiquitous test using computer vision and machine learning can detect milder forms of jaundice. We propose BiliScreen, a smartphone app that captures pictures of the eye and produces an estimate of a person's bilirubin level, even at levels normally undetectable by the human eye. We test two low-cost accessories that reduce the effects of external lighting: (1) a 3D-printed box that controls the eyes' exposure to light and (2) paper glasses with colored squares for calibration. In a 70-person clinical study, we found that BiliScreen with the box achieves a Pearson correlation coefficient of 0.89 and a mean error of -0.09 ± 2.76 mg/dl in predicting a person's bilirubin level. As a screening tool, BiliScreen identifies cases of concern with a sensitivity of 89.7% and a specificity of 96.8% with the box accessory.

[1]  Christopher G Owen,et al.  Vascular response of the bulbar conjunctiva to diabetes and elevated blood pressure. , 2005, Ophthalmology.

[2]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[3]  H. Kocher,et al.  Pancreatic Cancer , 2019, Methods in Molecular Biology.

[4]  Alex Kentsis,et al.  Colorimetric and Longitudinal Analysis of Leukocoria in Recreational Photographs of Children with Retinoblastoma , 2013, PloS one.

[5]  Edward J. Delp,et al.  A New Human Identification Method: Sclera Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[6]  Stephen Wolf,et al.  Color correction matrix for digital still and video imaging systems , 2003 .

[7]  Christopher G Owen,et al.  Diabetes and the tortuosity of vessels of the bulbar conjunctiva. , 2008, Ophthalmology.

[8]  Gudrun Klinker,et al.  A physical approach to color image understanding , 1989, International Journal of Computer Vision.

[9]  Miguel Angel Ferrer-Ballester,et al.  A new efficient and adaptive sclera recognition system , 2014, 2014 IEEE Symposium on Computational Intelligence in Biometrics and Identity Management (CIBIM).

[10]  Arun Ross,et al.  Multispectral scleral patterns for ocular biometric recognition , 2012, Pattern Recognit. Lett..

[11]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[12]  S. Gallinger,et al.  Diagnosis and management of pancreatic cancer , 2013, Canadian Medical Association Journal.

[13]  Matthew Burton,et al.  A smartphone based ophthalmoscope , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[14]  Somsak Leartveravat.  Transcutaneous bilirubin measurement in full term neonate by digital camera , 2009 .

[15]  Wencheng Wu,et al.  The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations , 2005 .

[16]  A. Bastawrous,et al.  Development and Validation of a Smartphone-Based Visual Acuity Test (Peek Acuity) for Clinical Practice and Community-Based Fieldwork. , 2015, JAMA ophthalmology.

[17]  D. Greig,et al.  Exact Maximum A Posteriori Estimation for Binary Images , 1989 .

[18]  D. Pascale.  RGB coordinates of the Macbeth ColorChecker , 2006 .

[19]  R. Wiesner,et al.  Model for end-stage liver disease (MELD) and allocation of donor livers. , 2003, Gastroenterology.

[20]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[21]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[22]  Miguel Angel Ferrer-Ballester,et al.  Sclera recognition using dense-SIFT , 2013, 2013 13th International Conference on Intellient Systems Design and Applications.

[23]  Judith Meek,et al.  Screening neonatal jaundice based on the sclera color of the eye using digital photography. , 2015, Biomedical optics express.

[24]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[25]  Adrian O'Dowd,et al.  Only women with symptoms need to have their breast implants removed, says government , 2012, BMJ : British Medical Journal.

[26]  V. Bhutani,et al.  Predictive Ability of a Predischarge Hour-specific Serum Bilirubin for Subsequent Significant Hyperbilirubinemia in Healthy Term and Near-term Newborns , 1999, Pediatrics.

[27]  Wolfgang Schima,et al.  Pancreatic adenocarcinoma , 2006, European Radiology.

[28]  Eric C. Larson,et al.  BiliCam: using mobile phones to monitor newborn jaundice , 2014, UbiComp Adjunct.

[30]  Vitor F. Pamplona,et al.  NETRA: interactive display for estimating refractive errors and focal range , 2010 .

[31]  Gordon Wetzstein,et al.  Computational retinal imaging via binocular coupling and indirect illumination , 2012, SIGGRAPH Posters.

[32]  D. Sillence,et al.  Genetic heterogeneity in osteogenesis imperfecta. , 1979, Journal of medical genetics.

[33]  Stefano Tubaro,et al.  Sclera segmentation for gaze estimation and iris localization in unconstrained images , 2012, CompIMAGE.