LesionMap: A Method and Tool for the Semantic Annotation of Dermatological Lesions for Documentation and Machine Learning

Diagnosis and follow-up of patients in dermatology rely on visual cues. Documentation of skin lesions in dermatology is time-consuming and inaccurate. Digital photography is resource-intensive, difficult to standardize, and has privacy concerns. We propose a simple method—LesionMap—and an electronic health software tool—LesionMapper—for semantically annotating dermatological lesions on a body wireframe. We discuss how the type, distribution, and progression of lesions can be represented in a standardized way. The tool is an open-source JavaScript package that can be integrated into web-based electronic medical records. We believe that LesionMapper will facilitate documentation in dermatology that can be used for machine learning in a privacy-preserving manner. (JMIR Dermatol 2020;3(1):e18149) doi: 10.2196/18149

[1]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[2]  Anjuli Kannan,et al.  Automatically Charting Symptoms From Patient-Physician Conversations Using Machine Learning. , 2019, JAMA internal medicine.

[3]  Rich Harris Dismantling the Barriers to Entry , 2015, ACM Queue.

[4]  C. L. Ventola Social media and health care professionals: benefits, risks, and best practices. , 2014, P & T : a peer-reviewed journal for formulary management.

[5]  Yan Jing,et al.  Artificial intelligence in dermatology: past, present, and future , 2019, Chinese medical journal.

[6]  L. Deng,et al.  The MNIST Database of Handwritten Digit Images for Machine Learning Research [Best of the Web] , 2012, IEEE Signal Processing Magazine.

[7]  Andrea Passaglia,et al.  Complete Vue.js 2 Web Development: Practical guide to building end-to-end web development solutions with Vue.js 2 , 2018 .

[8]  R. Harris Dismantling the Barriers to Entry , 2015 .

[9]  E. McMeniman,et al.  Clinical photography in dermatology: Ethical and medico‐legal considerations in the age of digital and smartphone technology , 2013, The Australasian journal of dermatology.

[10]  Dinesh Kumbhare,et al.  Pain-QuILT: Clinical Feasibility of a Web-Based Visual Pain Assessment Tool in Adults With Chronic Pain , 2014, Journal of medical Internet research.

[11]  Jenni A. M. Sidey-Gibbons,et al.  Machine learning in medicine: a practical introduction , 2019, BMC Medical Research Methodology.

[12]  Hoo-Chang Hoo-Chang Shin Shin,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, Ieee Transactions on Medical Imaging.

[13]  R. Cardili,et al.  Elementary lesions in dermatological semiology: literature review* , 2016, Anais brasileiros de dermatologia.

[14]  Louis-Philippe Morency,et al.  Multimodal Machine Learning: A Survey and Taxonomy , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Eduardo Romero,et al.  A visualization, navigation, and annotation system for dermatopathology training , 2018, Symposium on Medical Information Processing and Analysis.

[16]  Brief intervention to improve diagnosis and treatment knowledge of skin disorders by family medicine residents. , 2007, Family medicine.

[17]  L. Kamulegeya,et al.  Using artificial intelligence on dermatology conditions in Uganda: a case for diversity in training data sets for machine learning , 2019, bioRxiv.

[18]  Baskar Ganapathysubramanian,et al.  Computer vision and machine learning for robust phenotyping in genome-wide studies , 2017, Scientific Reports.

[19]  David Chan,et al.  Open-source health information technology: A case study of electronic medical records , 2015 .

[20]  J. Berk-Krauss,et al.  Mole Mapping for Management of Pigmented Skin Lesions. , 2017, Dermatologic clinics.

[21]  Christian Biemann,et al.  What do we need to build explainable AI systems for the medical domain? , 2017, ArXiv.

[22]  Chia-Wei Liang,et al.  Assessment of Deep Learning Using Nonimaging Information and Sequential Medical Records to Develop a Prediction Model for Nonmelanoma Skin Cancer. , 2019, JAMA dermatology.

[23]  A. Adamson,et al.  Machine Learning and Health Care Disparities in Dermatology. , 2018, JAMA dermatology.

[24]  Bell Raj Eapen ONTODerm--a domain ontology for dermatology. , 2008, Dermatology online journal.

[25]  Min Wu,et al.  Spatially-oriented EMR for Dental Surgery , 2006, AMIA.

[26]  Wen-Ching Lin,et al.  PMML in Action: Unleashing the Power of Open Standards for Data Mining and Predictive Analytics , 2010 .

[27]  Mark B Horton,et al.  Special requirements for electronic health record systems in ophthalmology. , 2011, Ophthalmology.

[28]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[29]  Jorge S. Marques,et al.  What Is the Role of Annotations in the Detection of Dermoscopic Structures? , 2019, IbPRIA.

[30]  Paul G. Biondich,et al.  Cooking Up An Open Source EMR For Developing Countries: OpenMRS - A Recipe For Successful Collaboration , 2006, AMIA.

[31]  A. Lim,et al.  Imaging the skin , 2003, The Australasian journal of dermatology.

[32]  Martin D. Levine,et al.  Dynamic Measurement of Computer Generated Image Segmentations , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.