A deep-learning algorithm to classify skin lesions from mpox virus infection

Alexander H. Thieme, Yuanning Zheng, Gautam Machiraju, Chris Sadee, Mirja Mittermaier, Maximilian Gertler, Jorge L. Salinas, Krithika Srinivasan, Prashnna Gyawali, Francisco Carrillo-Perez, Angelo Capodici, Maximilian Uhlig, Daniel Habenicht, Anastassia Löser, Maja Kohler, Maximilian Schuessler, David Kaul, Johannes Gollrad, Jackie Ma, Christoph LippertKendall Billick, Isaac Bogoch, Tina Hernandez-Boussard, Pascal Geldsetzer, Olivier Gevaert

Research output: Contribution to journalArticlepeer-review

18 Scopus citations

Abstract

Undetected infection and delayed isolation of infected individuals are key factors driving the monkeypox virus (now termed mpox virus or MPXV) outbreak. To enable earlier detection of MPXV infection, we developed an image-based deep convolutional neural network (named MPXV-CNN) for the identification of the characteristic skin lesions caused by MPXV. We assembled a dataset of 139,198 skin lesion images, split into training/validation and testing cohorts, comprising non-MPXV images (n = 138,522) from eight dermatological repositories and MPXV images (n = 676) from the scientific literature, news articles, social media and a prospective cohort of the Stanford University Medical Center (n = 63 images from 12 patients, all male). In the validation and testing cohorts, the sensitivity of the MPXV-CNN was 0.83 and 0.91, the specificity was 0.965 and 0.898 and the area under the curve was 0.967 and 0.966, respectively. In the prospective cohort, the sensitivity was 0.89. The classification performance of the MPXV-CNN was robust across various skin tones and body regions. To facilitate the usage of the algorithm, we developed a web-based app by which the MPXV-CNN can be accessed for patient guidance. The capability of the MPXV-CNN for identifying MPXV lesions has the potential to aid in MPXV outbreak mitigation.

Original languageEnglish (US)
Pages (from-to)738-747
Number of pages10
JournalNature medicine
Volume29
Issue number3
DOIs
StatePublished - Mar 2023
Externally publishedYes

ASJC Scopus subject areas

  • General Biochemistry, Genetics and Molecular Biology

Fingerprint

Dive into the research topics of 'A deep-learning algorithm to classify skin lesions from mpox virus infection'. Together they form a unique fingerprint.

Cite this