Deep learning extended depth-of-field microscope for fast and slide-free histology

Lingbo Jin, Yubo Tang, Yicheng Wu, Jackson B. Coole, Melody T. Tan, Xuan Zhao, Hawraa Badaoui, Jacob T. Robinson, Michelle D. Williams, Ann M. Gillenwater, Rebecca R. Richards-Kortum, Ashok Veeraraghavan

Research output: Contribution to journalArticlepeer-review

46 Scopus citations

Abstract

Microscopic evaluation of resected tissue plays a central role in the surgical management of cancer. Because optical microscopes have a limited depth-of-field (DOF), resected tissue is either frozen or preserved with chemical fixatives, sliced into thin sections placed on microscope slides, stained, and imaged to determine whether surgical margins are free of tumor cells—a costly and time- and labor-intensive procedure. Here, we introduce a deep-learning extended DOF (DeepDOF) microscope to quickly image large areas of freshly resected tissue to provide histologic-quality images of surgical margins without physical sectioning. The DeepDOF microscope consists of a conventional fluorescence microscope with the simple addition of an inexpensive (less than $10) phase mask inserted in the pupil plane to encode the light field and enhance the depth-invariance of the point-spread function. When used with a jointly optimized image-reconstruction algorithm, diffraction-limited optical performance to resolve subcellular features can be maintained while significantly extending the DOF (200 μm). Data from resected oral surgical specimens show that the DeepDOF microscope can consistently visualize nuclear morphology and other important diagnostic features across highly irregular resected tissue surfaces without serial refocusing. With the capability to quickly scan intact samples with subcellular detail, the DeepDOF microscope can improve tissue sampling during intraoperative tumor-margin assessment, while offering an affordable tool to provide histological information from resected tissue specimens in resource-limited settings.

Original languageEnglish (US)
Pages (from-to)33051-33060
Number of pages10
JournalProceedings of the National Academy of Sciences of the United States of America
Volume117
Issue number52
DOIs
StatePublished - Dec 2020

Keywords

  • Deep learning
  • End-to-end optimization
  • Extended depth-of-field microscopy
  • Pathology
  • Phase mask

ASJC Scopus subject areas

  • General

MD Anderson CCSG core facilities

  • Tissue Biospecimen and Pathology Resource

Fingerprint

Dive into the research topics of 'Deep learning extended depth-of-field microscope for fast and slide-free histology'. Together they form a unique fingerprint.

Cite this