Patch-RegNet: A Hierarchical Deformable Registration Framework for Inter-/intra-modality head-and-neck image registration with ViT-Morph

Yao Zhao, Xinru Chen, Brigid McDonald, Cenji Yu, Laurence E. Court, Tinsu Pan, He Wang, Xin Wang, Jack Phan, Jinzhong Yang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Deformable image registration (DIR) between Computed Tomography (CT)/Magnetic Resonance (MR) or MR/MR images is fundamentally important for MR-guided adaptive radiotherapy. In this work, we propose a novel hierarchical DIR framework, Patch-RegNet, to achieve accurate and rapid CT/MR and MR/MR registration for head-and-neck cancer. Patch-RegNet includes three steps: a whole volume rigid registration, a patch-based rigid registration, and a patch-based DIR. An innovative deep-learning-based network, ViT-Morph, is developed for the patch-based DIR in Patch-RegNet, taking advantage of both CNN-based local features and long-range image relationships from Transformer. Our Patch-RegNet is demonstrated to achieve notably improved registration accuracy for both inter- and intra-modality registration.

Original languageEnglish (US)
Title of host publicationMedical Imaging 2023
Subtitle of host publicationImage Processing
EditorsOlivier Colliot, Ivana Isgum
PublisherSPIE
ISBN (Electronic)9781510660335
DOIs
StatePublished - 2023
EventMedical Imaging 2023: Image Processing - San Diego, United States
Duration: Feb 19 2023Feb 23 2023

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume12464
ISSN (Print)1605-7422

Conference

ConferenceMedical Imaging 2023: Image Processing
Country/TerritoryUnited States
CitySan Diego
Period2/19/232/23/23

Keywords

  • CT/MR deformable registration
  • Modality independent neighborhood descriptor
  • Patch-based registration
  • Vision transformer

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Atomic and Molecular Physics, and Optics
  • Biomaterials
  • Radiology Nuclear Medicine and imaging

Fingerprint

Dive into the research topics of 'Patch-RegNet: A Hierarchical Deformable Registration Framework for Inter-/intra-modality head-and-neck image registration with ViT-Morph'. Together they form a unique fingerprint.

Cite this