Approximately 2.5% of the proton range uncertainty comes from computed tomography (CT) number to material characteristic conversion. We aim to conquer this CT-to-material conversion error by proposing a multimodal imaging framework to enable deep learning (DL)-based material mass density inference using dual-energy CT (DECT) and magnetic resonance imaging (MRI). To ensure the robustness of DL models, we integrated physics insights into the framework to regularize DL models and achieve DL using small datasets. Five MRI-compatible phantoms were created from tissue-mimicking materials that served as a ground true reference to validate the proposed framework. The reference mass densities for each phantom were measured by a 150 MeV proton beam. Multimodal images were acquired from T1- and T2-weighted images and DECT images as training and validation data for DL. Residual networks (ResNet) were implemented to evaluate the feasibility of the proposed framework. ResNet-DE-MR denotes that ResNet was trained with MRI and DECT images, while ResNet-DE presents that only DECT images were used to train ResNet. ResNet was also compared to an empirical DECT model. Meanwhile, a retrospective patient case was included in the study to demonstrate the proof of concept for the proposed framework. The phantom validation experiment showed that ResNet-DE-MR achieved mass density errors of -0.4%, 0.3%, 0.4%, 0.7%, and -0.2% for adipose, muscle, liver, skin, and bone. The proposed DL-based multimodal imaging framework was demonstrated to enable accurate material mass density inference using DECT and MR images. The framework can potentially improve the treatment quality for proton therapy by reducing proton range uncertainty.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.