Image Translation for Estimating Two-Dimensional Axial Amyloid-Beta PET From Structural MRI

J Magn Reson Imaging. 2024 Mar;59(3):1021-1031. doi: 10.1002/jmri.29070. Epub 2023 Nov 3.

Abstract

Background: Amyloid-beta and brain atrophy are hallmarks for Alzheimer's Disease that can be targeted with positron emission tomography (PET) and MRI, respectively. MRI is cheaper, less-invasive, and more available than PET. There is a known relationship between amyloid-beta and brain atrophy, meaning PET images could be inferred from MRI.

Purpose: To build an image translation model using a Conditional Generative Adversarial Network able to synthesize Amyloid-beta PET images from structural MRI.

Study type: Retrospective.

Population: Eight hundred eighty-two adults (348 males/534 females) with different stages of cognitive decline (control, mild cognitive impairment, moderate cognitive impairment, and severe cognitive impairment). Five hundred fifty-two subjects for model training and 331 for testing (80%:20%).

Field strength/sequence: 3 T, T1-weighted structural (T1w).

Assessment: The testing cohort was used to evaluate the performance of the model using the Structural Similarity Index Measure (SSIM) and Peak Signal-to-Noise Ratio (PSNR), comparing the likeness of the overall synthetic PET images created from structural MRI with the overall true PET images. SSIM was computed in the overall image to include the luminance, contrast, and structural similarity components. Experienced observers reviewed the images for quality, performance and tried to determine if they could tell the difference between real and synthetic images.

Statistical tests: Pixel wise Pearson correlation was significant, and had an R2 greater than 0.96 in example images. From blinded readings, a Pearson Chi-squared test showed that there was no significant difference between the real and synthetic images by the observers (P = 0.68).

Results: A high degree of likeness across the evaluation set, which had a mean SSIM = 0.905 and PSNR = 2.685. The two observers were not able to determine the difference between the real and synthetic images, with accuracies of 54% and 46%, respectively.

Conclusion: Amyloid-beta PET images can be synthesized from structural MRI with a high degree of similarity to the real PET images.

Evidence level: 3 TECHNICAL EFFICACY: Stage 1.

Keywords: amyloid-beta; generalized adversarial network; image translation; magnetic resonance imaging; positron emission tomography.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adult
  • Amyloid beta-Peptides*
  • Atrophy
  • Female
  • Humans
  • Image Processing, Computer-Assisted / methods
  • Magnetic Resonance Imaging / methods
  • Male
  • Positron-Emission Tomography* / methods
  • Retrospective Studies

Substances

  • Amyloid beta-Peptides