Creating High Fidelity Synthetic Pelvis Radiographs Using Generative Adversarial Networks: Unlocking the Potential of Deep Learning Models without Patient Privacy Concerns.

Researchers

Journal

Modalities

Models

Abstract

In this work, we applied and validated an artificial intelligence (AI) technique known as generative adversarial networks (GANs) to create large volumes of high-fidelity synthetic antero-posterior (AP) pelvis radiographs that can enable deep learning (DL)-based image analyses, while ensuring patient privacy.AP pelvis radiographs with native hips were gathered from an institutional registry between 1998 and 2018. The data was used to train a model to create 512×512 pixel synthetic AP pelvis images. The network was trained on 25 million images produced through augmentation. A set of 100 random images (50/50 real/synthetic) was evaluated by three orthopaedic surgeons and two radiologists to discern real versus synthetic images. Two models (joint localization and segmentation) were trained using synthetic images and tested on real images.The final model was trained on 37,640 real radiographs (16,782 patients). In a computer assessment of image fidelity, the final model achieved an “excellent” rating. In a blinded review of paired images (1 real, 1 synthetic), orthopedic surgeon reviewers were unable to correctly identify which image was synthetic (accuracy=55%, Kappa=0.11), highlighting synthetic image fidelity. The synthetic and real images showed equivalent performance when they were assessed by established DL models.This work shows the ability to use a DL technique to generate a large volume of high-fidelity synthetic pelvis images not discernible from real imaging by computers or experts. These images can be used for cross-institutional sharing and model pre-training, further advancing the performance of DL models without risk to patient data safety.Copyright © 2022 Elsevier Inc. All rights reserved.