Snapshot spectral imaging based on aberration model-driven deep learning.

Researchers

Journal

Modalities

Models

Abstract

Coded aperture snapshot spectral imaging (CASSI) can capture hyperspectral images (HSIs) in one shot, but it suffers from optical aberrations that degrade the reconstruction quality. Existing deep learning methods for CASSI reconstruction lose some performance on real data due to aberrations. We propose a method to restore high-resolution HSIs from a low-resolution CASSI measurement. We first generate realistic training data that mimics the optical aberrations of CASSI using a spectral imaging simulation technique. A generative network is then trained on this data to recover HSIs from a blurred and distorted CASSI measurement. Our method adapts to the optical system degradation model and thus improves the reconstruction robustness. Experiments on both simulated and real data indicate that our method significantly enhances the image quality of reconstruction outcomes and can be applied to different CASSI systems.