Diffusion Model Based Image Reconstruction in Lensless Imaging

Abstract

Lensless imaging systems eliminate the need for lenses by employing an encoding element to multiplex incident light signals, which are then captured directly onto a bare camera sensor. They present a promising alternative to traditional lens-based imaging systems by offering significant advantages in terms of compactness, versatility, and cost. Due to the multiplexed nature of measurements, image reconstruction takes place computationally. However, existing techniques for image reconstruction in lensless imaging fall short of the image quality offered by traditional lens-based imaging. In this work, we consider the application of diffusion models, a class of deep generative models, for image reconstruction in a lensless imaging modality. These models currently achieve state-of-the-art performance in image generation. Specifically, we focus on the PhlatCam lensless system, which consists of a coded phase mask as the encoding element placed close to the camera sensor. We use a ControlNet based diffusion model to improve the perceptual quality of image reconstruction. The performance is measured in terms of peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), and learned perceptual image patch similarity (LPIPS). The proposed method improves the performance in these metrics for synthetic measurements. For real measurements, the improvement in image quality comes at the expense of a small bias in color, which is attributed to the generative nature of the diffusion prior itself.