Abstract

Recently, imaging systems have exhibited remarkable image restoration performance through optimized optical systems and deep-learning-based models. Despite advancements in optical systems and models, severe performance degradation occurs when the predefined optical blur kernel differs from the actual kernel while restoring and upscaling the images. This is because super-resolution (SR) models assume that a blur kernel is predefined and known. To address this problem, various lenses could be stacked, and the SR model could be trained with all available optical blur kernels. However, infinite optical blur kernels exist in reality; thus, this task requires the complexity of the lens, substantial model training time, and hardware overhead. To resolve this issue by focusing on the SR models, we propose a kernel-attentive weight modulation memory network by adaptively modulating SR weights according to the shape of the optical blur kernel. The modulation layers are incorporated into the SR architecture and dynamically modulate the weights according to the blur level. Extensive experiments reveal that the proposed method improves peak signal-to-noise ratio performance, with an average gain of 0.83 dB for blurred and downsampled images. An experiment with a real-world blur dataset demonstrates that the proposed method can handle real-world scenarios.

© 2023 Optica Publishing Group

Blurring kernel extraction and super-resolution image reconstruction based on style generative adersarial networks

YangJie Wei and WeiHan Hou
Opt. Express 29(26) 44024-44044 (2021)

Registration-free 3D super-resolution generative deep-learning network for fluorescence microscopy imaging

Hang Zhou, Yuxin Li, Bolun Chen, Hao Yang, Maoyang Zou, Wu Wen, Yayu Ma, and Min Chen
Opt. Lett. 48(23) 6300-6303 (2023)

Single-shot image restoration via a model-enhanced network with unpaired supervision in an optical sparse aperture system

Ju Tang, Jiawei Zhang, Zhenbo Ren, Jianglei Di, Xiaoyan Wu, and Jianlin Zhao
Opt. Lett. 48(18) 4849-4852 (2023)

Super-resolution multimode fiber imaging with an untrained neural network

Wei Li, Ksenia Abrashitova, and Lyubov V. Amitonova
Opt. Lett. 48(13) 3363-3366 (2023)

High-definition image transmission through dynamically perturbed multimode fiber by a self-attention based neural network

Guohua Wu, Yong Sun, Longfei Yin, Zhixiong Song, and Wenting Yu
Opt. Lett. 48(10) 2764-2767 (2023)