Abstract
Light field (LF) image super-resolution (SR) can improve the limited spatial resolution of LF images by using complementary information from different perspectives. However, current LF image SR methods only use the RGB data to implicitly exploit the information among different perspectives, without paying attention to the information loss from raw data to RGB data and the explicit structure information utilization. To address the first issue, a data generation pipeline is developed to collect LF raw data for LF image SR. In addition, to make full use of the multiview information, an end-to-end convolutional neural network architecture (namely, LF-RawSR) is proposed for LF image SR. Specifically, an aggregated module is first used to fuse the angular information based on a volume transformer with plane sweep volume. Then the aggregated feature is warped to all LF views using a cross-view transformer for nonlocal dependencies utilization. The experimental results demonstrate that our method outperforms existing state-of-the-art methods with a comparative computational cost, and fine details and clear structures can be restored.
© 2022 Optica Publishing Group
Full Article | PDF ArticleMore Like This
Conghui Zhu, Yi Jiang, Yan Yuan, Lijuan Su, Xiaorui Yin, and Deqian Kong
Opt. Express 32(4) 5362-5379 (2024)
Wei Feng, Junhui Gao, Jichen Sun, and Henghui Wang
Appl. Opt. 62(12) 3016-3027 (2023)
Zhiyu Song, Yongping Lin, Liu Xiong, and Zhifang Li
J. Opt. Soc. Am. A 40(11) 2068-2077 (2023)