Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Light field image super-resolution based on raw data with transformers

Not Accessible

Your library or personal account may give you access

Abstract

Light field (LF) image super-resolution (SR) can improve the limited spatial resolution of LF images by using complementary information from different perspectives. However, current LF image SR methods only use the RGB data to implicitly exploit the information among different perspectives, without paying attention to the information loss from raw data to RGB data and the explicit structure information utilization. To address the first issue, a data generation pipeline is developed to collect LF raw data for LF image SR. In addition, to make full use of the multiview information, an end-to-end convolutional neural network architecture (namely, LF-RawSR) is proposed for LF image SR. Specifically, an aggregated module is first used to fuse the angular information based on a volume transformer with plane sweep volume. Then the aggregated feature is warped to all LF views using a cross-view transformer for nonlocal dependencies utilization. The experimental results demonstrate that our method outperforms existing state-of-the-art methods with a comparative computational cost, and fine details and clear structures can be restored.

© 2022 Optica Publishing Group

Full Article  |  PDF Article
More Like This
Full-resolution image restoration for light field images via a spatial shift-variant degradation network

Conghui Zhu, Yi Jiang, Yan Yuan, Lijuan Su, Xiaorui Yin, and Deqian Kong
Opt. Express 32(4) 5362-5379 (2024)

3D reconstruction of light-field images based on spatiotemporal correlation super-resolution

Wei Feng, Junhui Gao, Jichen Sun, and Henghui Wang
Appl. Opt. 62(12) 3016-3027 (2023)

Super-resolution algorithm for the characterization of sweat glands in fingerprint OCT images

Zhiyu Song, Yongping Lin, Liu Xiong, and Zhifang Li
J. Opt. Soc. Am. A 40(11) 2068-2077 (2023)

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Cited By

You do not have subscription access to this journal. Cited by links are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Figures (11)

You do not have subscription access to this journal. Figure files are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Tables (6)

You do not have subscription access to this journal. Article tables are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Equations (15)

You do not have subscription access to this journal. Equations are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.