Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Deep learning network for fusing optical and infrared images in a complex imaging environment by using the modified U-Net

Not Accessible

Your library or personal account may give you access

Abstract

The fusion of optical and infrared images is a critical task in the field of image processing. However, it is challenging to achieve optimal results when fusing images from complex environments. In this paper, we propose a deep learning network model comprising an encoding network and a decoding network based on the modified U-Net network to fuse low-quality images from complex imaging environments. As both encoding and decoding networks use similar convolutional modules, they can share similar layer structures to improve the overall fusion performance. Furthermore, an attention mechanism module is integrated into the decoding network to identify and capture the crucial features of the fused images. It can assist the deep learning network to extract more relevant image features and thus get more accurate fusion. The proposed model has been compared with some existing methods to prove its performance in view of subjective and objective evaluations.

© 2023 Optica Publishing Group

Full Article  |  PDF Article
More Like This
Multiscale feature pyramid network based on activity level weight selection for infrared and visible image fusion

Rui Xu, Gang Liu, Yuning Xie, Bavirisetti Durga Prasad, Yao Qian, and Mengliang Xing
J. Opt. Soc. Am. A 39(12) 2193-2204 (2022)

Surface weak scratch detection for optical elements based on a multimodal imaging system and a deep encoder–decoder network

Xiao Liang, Jingshuang Sun, Xuewei Wang, Jie Li, Lianpeng Zhang, and Jingbo Guo
J. Opt. Soc. Am. A 40(6) 1237-1248 (2023)

Underwater motion scene image restoration based on an improved U-Net network

Jianye Liu, Hu Luo, and Dawei Tu
Appl. Opt. 63(1) 228-238 (2024)

Data availability

The data that support the findings of this study are available from the corresponding author upon reasonable request.

Cited By

You do not have subscription access to this journal. Cited by links are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Figures (9)

You do not have subscription access to this journal. Figure files are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Tables (4)

You do not have subscription access to this journal. Article tables are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Equations (9)

You do not have subscription access to this journal. Equations are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All Rights Reserved