Abstract

Recently, polarization-based models for camouflaged object segmentation have attracted research attention. However, to construct this camouflaged object segmentation model, the main challenge is to effectively fuse polarization and light intensity features. Therefore, we propose a multi-modal camouflaged object segmentation method via gated fusion. First, the spatial positioning module is designed to perform channel calibration and global spatial attention alignment between polarization mode and light intensity mode from high-level feature representation to locate object positioning accurately. Then, the gated fusion module (GFM) is designed to selectively fuse the object information contained in the polarization and light intensity features. Among them, semantic information of location features is introduced in the GFM to guide each mode to aggregate dominant features. Finally, the features of each layer are aggregated to obtain an accurate segmentation result map. At the same time, considering the lack of public evaluation and training data on light intensity–polarization (I-P) camouflaged detection, we build the light I-P camouflaged detection dataset. Experimental results demonstrate that our proposed method outperforms other typical multi-modal segmentation methods in this dataset.

© 2022 Optica Publishing Group

Polarization-driven semantic segmentation via efficient attention-bridged fusion

Kaite Xiang, Kailun Yang, and Kaiwei Wang
Opt. Express 29(4) 4802-4820 (2021)

Semantic-guided polarization image fusion method based on a dual-discriminator GAN

Ju Liu, Jin Duan, Youfei Hao, Guangqiu Chen, and Hao Zhang
Opt. Express 30(24) 43601-43621 (2022)

MAFFNet: real-time multi-level attention feature fusion network with RGB-D semantic segmentation for autonomous driving

Tongfei Lv, Yu Zhang, Lin Luo, and Xiaorong Gao
Appl. Opt. 61(9) 2219-2229 (2022)

Fusion network based on the dual attention mechanism and atrous spatial pyramid pooling for automatic segmentation in retinal vessel images

Bingtao Liang, Chen Tang, Min Xu, Tianbo Wu, and Zhenkun Lei
J. Opt. Soc. Am. A 39(8) 1393-1402 (2022)

Exploiting fusion architectures for multispectral pedestrian detection and segmentation

Dayan Guan, Yanpeng Cao, Jiangxin Yang, Yanlong Cao, and Christel-Loic Tisse
Appl. Opt. 57(18) D108-D116 (2018)