Abstract
Existing hyperspectral image (HSI) super-resolution methods fusing a high-resolution RGB image (HR-RGB) and a low-resolution HSI (LR-HSI) always rely on spatial degradation and handcrafted priors, which hinders their practicality. To address these problems, we propose a novel, to the best of our knowledge, method with two transfer models: a window-based linear mixing (W-LM) model and a feature transfer model. Specifically, W-LM initializes a high-resolution HSI (HR-HSI) by transferring the spectra from the LR-HSI to the HR-RGB. By using the proposed feature transfer model, the HR-RGB multi-level features extracted by a pre-trained convolutional neural network (CNN) are then transferred to the initialized HR-HSI. The proposed method fully exploits spectra of LR-HSI and multi-level features of HR-RGB and achieves super-resolution without requiring the spatial degradation model and any handcrafted priors. The experimental results for 32 × super-resolution on two public datasets and our real image set demonstrate the proposed method outperforms eight state-of-the-art existing methods.
© 2022 Optica Publishing Group
Full Article | PDF ArticleMore Like This
Xuheng Cao, Yusheng Lian, Zilong Liu, Han Zhou, Bin Wang, Wan Zhang, and Beiqing Huang
Opt. Lett. 47(19) 5184-5187 (2022)
Xuheng Cao, Yusheng Lian, Zilong Liu, Jiahui Wu, Wan Zhang, and Jianghao Liu
J. Opt. Soc. Am. A 40(8) 1635-1643 (2023)
Xuheng Cao, Yusheng Lian, Zilong Liu, Jin Li, and Kaixuan Wang
Opt. Lett. 49(8) 1993-1996 (2024)