BUSIFusion: Blind Unsupervised Single Image Fusion of Hyperspectral and RGB Images

Jiabao Li, Yuqi Li, Chong Wang, Xulun Ye, Wolfgang Heidrich

Research output: Contribution to journalArticlepeer-review

10 Scopus citations

Abstract

Hyperspectral images (HSIs) provide rich spectral information that has been widely used in numerous computer vision tasks. However, their low spatial resolution often prevents their use in applications such as image segmentation and recognition. Fusing low-resolution HSIs with high-resolution RGB images to reconstruct high-resolution HSIs has attracted great research attention recently. In this paper, we propose an unsupervised blind fusion network that operates on a single HSI and RGB image pair and requires neither known degradation models nor any training data. Our method takes full advantage of an unrolling network and coordinate encoding to provide a state-of-the-art HSI reconstruction. It can also estimate the degradation parameters relatively accurately through the neural representation and implicit regularization of the degradation model. The experimental results demonstrate the effectiveness of our method both in simulations and in our real experiments. The proposed method outperforms other state-of-the-art nonblind and blind fusion methods on two popular HSI datasets.
Original languageEnglish (US)
Pages (from-to)1-12
Number of pages12
JournalIEEE Transactions on Computational Imaging
DOIs
StatePublished - Feb 6 2023

Bibliographical note

KAUST Repository Item: Exported on 2023-02-10
Acknowledgements: The work has been supported by the Natural Science Foundation of Zhejiang Province(Y19F020050)

Fingerprint

Dive into the research topics of 'BUSIFusion: Blind Unsupervised Single Image Fusion of Hyperspectral and RGB Images'. Together they form a unique fingerprint.

Cite this