A survey on computational spectral reconstruction methods from RGB to hyperspectral imaging

Jingang Zhang, Runmu Su, Qiang Fu, Wenqi Ren, Felix Heide, Yunfeng Nie

Research output: Contribution to journalArticlepeer-review

6 Scopus citations

Abstract

Hyperspectral imaging enables many versatile applications for its competence in capturing abundant spatial and spectral information, which is crucial for identifying substances. However, the devices for acquiring hyperspectral images are typically expensive and very complicated, hindering the promotion of their application in consumer electronics, such as daily food inspection and point-of-care medical screening, etc. Recently, many computational spectral imaging methods have been proposed by directly reconstructing the hyperspectral information from widely available RGB images. These reconstruction methods can exclude the usage of burdensome spectral camera hardware while keeping a high spectral resolution and imaging performance. We present a thorough investigation of more than 25 state-of-the-art spectral reconstruction methods which are categorized as prior-based and data-driven methods. Simulations on open-source datasets show that prior-based methods are more suitable for rare data situations, while data-driven methods can unleash the full potential of deep learning in big data cases. We have identified current challenges faced by those methods (e.g., loss function, spectral accuracy, data generalization) and summarized a few trends for future work. With the rapid expansion in datasets and the advent of more advanced neural networks, learnable methods with fine feature representation abilities are very promising. This comprehensive review can serve as a fruitful reference source for peer researchers, thus paving the way for the development of computational hyperspectral imaging.
Original languageEnglish (US)
JournalScientific reports
Volume12
Issue number1
DOIs
StatePublished - Jul 13 2022

Bibliographical note

KAUST Repository Item: Exported on 2022-09-14
Acknowledgements: This work was supported by the Chinese Academy of Sciences (No. CAS-WX2021-PY-0110, NO. YJKYYQ20180039 and NO. Y70X25A1HY ), and the National Natural Science Foundation of China (NO. 61775219, NO. 61771369 and NO. 61640422). Yunfeng Nie acknowledges the Flemish Fund for Scientific Research (FWO) for supporting her research (No. FWOTM1039). The authors would like to thank those who provide open-sources code for the whole community, such as Sparse Coding, SRUNet, SRMSCNN, HSCNN+ and etc.

ASJC Scopus subject areas

  • General

Fingerprint

Dive into the research topics of 'A survey on computational spectral reconstruction methods from RGB to hyperspectral imaging'. Together they form a unique fingerprint.

Cite this