CODE-IF: A Convex/Deep Image Fusion Algorithm for Efficient Hyperspectral Super-Resolution

Chia Hsiang Lin, Cheng Ying Hsieh, Jhao Ting Lin

Research output: Contribution to journalArticlepeer-review

Abstract

Super-resolving remotely acquired hyperspectral images (HSIs), often with low resolution (LR), is a critical signal-processing technique, as it greatly affects the subsequent material classification and identification tasks. An economical approach in the remote sensing area is to fuse the spatial details extracted from the high-resolution (HR) counterpart multispectral image (MSI) into the LR HSI, thereby inferring the desired HR HSI. Convex analysis is an effective tool for the fusion mission, but it often relies on sophisticated regularization schemes to tackle this challenging inverse problem. In the existing literature, the deep plug-and-play (PnP) strategy was proposed for fast implementation of those sophisticated regularizers, but just approximately without convergence guarantees. Thus, we introduce deep learning (in an alternative approach) to tailor a simple convex regularizer for efficient super-resolution. Remarkably, though typical deep fusion methods can tackle nonlinear effects presented in real hyperspectral data, they often rely on big data and sophisticated network structures, which are often time-consuming and resource-intensive. Instead, our deep regularizer just needs a small-data-driven simple network architecture that implies better stability and tractability; we achieve so by reconsidering the role of deep learning as simply to guide the convex algorithm to search the fusion solution, rather than directly serving as the final solution. The proposed convex/deep image fusion (CODE-IF) algorithm, with all the closed-form algorithmic expressions derived, achieves state-of-the-art hyperspectral super-resolution (HSR) performance.

Original languageEnglish
Article number5617318
Pages (from-to)1-18
Number of pages18
JournalIEEE Transactions on Geoscience and Remote Sensing
Volume62
DOIs
Publication statusPublished - 2024

All Science Journal Classification (ASJC) codes

  • Electrical and Electronic Engineering
  • General Earth and Planetary Sciences

Fingerprint

Dive into the research topics of 'CODE-IF: A Convex/Deep Image Fusion Algorithm for Efficient Hyperspectral Super-Resolution'. Together they form a unique fingerprint.

Cite this