Pansharpening by interspectral similarity and edge information using improved deep residual network

Peng Yu Chen, Shen Chuan Tai

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

Remote sensing image pansharpening involves the fusing of multispectral (MS) images with a panchromatic (PAN) image to produce an image with high-spatial as well as high-spectral resolution. We propose an improved pansharpening algorithm based on deep learning. A four-layer residual network is used as a reconstructed model to enable the accurate estimation of high-frequency details. We consider two priors to take advantage of MS information. The first prior indicates interspectral similarity, wherein the relationship between high- and low-resolution PAN images is used in the estimation of high-resolution MS images. The second prior provides the location of edges and textures according to the gradient of the PAN image. Consistency in the spectral characteristic is used as the basis in creating a pretrained model with the aim of accelerating convergence. Multiple evaluation metrics were applied to simulated and real images in order to compare the efficacy of the proposed method with that of state-of-the-art image fusion methods.

Original languageEnglish
Article number033013
JournalJournal of Electronic Imaging
Volume27
Issue number3
DOIs
Publication statusPublished - 2018 May 1

All Science Journal Classification (ASJC) codes

  • Atomic and Molecular Physics, and Optics
  • Computer Science Applications
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Pansharpening by interspectral similarity and edge information using improved deep residual network'. Together they form a unique fingerprint.

Cite this