TY - JOUR
T1 - DCSN
T2 - Deep Compressed Sensing Network for Efficient Hyperspectral Data Transmission of Miniaturized Satellite
AU - Hsu, Chih Chung
AU - Lin, Chia Hsiang
AU - Kao, Chi Hung
AU - Lin, Yen Cheng
N1 - Funding Information:
Manuscript received June 8, 2020; revised September 22, 2020 and October 22, 2020; accepted October 22, 2020. Date of publication November 12, 2020; date of current version August 30, 2021. This work was supported in part by the Ministry of Science and Technology (MOST), Taiwan, under Grant MOST 109-2218-E-006-032, Grant 109-2634-F-007-013, and Grant 107-2218-E-020-002-MY3; in part by the Young Scholar Fellowship Program (Einstein Program) of Ministry of Science and Technology, Taiwan, under Grant MOST 109-2636-E-006-022; and in part by the Higher Education Sprout Project of Ministry of Education (MOE) to the Headquarters of University Advancement at National Cheng Kung University (NCKU). (Corresponding author: Chia-Hsiang Lin.) Chih-Chung Hsu is with the Department of Management Information Systems, National Pingtung University of Science and Technology, Pingtung 91201, Taiwan (e-mail: [email protected]).
Publisher Copyright:
© 2020 IEEE.
PY - 2021/9/1
Y1 - 2021/9/1
N2 - Requirements of compressed sensing techniques targeted at miniaturized hyperspectral satellite applications include lightweight onboard hardware, high-speed sensing, low sampling rate for compressing the massive volume of typical hyperspectral data, and noise robustness for reliable data transmission to the ground station. We achieve all these aims via deep learning, and neural networks resulted from which can be implemented on-chip, thereby allowing light hardware implementation. Our neural networks were trained from small-scaled data, but, even so, the resulting encoder achieves a very low sampling rate and very high speed. Unlike typical network training, the input-output pairs are not square but stripe-like images, partly because compressed acquisition does not allow performing compression after obtaining complete data cube and partly because stripe-like acquisition well matches the popular pushbroom hyperspectral sensing schemes. Even with such hard restriction caused by nontraditional training, the resulting decoder still reconstructs the image with high accuracy. To match the requirement of pushbroom sensing, a lightweight encoder is proposed to compress the stripe-like images immediately. Meanwhile, multiscale feature fusion block (MFB) and aggregation (MFA) modules are proposed to form our decoder for enhancing the feature representation of the compressed acquisitions. Furthermore, we achieve joint spatial/spectral super-resolution (SR) progressively, ensuring accurate hyperspectral reconstruction via a low-rank-driven decoder. The encoder and decoder are trained in an end-to-end manner, where noise robustness is forced during the training stage. Comprehensive experiments demonstrate the superiority of the proposed hyperspectral compressed sensing method, as well as its one-shot transfer learning (OTL)-based extension, both quantitatively and qualitatively.
AB - Requirements of compressed sensing techniques targeted at miniaturized hyperspectral satellite applications include lightweight onboard hardware, high-speed sensing, low sampling rate for compressing the massive volume of typical hyperspectral data, and noise robustness for reliable data transmission to the ground station. We achieve all these aims via deep learning, and neural networks resulted from which can be implemented on-chip, thereby allowing light hardware implementation. Our neural networks were trained from small-scaled data, but, even so, the resulting encoder achieves a very low sampling rate and very high speed. Unlike typical network training, the input-output pairs are not square but stripe-like images, partly because compressed acquisition does not allow performing compression after obtaining complete data cube and partly because stripe-like acquisition well matches the popular pushbroom hyperspectral sensing schemes. Even with such hard restriction caused by nontraditional training, the resulting decoder still reconstructs the image with high accuracy. To match the requirement of pushbroom sensing, a lightweight encoder is proposed to compress the stripe-like images immediately. Meanwhile, multiscale feature fusion block (MFB) and aggregation (MFA) modules are proposed to form our decoder for enhancing the feature representation of the compressed acquisitions. Furthermore, we achieve joint spatial/spectral super-resolution (SR) progressively, ensuring accurate hyperspectral reconstruction via a low-rank-driven decoder. The encoder and decoder are trained in an end-to-end manner, where noise robustness is forced during the training stage. Comprehensive experiments demonstrate the superiority of the proposed hyperspectral compressed sensing method, as well as its one-shot transfer learning (OTL)-based extension, both quantitatively and qualitatively.
UR - http://www.scopus.com/inward/record.url?scp=85131752808&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85131752808&partnerID=8YFLogxK
U2 - 10.1109/TGRS.2020.3034414
DO - 10.1109/TGRS.2020.3034414
M3 - Article
AN - SCOPUS:85131752808
SN - 0196-2892
VL - 59
SP - 7773
EP - 7789
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
IS - 9
ER -