Clouds classification from Sentinel-2 imagery with deep residual learning and semantic image segmentation

Cheng Chien Liu, Yu Cheng Zhang, Pei Yin Chen, Chien Chih Lai, Yi Hsin Chen, Ji Hong Cheng, Ming Hsun Ko

研究成果: Article

3 引文 (Scopus)

摘要

Detecting changes in land use and land cover (LULC) from space has long been the main goal of satellite remote sensing (RS), yet the existing and available algorithms for cloud classification are not reliable enough to attain this goal in an automated fashion. Clouds are very strong optical signals that dominate the results of change detection if they are not removed completely from imagery. As various architectures of deep learning (DL) have been proposed and advanced quickly, their potential in perceptual tasks has been widely accepted and successfully applied to many fields. A comprehensive survey of DL in RS has been reviewed, and the RS community has been suggested to be leading researchers in DL. Based on deep residual learning, semantic image segmentation, and the concept of atrous convolution, we propose a new DL architecture, named CloudNet, with an enhanced capability of feature extraction for classifying cloud and haze from Sentinel-2 imagery, with the intention of supporting automatic change detection in LULC. To ensure the quality of the training dataset, scene classification maps of Taiwan processed by Sen2cor were visually examined and edited, resulting in a total of 12,769 sub-images with a standard size of 224 × 224 pixels, cut from the Sen2cor-corrected images and compiled in a trainset. The data augmentation technique enabled CloudNet to have stable cirrus identification capability without extensive training data. Compared to the traditional method and other DL methods, CloudNet had higher accuracy in cloud and haze classification, as well as better performance in cirrus cloud recognition. CloudNet will be incorporated into the Open Access Satellite Image Service to facilitate change detection by using Sentinel-2 imagery on a regular and automatic basis.

原文English
文章編號119
期刊Remote Sensing
11
發行號2
DOIs
出版狀態Published - 2019 一月 1

指紋

cloud classification
segmentation
imagery
learning
haze
cirrus
remote sensing
land cover
land use
pixel
detection

All Science Journal Classification (ASJC) codes

  • Earth and Planetary Sciences(all)

引用此文

Liu, Cheng Chien ; Zhang, Yu Cheng ; Chen, Pei Yin ; Lai, Chien Chih ; Chen, Yi Hsin ; Cheng, Ji Hong ; Ko, Ming Hsun. / Clouds classification from Sentinel-2 imagery with deep residual learning and semantic image segmentation. 於: Remote Sensing. 2019 ; 卷 11, 編號 2.
@article{5cf8ac07ab524c319f8a41ffaccc6074,
title = "Clouds classification from Sentinel-2 imagery with deep residual learning and semantic image segmentation",
abstract = "Detecting changes in land use and land cover (LULC) from space has long been the main goal of satellite remote sensing (RS), yet the existing and available algorithms for cloud classification are not reliable enough to attain this goal in an automated fashion. Clouds are very strong optical signals that dominate the results of change detection if they are not removed completely from imagery. As various architectures of deep learning (DL) have been proposed and advanced quickly, their potential in perceptual tasks has been widely accepted and successfully applied to many fields. A comprehensive survey of DL in RS has been reviewed, and the RS community has been suggested to be leading researchers in DL. Based on deep residual learning, semantic image segmentation, and the concept of atrous convolution, we propose a new DL architecture, named CloudNet, with an enhanced capability of feature extraction for classifying cloud and haze from Sentinel-2 imagery, with the intention of supporting automatic change detection in LULC. To ensure the quality of the training dataset, scene classification maps of Taiwan processed by Sen2cor were visually examined and edited, resulting in a total of 12,769 sub-images with a standard size of 224 × 224 pixels, cut from the Sen2cor-corrected images and compiled in a trainset. The data augmentation technique enabled CloudNet to have stable cirrus identification capability without extensive training data. Compared to the traditional method and other DL methods, CloudNet had higher accuracy in cloud and haze classification, as well as better performance in cirrus cloud recognition. CloudNet will be incorporated into the Open Access Satellite Image Service to facilitate change detection by using Sentinel-2 imagery on a regular and automatic basis.",
author = "Liu, {Cheng Chien} and Zhang, {Yu Cheng} and Chen, {Pei Yin} and Lai, {Chien Chih} and Chen, {Yi Hsin} and Cheng, {Ji Hong} and Ko, {Ming Hsun}",
year = "2019",
month = "1",
day = "1",
doi = "10.3390/rs11020119",
language = "English",
volume = "11",
journal = "Remote Sensing",
issn = "2072-4292",
publisher = "Multidisciplinary Digital Publishing Institute (MDPI)",
number = "2",

}

Clouds classification from Sentinel-2 imagery with deep residual learning and semantic image segmentation. / Liu, Cheng Chien; Zhang, Yu Cheng; Chen, Pei Yin; Lai, Chien Chih; Chen, Yi Hsin; Cheng, Ji Hong; Ko, Ming Hsun.

於: Remote Sensing, 卷 11, 編號 2, 119, 01.01.2019.

研究成果: Article

TY - JOUR

T1 - Clouds classification from Sentinel-2 imagery with deep residual learning and semantic image segmentation

AU - Liu, Cheng Chien

AU - Zhang, Yu Cheng

AU - Chen, Pei Yin

AU - Lai, Chien Chih

AU - Chen, Yi Hsin

AU - Cheng, Ji Hong

AU - Ko, Ming Hsun

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Detecting changes in land use and land cover (LULC) from space has long been the main goal of satellite remote sensing (RS), yet the existing and available algorithms for cloud classification are not reliable enough to attain this goal in an automated fashion. Clouds are very strong optical signals that dominate the results of change detection if they are not removed completely from imagery. As various architectures of deep learning (DL) have been proposed and advanced quickly, their potential in perceptual tasks has been widely accepted and successfully applied to many fields. A comprehensive survey of DL in RS has been reviewed, and the RS community has been suggested to be leading researchers in DL. Based on deep residual learning, semantic image segmentation, and the concept of atrous convolution, we propose a new DL architecture, named CloudNet, with an enhanced capability of feature extraction for classifying cloud and haze from Sentinel-2 imagery, with the intention of supporting automatic change detection in LULC. To ensure the quality of the training dataset, scene classification maps of Taiwan processed by Sen2cor were visually examined and edited, resulting in a total of 12,769 sub-images with a standard size of 224 × 224 pixels, cut from the Sen2cor-corrected images and compiled in a trainset. The data augmentation technique enabled CloudNet to have stable cirrus identification capability without extensive training data. Compared to the traditional method and other DL methods, CloudNet had higher accuracy in cloud and haze classification, as well as better performance in cirrus cloud recognition. CloudNet will be incorporated into the Open Access Satellite Image Service to facilitate change detection by using Sentinel-2 imagery on a regular and automatic basis.

AB - Detecting changes in land use and land cover (LULC) from space has long been the main goal of satellite remote sensing (RS), yet the existing and available algorithms for cloud classification are not reliable enough to attain this goal in an automated fashion. Clouds are very strong optical signals that dominate the results of change detection if they are not removed completely from imagery. As various architectures of deep learning (DL) have been proposed and advanced quickly, their potential in perceptual tasks has been widely accepted and successfully applied to many fields. A comprehensive survey of DL in RS has been reviewed, and the RS community has been suggested to be leading researchers in DL. Based on deep residual learning, semantic image segmentation, and the concept of atrous convolution, we propose a new DL architecture, named CloudNet, with an enhanced capability of feature extraction for classifying cloud and haze from Sentinel-2 imagery, with the intention of supporting automatic change detection in LULC. To ensure the quality of the training dataset, scene classification maps of Taiwan processed by Sen2cor were visually examined and edited, resulting in a total of 12,769 sub-images with a standard size of 224 × 224 pixels, cut from the Sen2cor-corrected images and compiled in a trainset. The data augmentation technique enabled CloudNet to have stable cirrus identification capability without extensive training data. Compared to the traditional method and other DL methods, CloudNet had higher accuracy in cloud and haze classification, as well as better performance in cirrus cloud recognition. CloudNet will be incorporated into the Open Access Satellite Image Service to facilitate change detection by using Sentinel-2 imagery on a regular and automatic basis.

UR - http://www.scopus.com/inward/record.url?scp=85060691480&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85060691480&partnerID=8YFLogxK

U2 - 10.3390/rs11020119

DO - 10.3390/rs11020119

M3 - Article

AN - SCOPUS:85060691480

VL - 11

JO - Remote Sensing

JF - Remote Sensing

SN - 2072-4292

IS - 2

M1 - 119

ER -