Skip to main content

2024 | OriginalPaper | Buchkapitel

Deep Encoder-Decoder Structure for Cloud Image Segmentation

verfasst von : Jian Li, Ying Liu, Xin Li, Jie Ren, Xueting Niu, Shuang Liu

Erschienen in: Communications, Signal Processing, and Systems

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Deep learning makes remarkable progress in the application of remote sensing image processing, particularly in the cloud image segmentation field. The encoder-decoder structure in deep learning is widely employed for cloud image segmentation tasks. The encoder extracts high-level semantic features from the input cloud image, while the decoder restores the semantic features to generate pixel-level segmentation results. Furthermore, skip connections are adopted to connect the encoder and the decoder. In this paper, we introduce and evaluate the representative encoder-decoder struture methods for cloud image segmentation. We focus on the design of encoder, decoder and skip connections. We conduct comparative experiments on cloud image datasets and analyze the encoder-decoder structure with different layers.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Long CN, Sabburg JM, Calbó J, Pagès D (2006) Retrieving cloud characteristics from ground-based daytime color all-sky images. J Atmos Oceanic Technol 23(5):633–652CrossRef Long CN, Sabburg JM, Calbó J, Pagès D (2006) Retrieving cloud characteristics from ground-based daytime color all-sky images. J Atmos Oceanic Technol 23(5):633–652CrossRef
2.
Zurück zum Zitat Wang Y, Wang C, Shi C, Xiao B (2018) A selection criterion for the optimal resolution of ground-based remote sensing cloud images for cloud classification. IEEE Trans Geosci Remote Sens 57(3):1358–1367CrossRef Wang Y, Wang C, Shi C, Xiao B (2018) A selection criterion for the optimal resolution of ground-based remote sensing cloud images for cloud classification. IEEE Trans Geosci Remote Sens 57(3):1358–1367CrossRef
3.
Zurück zum Zitat Xie W, Liu D, Yang M, Chen S, Wang B, Wang Z, Xia Y, Liu Y, Wang Y, Zhang C (2020) Segcloud: a novel cloud image segmentation model using a deep convolutional neural network for ground-based all-sky-view camera observation. Atmos Measure Tech 13(4):1953–1961CrossRef Xie W, Liu D, Yang M, Chen S, Wang B, Wang Z, Xia Y, Liu Y, Wang Y, Zhang C (2020) Segcloud: a novel cloud image segmentation model using a deep convolutional neural network for ground-based all-sky-view camera observation. Atmos Measure Tech 13(4):1953–1961CrossRef
4.
Zurück zum Zitat Liu S, Zhang J, Zhang Z, Cao X, Durrani TS (2022) Transcloudseg: ground-based cloud image segmentation with transformer. IEEE J Selec Topics Appl Earth Observ Remote Sens 15:6121–6132CrossRef Liu S, Zhang J, Zhang Z, Cao X, Durrani TS (2022) Transcloudseg: ground-based cloud image segmentation with transformer. IEEE J Selec Topics Appl Earth Observ Remote Sens 15:6121–6132CrossRef
5.
Zurück zum Zitat Wang Y, Wang C, Shi C, Xiao B (2018) Joint encoding lbp features from infrared and visible-light cloud image observations for ground-based cloud classification. In: IEEE International geoscience and remote sensing symposium, pp 4993–4996 Wang Y, Wang C, Shi C, Xiao B (2018) Joint encoding lbp features from infrared and visible-light cloud image observations for ground-based cloud classification. In: IEEE International geoscience and remote sensing symposium, pp 4993–4996
6.
Zurück zum Zitat Zhang Z, Yang S, Liu S, Xiao B, Cao X (2022) Ground-based cloud detection using multiscale attention convolutional neural network. IEEE Geosci Remote Sens Lett 19:1–5 Zhang Z, Yang S, Liu S, Xiao B, Cao X (2022) Ground-based cloud detection using multiscale attention convolutional neural network. IEEE Geosci Remote Sens Lett 19:1–5
7.
Zurück zum Zitat Kreuter A, Zangerl M, Schwarzmann M, Blumthaler M (2009) All-sky imaging: a simple, versatile system for atmospheric research. Appl Opt 48(6):1091–1097CrossRef Kreuter A, Zangerl M, Schwarzmann M, Blumthaler M (2009) All-sky imaging: a simple, versatile system for atmospheric research. Appl Opt 48(6):1091–1097CrossRef
8.
Zurück zum Zitat Taravat A, Del Frate F, Cornaro C, Vergari S (2014) Neural networks and support vector machine algorithms for automatic cloud classification of whole-sky ground-based images. IEEE Geosci Remote Sens Lett 12(3):666–670CrossRef Taravat A, Del Frate F, Cornaro C, Vergari S (2014) Neural networks and support vector machine algorithms for automatic cloud classification of whole-sky ground-based images. IEEE Geosci Remote Sens Lett 12(3):666–670CrossRef
9.
Zurück zum Zitat Allmen MC, Kegelmeyer WP Jr (1996) The computation of cloud-base height from paired whole-sky imaging cameras. J Atmos Oceanic Tech 13(1):97–113CrossRef Allmen MC, Kegelmeyer WP Jr (1996) The computation of cloud-base height from paired whole-sky imaging cameras. J Atmos Oceanic Tech 13(1):97–113CrossRef
10.
Zurück zum Zitat Fikriansyah MN, Nugroho HA, Sinambela M (2022) Low cloud type classification system using convolutional neural network algorithm. In: International conference on informatics and computing, pp 1–6 Fikriansyah MN, Nugroho HA, Sinambela M (2022) Low cloud type classification system using convolutional neural network algorithm. In: International conference on informatics and computing, pp 1–6
11.
Zurück zum Zitat Lai C, Liu T, Mei R, Wang H, Hu S (2019) The cloud images classification based on convolutional neural network. In: International conference on meteorology observations, pp 1–4 Lai C, Liu T, Mei R, Wang H, Hu S (2019) The cloud images classification based on convolutional neural network. In: International conference on meteorology observations, pp 1–4
12.
Zurück zum Zitat Shi C, Wang Y, Wang C, Xiao B (2017) Ground-based cloud detection using graph model built upon superpixels. IEEE Geosci Remote Sens Lett 14(5):719–723CrossRef Shi C, Wang Y, Wang C, Xiao B (2017) Ground-based cloud detection using graph model built upon superpixels. IEEE Geosci Remote Sens Lett 14(5):719–723CrossRef
13.
Zurück zum Zitat Yang J, Lu W, Ma Y, Yao W (2012) An automated cirrus cloud detection method for a ground-based cloud image. J Atmos Oceanic Tech 29(4):527–537CrossRef Yang J, Lu W, Ma Y, Yao W (2012) An automated cirrus cloud detection method for a ground-based cloud image. J Atmos Oceanic Tech 29(4):527–537CrossRef
14.
Zurück zum Zitat Dev S, Nautiyal A, Lee YH, Winkler S (2019) Cloudsegnet: a deep network for nychthemeron cloud image segmentation. IEEE Geosci Remote Sens Lett 16(12):1814–1818CrossRef Dev S, Nautiyal A, Lee YH, Winkler S (2019) Cloudsegnet: a deep network for nychthemeron cloud image segmentation. IEEE Geosci Remote Sens Lett 16(12):1814–1818CrossRef
15.
Zurück zum Zitat Qi H, Yuan J, Li L, Ren J, Liang J (2019) A infrared cloud image simulation method for cloud segmentation network training. Int Appl Comput Electromag Soc Sympo 1:1–2 Qi H, Yuan J, Li L, Ren J, Liang J (2019) A infrared cloud image simulation method for cloud segmentation network training. Int Appl Comput Electromag Soc Sympo 1:1–2
16.
Zurück zum Zitat Liu S, Zhang J, Zhang Z, Cao X, Durrani TS (2023) Integration transformer for ground-based cloud image segmentation. IEEE Trans Geosci Remote Sens 61:1–12CrossRef Liu S, Zhang J, Zhang Z, Cao X, Durrani TS (2023) Integration transformer for ground-based cloud image segmentation. IEEE Trans Geosci Remote Sens 61:1–12CrossRef
17.
Zurück zum Zitat Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: IEEE Conference on computer vision and pattern recognition, pp 3431–3440 Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: IEEE Conference on computer vision and pattern recognition, pp 3431–3440
18.
Zurück zum Zitat Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. Med Image Comput Comput Assist Inter 234–241 Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. Med Image Comput Comput Assist Inter 234–241
19.
Zurück zum Zitat Zhao H, Shi J, Qi X, Wang X, Jia J (2017) Pyramid scene parsing network. In: IEEE Conference on computer vision and pattern recognition, pp 6230–6239 Zhao H, Shi J, Qi X, Wang X, Jia J (2017) Pyramid scene parsing network. In: IEEE Conference on computer vision and pattern recognition, pp 6230–6239
20.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: IEEE conference on computer vision and pattern recognition, pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: IEEE conference on computer vision and pattern recognition, pp 770–778
21.
Zurück zum Zitat Shi W, Caballero J, Theis L, Huszar F, Aitken A, Ledig C, Wang Z (2016) Is the deconvolution layer the same as a convolutional layer? arXiv preprint arXiv:1609.07009 Shi W, Caballero J, Theis L, Huszar F, Aitken A, Ledig C, Wang Z (2016) Is the deconvolution layer the same as a convolutional layer? arXiv preprint arXiv:​1609.​07009
23.
Zurück zum Zitat Sutskever I, Martens J, Dahl G, Hinton G (2013) On the importance of initialization and momentum in deep learning. In: International conference on machine learning, pp 1139–1147 Sutskever I, Martens J, Dahl G, Hinton G (2013) On the importance of initialization and momentum in deep learning. In: International conference on machine learning, pp 1139–1147
Metadaten
Titel
Deep Encoder-Decoder Structure for Cloud Image Segmentation
verfasst von
Jian Li
Ying Liu
Xin Li
Jie Ren
Xueting Niu
Shuang Liu
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-99-7502-0_8

Neuer Inhalt