Skip to main content

2024 | OriginalPaper | Buchkapitel

Single Image Super Resolution Based on Dual-Path Large Kernel Learning

verfasst von : He Jiang, Gui Liu, Gaoting Cao, Ping Zheng, Haoxiang Zhang, Qiqi Kou, Feixiang Xu, Deqiang Cheng

Erschienen in: Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

To excel in image super-resolution, deep neural network-based models often employ a stacking strategy of network modules. However, this approach leads to parameter explosion and information redundancy, thereby restricting the feasibility of deploying these models on mobile devices. To tackle this challenge, this study introduces a lightweight Dual-path Large Kernel Learning approach, namely DLKL, and applies it to image super-resolution. In DLKL, the first step involves the utilization of multi-scale large kernel decomposition to effectively establish long-range dependencies between pixels and successfully preserve local information. Subsequently, DLKL enhances the feature expression ability and achieves effective feature fusion through its dual-path network architecture. Furthermore, DLKL reduces the number of parameters while maintaining performance, thus striking a balance between network performance and efficiency. The remarkable performance of DLKL has been validated through a multitude of experiments by quantitative metric tests and visual evaluations. Comparative analysis, conducted against other prevailing algorithms, provides evidence of the DLKL method’s consistent proficiency in generating images featuring enhanced texture clarity and more faithful representation of natural structures. These findings serve to reinforce the method’s inherent superiority and robustness.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Dong, C., et al.: Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 38, 295–307 (2014)CrossRef Dong, C., et al.: Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 38, 295–307 (2014)CrossRef
2.
Zurück zum Zitat Kim, J., et al.: Accurate image super-resolution using very deep convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1646–1654 (2015) Kim, J., et al.: Accurate image super-resolution using very deep convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1646–1654 (2015)
3.
Zurück zum Zitat Lim, B., et al.: Enhanced deep residual networks for single image super-resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1132–1140 (2017) Lim, B., et al.: Enhanced deep residual networks for single image super-resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1132–1140 (2017)
4.
Zurück zum Zitat Kim, J., et al.: Deeply-recursive convolutional network for image super-resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1637–1645 (2015) Kim, J., et al.: Deeply-recursive convolutional network for image super-resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1637–1645 (2015)
5.
Zurück zum Zitat Zhang, Y., et al.: Image super-resolution using very deep residual channel attention networks. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 286–301 (2018) Zhang, Y., et al.: Image super-resolution using very deep residual channel attention networks. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 286–301 (2018)
6.
Zurück zum Zitat Chen, H., et al.: Pre-trained image processing transformer. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 12294–12305 (2020) Chen, H., et al.: Pre-trained image processing transformer. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 12294–12305 (2020)
7.
Zurück zum Zitat Lan, R., et al.: MADNet: a fast and lightweight network for single-image super resolution. IEEE Trans. Cybern. 51, 1443–1453 (2020)CrossRef Lan, R., et al.: MADNet: a fast and lightweight network for single-image super resolution. IEEE Trans. Cybern. 51, 1443–1453 (2020)CrossRef
8.
Zurück zum Zitat Guo, M., et al.: Visual attention network. Comput. Vis. Media 9, 733–752 (2022)CrossRef Guo, M., et al.: Visual attention network. Comput. Vis. Media 9, 733–752 (2022)CrossRef
9.
Zurück zum Zitat Wang, Q., et al.: ECA-net: efficient channel attention for deep convolutional neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.11531–11539 (2019) Wang, Q., et al.: ECA-net: efficient channel attention for deep convolutional neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.11531–11539 (2019)
10.
Zurück zum Zitat Bevilacqua, M., et al.: Low-complexity single-image super-resolution based on nonnegative neighbor embedding. In: Proceedings of the British Machine Vision Conference (2012) Bevilacqua, M., et al.: Low-complexity single-image super-resolution based on nonnegative neighbor embedding. In: Proceedings of the British Machine Vision Conference (2012)
12.
Zurück zum Zitat Huang, J-B., et al.: Single image super-resolution from transformed self-exemplars. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5197–5206 (2015) Huang, J-B., et al.: Single image super-resolution from transformed self-exemplars. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5197–5206 (2015)
14.
Zurück zum Zitat Lai, W-S., et al.: Deep Laplacian pyramid networks for fast and accurate super-resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5835–5843 (2017) Lai, W-S., et al.: Deep Laplacian pyramid networks for fast and accurate super-resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5835–5843 (2017)
15.
Zurück zum Zitat Ahn, N., et al.: Fast, accurate, and, lightweight super-resolution with cascading residual network. In: Proceedings of the European Conference on Computer Vision, (ECCV), pp. 256–272 (2018) Ahn, N., et al.: Fast, accurate, and, lightweight super-resolution with cascading residual network. In: Proceedings of the European Conference on Computer Vision, (ECCV), pp. 256–272 (2018)
16.
Zurück zum Zitat Hui, Z., et al.: Lightweight image super-resolution with information multi-distillation network. In: Proceedings of the ACM International Conference on Multimedia, pp. 2024–2032 (2019) Hui, Z., et al.: Lightweight image super-resolution with information multi-distillation network. In: Proceedings of the ACM International Conference on Multimedia, pp. 2024–2032 (2019)
17.
Zurück zum Zitat Wang, X., et al.: Lightweight single-image super-resolution network with attentive auxiliary feature learning. In: Proceedings of the Asian Conference on Computer Vision (ACCV), pp. 3023–3041 (2020) Wang, X., et al.: Lightweight single-image super-resolution network with attentive auxiliary feature learning. In: Proceedings of the Asian Conference on Computer Vision (ACCV), pp. 3023–3041 (2020)
18.
Zurück zum Zitat Wang, L., et al.: Exploring sparsity in image super-resolution for efficient inference. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4915–4924 (2021) Wang, L., et al.: Exploring sparsity in image super-resolution for efficient inference. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4915–4924 (2021)
19.
Zurück zum Zitat Yan, Y., et al.: Lightweight attended multi-scale residual network for single image super-resolution. IEEE Access 9, 52202–52212 (2021)CrossRef Yan, Y., et al.: Lightweight attended multi-scale residual network for single image super-resolution. IEEE Access 9, 52202–52212 (2021)CrossRef
20.
Zurück zum Zitat Qin, J., et al.: Lightweight single image super-resolution with attentive residual refinement network. Neurocomputing 500, 846–855 (2022)CrossRef Qin, J., et al.: Lightweight single image super-resolution with attentive residual refinement network. Neurocomputing 500, 846–855 (2022)CrossRef
21.
Zurück zum Zitat Woo, S., et al.: CBAM: convolutional block attention module. In: Proceedings of the European Conference on Computer Vision, pp. 3–19 (2018) Woo, S., et al.: CBAM: convolutional block attention module. In: Proceedings of the European Conference on Computer Vision, pp. 3–19 (2018)
22.
Zurück zum Zitat Kou, Q., et al.: Single image super resolution via multi-attention fusion recurrent network. IEEE Access 11, 98653–98665 (2023)CrossRef Kou, Q., et al.: Single image super resolution via multi-attention fusion recurrent network. IEEE Access 11, 98653–98665 (2023)CrossRef
23.
Zurück zum Zitat Jiang, H., et al.: Learning in-place residual homogeneity for image detail enhancement. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1428–1432 (2018) Jiang, H., et al.: Learning in-place residual homogeneity for image detail enhancement. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1428–1432 (2018)
24.
Zurück zum Zitat Jiang, H., et al.: Single image detail enhancement via metropolis theorem. Multimedia Tools Appl. 1–25 (2023) Jiang, H., et al.: Single image detail enhancement via metropolis theorem. Multimedia Tools Appl. 1–25 (2023)
25.
Zurück zum Zitat Wan, J., et al.: Lightweight image super-resolution by multi-scale aggregation. IEEE Trans. Broadcast. 67, 372–382 (2021)CrossRef Wan, J., et al.: Lightweight image super-resolution by multi-scale aggregation. IEEE Trans. Broadcast. 67, 372–382 (2021)CrossRef
26.
Zurück zum Zitat Wang, Z., et al.: Lightweight image super-resolution with multi-scale feature interaction network. In: 2021 IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6 (2021) Wang, Z., et al.: Lightweight image super-resolution with multi-scale feature interaction network. In: 2021 IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6 (2021)
27.
Zurück zum Zitat Arbeláez, P., et al.: Contour detection and hierarchical image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 33, 898–916 (2011)CrossRef Arbeláez, P., et al.: Contour detection and hierarchical image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 33, 898–916 (2011)CrossRef
29.
Zurück zum Zitat Holla, R., et al.: High-performance medical image secret sharing using super-resolution for CAD systems. Appl. Intell. 52, 16852–16868 (2022)CrossRef Holla, R., et al.: High-performance medical image secret sharing using super-resolution for CAD systems. Appl. Intell. 52, 16852–16868 (2022)CrossRef
30.
Zurück zum Zitat Wu, H., et al.: Remote sensing image super-resolution via saliency-guided feedback GANs. IEEE Trans. Geosci. Remote Sens. 60, 1–16 (2022)CrossRef Wu, H., et al.: Remote sensing image super-resolution via saliency-guided feedback GANs. IEEE Trans. Geosci. Remote Sens. 60, 1–16 (2022)CrossRef
Metadaten
Titel
Single Image Super Resolution Based on Dual-Path Large Kernel Learning
verfasst von
He Jiang
Gui Liu
Gaoting Cao
Ping Zheng
Haoxiang Zhang
Qiqi Kou
Feixiang Xu
Deqiang Cheng
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2757-5_63

Premium Partner