Skip to main content

2024 | OriginalPaper | Buchkapitel

A Novel SegNet Model for Crack Image Semantic Segmentation in Bridge Inspection

verfasst von : Rong Pang, Hao Tan, Yan Yang, Xun Xu, Nanqing Liu, Peng Zhang

Erschienen in: Advances in Knowledge Discovery and Data Mining

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Cracks on bridge surfaces represent a significant defect that demands accurate and efficient inspection methods. However, current approaches for segmenting cracks suffer from low accuracy and slow detection speed, particularly when dealing with fine and small cracks that occupy only a few pixels. In this work, we propose a novel crack image semantic segmentation method based on an enhanced SegNet. The proposed approach addresses these challenges through three key innovations. First, we reduce the network depth to improve computational efficiency while maintaining accuracy. Furthermore, we employ ConvNeXt-V2 to effectively extract and fuse crack features, thereby improving segmentation performance. To handle pixel imbalance during loss calculation, we integrate the Dice coefficient into the original cross-entropy loss function. Experimental results demonstrate that our enhanced SegNet achieves remarkable improvements in mIoU for non-steel and steel crack segmentation tasks, reaching 82.37% and 77.26%, respectively. Our approach outperforms state-of-the-art methods in both inference speed and accuracy.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abdel-Qader, I., Abudayyeh, O., Kelly, M.E.: Analysis of edge-detection techniques for crack identification in bridges. J. Comput. Civil Eng. 17(4), 255–263 (2013)CrossRef Abdel-Qader, I., Abudayyeh, O., Kelly, M.E.: Analysis of edge-detection techniques for crack identification in bridges. J. Comput. Civil Eng. 17(4), 255–263 (2013)CrossRef
2.
Zurück zum Zitat Badrinarayanan, V., Kendall, A., Cipolla, R.: SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)CrossRef Badrinarayanan, V., Kendall, A., Cipolla, R.: SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)CrossRef
4.
Zurück zum Zitat Carr, T.A., Jenkins, M.D., Iglesias, M.I., Buggy, T., Morison, G.: Road crack detection using a single stage detector based deep neural network. In: 2018 IEEE Workshop on Environmental, Energy, and Structural Monitoring Systems (EESMS), pp. 1–5. IEEE (2018) Carr, T.A., Jenkins, M.D., Iglesias, M.I., Buggy, T., Morison, G.: Road crack detection using a single stage detector based deep neural network. In: 2018 IEEE Workshop on Environmental, Energy, and Structural Monitoring Systems (EESMS), pp. 1–5. IEEE (2018)
5.
Zurück zum Zitat Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 801–818 (2018) Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 801–818 (2018)
6.
Zurück zum Zitat Chen, T., et al.: Pavement crack detection and recognition using the architecture of SegNet. J. Ind. Inf. Integr. 18, 100144 (2020) Chen, T., et al.: Pavement crack detection and recognition using the architecture of SegNet. J. Ind. Inf. Integr. 18, 100144 (2020)
7.
Zurück zum Zitat Chong, W.-K., Low, S.-P.: Assessment of defects at construction and occupancy stages. J. Perform. Constr. Facil. 19(4), 283–289 (2005)CrossRef Chong, W.-K., Low, S.-P.: Assessment of defects at construction and occupancy stages. J. Perform. Constr. Facil. 19(4), 283–289 (2005)CrossRef
8.
Zurück zum Zitat Delagnes, P., Barba, D.: A markov random field for rectilinear structure extraction in pavement distress image analysis. In: Proceedings of International Conference on Image Processing, vol. 1, pp. 446–449. IEEE (1995) Delagnes, P., Barba, D.: A markov random field for rectilinear structure extraction in pavement distress image analysis. In: Proceedings of International Conference on Image Processing, vol. 1, pp. 446–449. IEEE (1995)
9.
Zurück zum Zitat Jin, T., Li, Z., Ding, Y., Ma, S., Ou, Y.: Bridge crack library. In: Harvard Dataverse (2021) Jin, T., Li, Z., Ding, Y., Ma, S., Ou, Y.: Bridge crack library. In: Harvard Dataverse (2021)
10.
Zurück zum Zitat Jin, X., et al.: Development of nanomodified self-healing mortar and a u-net model based on semantic segmentation for crack detection and evaluation. Construct. Build. Mater. 365, 129985 (2023) Jin, X., et al.: Development of nanomodified self-healing mortar and a u-net model based on semantic segmentation for crack detection and evaluation. Construct. Build. Mater. 365, 129985 (2023)
11.
Zurück zum Zitat Lei, B., Wang, N., Pengcheng, X., Song, G.: New crack detection method for bridge inspection using UAV incorporating image processing. J. Aerosp. Eng. 31(5), 04018058 (2018)CrossRef Lei, B., Wang, N., Pengcheng, X., Song, G.: New crack detection method for bridge inspection using UAV incorporating image processing. J. Aerosp. Eng. 31(5), 04018058 (2018)CrossRef
12.
Zurück zum Zitat Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015) Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)
13.
Zurück zum Zitat Munawar, H.S., Hammad, A.W.A., Haddad, A., Pereira Soares, C.A., Waller, S.T.: Image-based crack detection methods: a review. Infrastructures 6(8), 115 (2021) Munawar, H.S., Hammad, A.W.A., Haddad, A., Pereira Soares, C.A., Waller, S.T.: Image-based crack detection methods: a review. Infrastructures 6(8), 115 (2021)
14.
Zurück zum Zitat Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9(1), 62–66 (1979)CrossRef Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9(1), 62–66 (1979)CrossRef
15.
Zurück zum Zitat Qin, Y., Dong, S., Pang, R., Xia, Z., Zhou, Q., Yang, J.: Design and kinematic analysis of a wall-climbing robot for bridge appearance inspection. In: IOP Conference Series: Earth and Environmental Science, vol. 638, 012062. IOP Publishing (2021) Qin, Y., Dong, S., Pang, R., Xia, Z., Zhou, Q., Yang, J.: Design and kinematic analysis of a wall-climbing robot for bridge appearance inspection. In: IOP Conference Series: Earth and Environmental Science, vol. 638, 012062. IOP Publishing (2021)
18.
Zurück zum Zitat Woo, S., et al.: ConvNeXt V2: co-designing and scaling convnets with masked autoencoders. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 16133–16142 (2023) Woo, S., et al.: ConvNeXt V2: co-designing and scaling convnets with masked autoencoders. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 16133–16142 (2023)
19.
Zurück zum Zitat Xu, X., Nguyen, M.C., Yazici, Y., Lu, K., Min, H., Foo, C.-S.: Semi-supervised curvilinear structure segmentation. Semicurv. IEEE Trans. Image Process. 31, 5109–5120 (2022) Xu, X., Nguyen, M.C., Yazici, Y., Lu, K., Min, H., Foo, C.-S.: Semi-supervised curvilinear structure segmentation. Semicurv. IEEE Trans. Image Process. 31, 5109–5120 (2022)
20.
Zurück zum Zitat Yamaguchi, T., Nakamura, S., Saegusa, R., Hashimoto, S.: Image-based crack detection for real concrete surfaces. IEEJ Trans. Electr. Electron. Eng. 3(1), 128–135 (2008)CrossRef Yamaguchi, T., Nakamura, S., Saegusa, R., Hashimoto, S.: Image-based crack detection for real concrete surfaces. IEEJ Trans. Electr. Electron. Eng. 3(1), 128–135 (2008)CrossRef
21.
Zurück zum Zitat Yang, F., Zhang, L., Sijia, Yu., Prokhorov, D., Mei, X., Ling, H.: Feature pyramid and hierarchical boosting network for pavement crack detection. IEEE Trans. Intell. Transp. Syst. 21(4), 1525–1535 (2019)CrossRef Yang, F., Zhang, L., Sijia, Yu., Prokhorov, D., Mei, X., Ling, H.: Feature pyramid and hierarchical boosting network for pavement crack detection. IEEE Trans. Intell. Transp. Syst. 21(4), 1525–1535 (2019)CrossRef
22.
Zurück zum Zitat Zhang, J., Qian, S., Tan, C.: Automated bridge crack detection method based on lightweight vision models. Complex Intell. Syst. 9(2), 1639–1652 (2023)CrossRef Zhang, J., Qian, S., Tan, C.: Automated bridge crack detection method based on lightweight vision models. Complex Intell. Syst. 9(2), 1639–1652 (2023)CrossRef
23.
Zurück zum Zitat Zheng, Y., Gao, Y., Lu, S., Mosalam, K.M.: Multistage semisupervised active learning framework for crack identification, segmentation, and measurement of bridges. Comput.-Aided Civil Infrastruct. Eng. 37(9), 1089–1108 (2022) Zheng, Y., Gao, Y., Lu, S., Mosalam, K.M.: Multistage semisupervised active learning framework for crack identification, segmentation, and measurement of bridges. Comput.-Aided Civil Infrastruct. Eng. 37(9), 1089–1108 (2022)
Metadaten
Titel
A Novel SegNet Model for Crack Image Semantic Segmentation in Bridge Inspection
verfasst von
Rong Pang
Hao Tan
Yan Yang
Xun Xu
Nanqing Liu
Peng Zhang
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2259-4_26

Premium Partner