Skip to main content

2024 | OriginalPaper | Buchkapitel

Random Mask Perturbation Based Explainable Method of Graph Neural Networks

verfasst von : Xinyue Yang, Hai Huang, Xingquan Zuo

Erschienen in: Advances in Knowledge Discovery and Data Mining

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Graph Neural Networks (GNNs) have garnered considerable attention due to their potential applications across multiple domains. However, enhancing their interpretability is a significant challenge for the crucial application. This paper proposes an innovative node perturbation-based method to explicate GNNs and unveil their decision-making processes. Categorized as a black-box method, it generates explanations of node importance solely through the input-output analysis of the model, obviating the necessity for internal access. The method employs fidelity as a metric for calculating the significance of perturbation masks and utilizes a sparsity threshold to filter the computation results. Furthermore, recognizing the impact of different node combinations on model prediction outcomes, we treat the mask as a random variable. By randomly sampling various masks, we compute perturbed node importance, facilitating the generation of user-friendly explanations. Comparative experiments and ablation studies conducted on both real and synthetic datasets substantiate the efficacy of our approach in interpreting GNNs. Additionally, through a case study, we visually demonstrate the method’s compelling interpretative evidence regarding model prediction outcomes.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Adadi, A., Berrada, M.: Peeking inside the black-box: a survey on explainable artificial intelligence (XAI). IEEE Access 6, 52138–52160 (2018)CrossRef Adadi, A., Berrada, M.: Peeking inside the black-box: a survey on explainable artificial intelligence (XAI). IEEE Access 6, 52138–52160 (2018)CrossRef
2.
Zurück zum Zitat Baldassarre, F., Azizpour, H.:. Explainability techniques for graph convolutional networks. arXiv preprint arXiv:1905.13686 (2019) Baldassarre, F., Azizpour, H.:. Explainability techniques for graph convolutional networks. arXiv preprint arXiv:​1905.​13686 (2019)
3.
Zurück zum Zitat Dai, E., et al.: A comprehensive survey on trustworthy graph neural networks: privacy, robustness, fairness, and explainability. arXiv preprint arXiv:2204.08570 (2022) Dai, E., et al.: A comprehensive survey on trustworthy graph neural networks: privacy, robustness, fairness, and explainability. arXiv preprint arXiv:​2204.​08570 (2022)
4.
Zurück zum Zitat Feng, Q., Liu, N., Yang, F., Tang, R., Du, M., Hu, X.: Degree: decomposition based explanation for graph neural networks. arXiv preprint arXiv:2305.12895 (2023) Feng, Q., Liu, N., Yang, F., Tang, R., Du, M., Hu, X.: Degree: decomposition based explanation for graph neural networks. arXiv preprint arXiv:​2305.​12895 (2023)
5.
Zurück zum Zitat Funke, T., Khosla, M., Rathee, M., Anand, A.: ZORRO: valid, sparse, and stable explanations in graph neural networks. IEEE Trans. Knowl. Data Eng. 35, 8687–8698 (2022) Funke, T., Khosla, M., Rathee, M., Anand, A.: ZORRO: valid, sparse, and stable explanations in graph neural networks. IEEE Trans. Knowl. Data Eng. 35, 8687–8698 (2022)
6.
Zurück zum Zitat Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., Pedreschi, D.: A survey of methods for explaining black box models. ACM Comput. Surv. (CSUR) 51(5), 1–42 (2018)CrossRef Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., Pedreschi, D.: A survey of methods for explaining black box models. ACM Comput. Surv. (CSUR) 51(5), 1–42 (2018)CrossRef
7.
Zurück zum Zitat Holdijk, L., Boon, M., Henckens, S., de Jong, L.: [re] parameterized explainer for graph neural network. In: ML Reproducibility Challenge 2020 (2021) Holdijk, L., Boon, M., Henckens, S., de Jong, L.: [re] parameterized explainer for graph neural network. In: ML Reproducibility Challenge 2020 (2021)
8.
Zurück zum Zitat Huang, Q., Yamada, M., Tian, Y., Singh, D., Chang, Y.: GraphLIME: local interpretable model explanations for graph neural networks. IEEE Trans. Knowl. Data Eng. 35, 6968–6972 (2022) Huang, Q., Yamada, M., Tian, Y., Singh, D., Chang, Y.: GraphLIME: local interpretable model explanations for graph neural networks. IEEE Trans. Knowl. Data Eng. 35, 6968–6972 (2022)
9.
Zurück zum Zitat Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016) Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:​1609.​02907 (2016)
10.
Zurück zum Zitat Lucic, A., Ter Hoeve, M.A., Tolomei, G., De Rijke, M., Silvestri, F.: CF-GNNexplainer: counterfactual explanations for graph neural networks. In: International Conference on Artificial Intelligence and Statistics, pp. 4499–4511. PMLR (2022) Lucic, A., Ter Hoeve, M.A., Tolomei, G., De Rijke, M., Silvestri, F.: CF-GNNexplainer: counterfactual explanations for graph neural networks. In: International Conference on Artificial Intelligence and Statistics, pp. 4499–4511. PMLR (2022)
11.
Zurück zum Zitat Luo, D., et al.: Parameterized explainer for graph neural network. In: Advance Neural Information Processing System, vol. 33, pp. 19620–19631 (2020) Luo, D., et al.: Parameterized explainer for graph neural network. In: Advance Neural Information Processing System, vol. 33, pp. 19620–19631 (2020)
12.
Zurück zum Zitat Petsiuk, V., Das, A., Saenko, K.: Rise: randomized input sampling for explanation of black-box models. arXiv preprint arXiv:1806.07421 (2018) Petsiuk, V., Das, A., Saenko, K.: Rise: randomized input sampling for explanation of black-box models. arXiv preprint arXiv:​1806.​07421 (2018)
13.
Zurück zum Zitat Pope, P.E., Kolouri, S., Rostami, M., Martin, C.E., Hoffmann, H.: Explainability methods for graph convolutional neural networks. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10772–10781 (2019) Pope, P.E., Kolouri, S., Rostami, M., Martin, C.E., Hoffmann, H.: Explainability methods for graph convolutional neural networks. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10772–10781 (2019)
14.
Zurück zum Zitat Schnake, T., et al.: Higher-order explanations of graph neural networks via relevant walks. IEEE Trans. Pattern Anal. Mach. Intell. 44(11), 7581–7596 (2021)CrossRef Schnake, T., et al.: Higher-order explanations of graph neural networks via relevant walks. IEEE Trans. Pattern Anal. Mach. Intell. 44(11), 7581–7596 (2021)CrossRef
15.
Zurück zum Zitat Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-CAM: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 618–626 (2017) Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-CAM: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 618–626 (2017)
16.
Zurück zum Zitat Shun, K.T.T., Limanta, E.E., Khan, A.: An evaluation of backpropagation interpretability for graph classification with deep learning. In: 2020 IEEE International Conference on Big Data (Big Data), pp. 561–570. IEEE (2020) Shun, K.T.T., Limanta, E.E., Khan, A.: An evaluation of backpropagation interpretability for graph classification with deep learning. In: 2020 IEEE International Conference on Big Data (Big Data), pp. 561–570. IEEE (2020)
17.
Zurück zum Zitat Simonyan, K., Vedaldi, A., Zisserman, A.: Deep inside convolutional networks: visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034 (2013) Simonyan, K., Vedaldi, A., Zisserman, A.: Deep inside convolutional networks: visualising image classification models and saliency maps. arXiv preprint arXiv:​1312.​6034 (2013)
18.
Zurück zum Zitat Sundararajan, M., Taly, A., Yan, Q.: Axiomatic attribution for deep networks. In: International Conference on Machine Learning, pp. 3319–3328. PMLR (2017) Sundararajan, M., Taly, A., Yan, Q.: Axiomatic attribution for deep networks. In: International Conference on Machine Learning, pp. 3319–3328. PMLR (2017)
19.
Zurück zum Zitat Vu, M., Thai, M.T.: PGM-Explainer: probabilistic graphical model explanations for graph neural networks. In: Advances in Neural Information Processing Systems, vol. 33, pp. 12225–12235 (2020) Vu, M., Thai, M.T.: PGM-Explainer: probabilistic graphical model explanations for graph neural networks. In: Advances in Neural Information Processing Systems, vol. 33, pp. 12225–12235 (2020)
20.
Zurück zum Zitat Wang, X., Wu, Y., Zhang, A., He, X., Chua, T.S.: Causal screening to interpret graph neural networks (2020) Wang, X., Wu, Y., Zhang, A., He, X., Chua, T.S.: Causal screening to interpret graph neural networks (2020)
21.
Zurück zum Zitat Xuanyuan, H., Barbiero, P., Georgiev, D., Magister, L.C., Liò, P.: Global concept based interpretability for graph neural networks via neuron analysis. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 37, pp. 10675–10683 (2023) Xuanyuan, H., Barbiero, P., Georgiev, D., Magister, L.C., Liò, P.: Global concept based interpretability for graph neural networks via neuron analysis. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 37, pp. 10675–10683 (2023)
22.
Zurück zum Zitat Ying, Z., Bourgeois, D., You, J., Zitnik, M., Leskovec, J.: GNNExplainer: generating explanations for graph neural networks. In: Advances in Neural Information Processing Systems, vol. 32 (2019) Ying, Z., Bourgeois, D., You, J., Zitnik, M., Leskovec, J.: GNNExplainer: generating explanations for graph neural networks. In: Advances in Neural Information Processing Systems, vol. 32 (2019)
23.
Zurück zum Zitat Yuan, H., Tang, J., Hu, X., Ji, S.: XGNN: towards model-level explanations of graph neural networks. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 430–438 (2020) Yuan, H., Tang, J., Hu, X., Ji, S.: XGNN: towards model-level explanations of graph neural networks. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 430–438 (2020)
24.
Zurück zum Zitat Yuan, H., Haiyang, Yu., Gui, S., Ji, S.: Explainability in graph neural networks: a taxonomic survey. IEEE Trans. Pattern Anal. Mach. Intell. 45(5), 5782–5799 (2022) Yuan, H., Haiyang, Yu., Gui, S., Ji, S.: Explainability in graph neural networks: a taxonomic survey. IEEE Trans. Pattern Anal. Mach. Intell. 45(5), 5782–5799 (2022)
25.
Zurück zum Zitat Zhang, S., Liu, Y., Shah, N., Sun, Y.: GStarX: explaining graph neural networks with structure-aware cooperative games. In: Advance Neural Information Processing System, vol. 35, pp. 19810–19823 (2022) Zhang, S., Liu, Y., Shah, N., Sun, Y.: GStarX: explaining graph neural networks with structure-aware cooperative games. In: Advance Neural Information Processing System, vol. 35, pp. 19810–19823 (2022)
Metadaten
Titel
Random Mask Perturbation Based Explainable Method of Graph Neural Networks
verfasst von
Xinyue Yang
Hai Huang
Xingquan Zuo
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2259-4_2

Premium Partner