Skip to main content

2024 | OriginalPaper | Buchkapitel

Interpreting Node Embedding Distances Through n-Order Proximity Neighbourhoods

verfasst von : Dougal Shakespeare, Camille Roth

Erschienen in: Complex Networks XV

Verlag: Springer Nature Switzerland

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In the field of node representation learning the task of interpreting latent dimensions has become a prominent, well-studied research topic. The contribution of this work focuses on appraising the interpretability of another rarely-exploited feature of node embeddings increasingly utilised in recommendation and consumption diversity studies: inter-node embedded distances. Introducing a new method to measure how understandable the distances between nodes are, our work assesses how well the proximity weights derived from a network before embedding relate to the node closeness measurements after embedding. Testing several classical node embedding models, our findings reach a conclusion familiar to practitioners albeit rarely cited in literature—the matrix factorisation model SVD is the most interpretable through 1, 2 and even higher-order proximities.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Afchar, D., Hennequin, R., Guigue, V.: Of spiky SVDs and music recommendation. In: Proceeding of the 17th RecSys ACM Conference on Recommender Systems, pp. 926–932 (2023) Afchar, D., Hennequin, R., Guigue, V.: Of spiky SVDs and music recommendation. In: Proceeding of the 17th RecSys ACM Conference on Recommender Systems, pp. 926–932 (2023)
2.
Zurück zum Zitat Anderson, A., Maystre, L., Anderson, I., Mehrotra, R., Lalmas, M.: Algorithmic effects on the diversity of consumption on spotify. In: Proceedings of The Web Conference 2020, pp. 2155–2165. WWW ’20, Association for Computing Machinery, New York, NY, USA (2020) Anderson, A., Maystre, L., Anderson, I., Mehrotra, R., Lalmas, M.: Algorithmic effects on the diversity of consumption on spotify. In: Proceedings of The Web Conference 2020, pp. 2155–2165. WWW ’20, Association for Computing Machinery, New York, NY, USA (2020)
4.
Zurück zum Zitat Caselles-Dupré, H., Lesaint, F., Royo-Letelier, J.: Word2vec applied to recommendation: hyperparameters matter. In: Proceedings of the 12th ACM Conference on Recommender Systems RecSys’18, pp. 352–356 (2018) Caselles-Dupré, H., Lesaint, F., Royo-Letelier, J.: Word2vec applied to recommendation: hyperparameters matter. In: Proceedings of the 12th ACM Conference on Recommender Systems RecSys’18, pp. 352–356 (2018)
5.
Zurück zum Zitat Dalmia, A., Gupta, M.: Towards interpretation of node embeddings. In: Companion Proceedings of the The Web Conference 2018, pp. 945–952 (2018) Dalmia, A., Gupta, M.: Towards interpretation of node embeddings. In: Companion Proceedings of the The Web Conference 2018, pp. 945–952 (2018)
6.
Zurück zum Zitat Gogoglou, A., Bruss, C.B., Hines, K.E.: On the interpretability and evaluation of graph representation learning (2019). arXiv:1910.03081 Gogoglou, A., Bruss, C.B., Hines, K.E.: On the interpretability and evaluation of graph representation learning (2019). arXiv:​1910.​03081
7.
Zurück zum Zitat Goyal, P., Ferrara, E.: Gem: a python package for graph embedding methods. J. Open Sour. Soft. 3(29), 876 (2018)CrossRef Goyal, P., Ferrara, E.: Gem: a python package for graph embedding methods. J. Open Sour. Soft. 3(29), 876 (2018)CrossRef
8.
Zurück zum Zitat Goyal, P., Ferrara, E.: Graph embedding techniques, applications, and performance: a survey. Knowl.-Based Syst. 151, 78–94 (2018)CrossRef Goyal, P., Ferrara, E.: Graph embedding techniques, applications, and performance: a survey. Knowl.-Based Syst. 151, 78–94 (2018)CrossRef
9.
Zurück zum Zitat Grover, A., Leskovec, J.: Node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 855–864. Association for Computing Machinery, New York, NY, USA (2016) Grover, A., Leskovec, J.: Node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 855–864. Association for Computing Machinery, New York, NY, USA (2016)
10.
Zurück zum Zitat Han, H., Li, W., Wang, J., Qin, G., Qin, X.: Enhance explainability of manifold learning. Neurocomputing 500, 877–895 (2022)CrossRef Han, H., Li, W., Wang, J., Qin, G., Qin, X.: Enhance explainability of manifold learning. Neurocomputing 500, 877–895 (2022)CrossRef
11.
Zurück zum Zitat Jin, J., Heimann, M., Jin, D., Koutra, D.: Towards understanding and evaluating structural node embeddings (2021) Jin, J., Heimann, M., Jin, D., Koutra, D.: Towards understanding and evaluating structural node embeddings (2021)
12.
Zurück zum Zitat Lapesa, G., Evert, S., Schulte im Walde, S.: Contrasting syntagmatic and paradigmatic relations: insights from distributional semantic models. In: Proceedings of the Third Joint Conference on Lexical and Computational Semantics (*SEM 2014), pp. 160–170. Association for Computational Linguistics and Dublin City University, Dublin, Ireland (2014) Lapesa, G., Evert, S., Schulte im Walde, S.: Contrasting syntagmatic and paradigmatic relations: insights from distributional semantic models. In: Proceedings of the Third Joint Conference on Lexical and Computational Semantics (*SEM 2014), pp. 160–170. Association for Computational Linguistics and Dublin City University, Dublin, Ireland (2014)
13.
Zurück zum Zitat Liu, N., Huang, X., Li, J., Hu, X.: On interpretation of network embedding via taxonomy induction. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 1812–1820 (2018) Liu, N., Huang, X., Li, J., Hu, X.: On interpretation of network embedding via taxonomy induction. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 1812–1820 (2018)
14.
Zurück zum Zitat Lorrain, F., White, H.C.: Structural equivalence of individuals in social networks. J. Math. Sociol. 1(1), 49–80 (1971)CrossRef Lorrain, F., White, H.C.: Structural equivalence of individuals in social networks. J. Math. Sociol. 1(1), 49–80 (1971)CrossRef
15.
Zurück zum Zitat McFee, B., Lanckriet, G.R.: The natural language of playlists. In: ISMIR, vol. 11, pp. 537–541 (2011) McFee, B., Lanckriet, G.R.: The natural language of playlists. In: ISMIR, vol. 11, pp. 537–541 (2011)
16.
Zurück zum Zitat Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. In: Bengio, Y., LeCun, Y. (eds.) 1st International Conference on Learning Representations, ICLR 2013, Scottsdale, Ariz., USA, May 2–4 (2013) Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. In: Bengio, Y., LeCun, Y. (eds.) 1st International Conference on Learning Representations, ICLR 2013, Scottsdale, Ariz., USA, May 2–4 (2013)
17.
Zurück zum Zitat Musto, C., Semeraro, G., Degemmis, M., Lops, P.: Word embedding techniques for content-based recommender systems: an empirical evaluation. In: RecSys Posters, vol. 1441 (2015) Musto, C., Semeraro, G., Degemmis, M., Lops, P.: Word embedding techniques for content-based recommender systems: an empirical evaluation. In: RecSys Posters, vol. 1441 (2015)
19.
Zurück zum Zitat Papreja, P., Venkateswara, H., Panchanathan, S.: Representation, exploration and recommendation of playlists. In: Cellier, P., Driessens, K. (eds.) Machine Learning and Knowledge Discovery in Databases - International Workshops of ECML PKDD 2019, pp. 543–550. Springer, Switzerland (2020) Papreja, P., Venkateswara, H., Panchanathan, S.: Representation, exploration and recommendation of playlists. In: Cellier, P., Driessens, K. (eds.) Machine Learning and Knowledge Discovery in Databases - International Workshops of ECML PKDD 2019, pp. 543–550. Springer, Switzerland (2020)
20.
Zurück zum Zitat Park, H.: Providing post-hoc explanation for node representation learning models through inductive conformal predictions. IEEE Access 11, 1202–1212 (2022)CrossRef Park, H.: Providing post-hoc explanation for node representation learning models through inductive conformal predictions. IEEE Access 11, 1202–1212 (2022)CrossRef
21.
Zurück zum Zitat Perozzi, B., Al-Rfou, R., Skiena, S.: Deepwalk: Online learning of social representations. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge discovery and data mining, pp. 701–710 (2014) Perozzi, B., Al-Rfou, R., Skiena, S.: Deepwalk: Online learning of social representations. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge discovery and data mining, pp. 701–710 (2014)
22.
Zurück zum Zitat Piaggesi, S., Khosla, M., Panisson, A., Anand, A.: Dine: dimensional interpretability of node embeddings (2023). arXiv:2310.01162 Piaggesi, S., Khosla, M., Panisson, A., Anand, A.: Dine: dimensional interpretability of node embeddings (2023). arXiv:​2310.​01162
23.
Zurück zum Zitat Rossi, R.A., Ahmed, N.K.: Role discovery in networks. IEEE Trans. Knowl. Data Eng. 27(4), 1112–1131 (2015) Rossi, R.A., Ahmed, N.K.: Role discovery in networks. IEEE Trans. Knowl. Data Eng. 27(4), 1112–1131 (2015)
24.
Zurück zum Zitat Sahlgren, M.: The Word-Space Model: using distributional analysis to represent syntagmatic and paradigmatic relations between words in high-dimensional vector spaces. Ph.D. thesis, Institutionen för lingvistik (2006) Sahlgren, M.: The Word-Space Model: using distributional analysis to represent syntagmatic and paradigmatic relations between words in high-dimensional vector spaces. Ph.D. thesis, Institutionen för lingvistik (2006)
25.
Zurück zum Zitat Schlechtweg, D., Oguz, C., Schulte im Walde, S.: Second-order co-occurrence sensitivity of skip-gram with negative sampling. In: Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, pp. 24–30. Association for Computational Linguistics, Florence, Italy (2019) Schlechtweg, D., Oguz, C., Schulte im Walde, S.: Second-order co-occurrence sensitivity of skip-gram with negative sampling. In: Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, pp. 24–30. Association for Computational Linguistics, Florence, Italy (2019)
26.
Zurück zum Zitat Scholkemper, M., Schaub, M.T.: Local, global and scale-dependent node roles. In: 2021 IEEE International Conference on Autonomous Systems (ICAS), pp. 1–5 (2021) Scholkemper, M., Schaub, M.T.: Local, global and scale-dependent node roles. In: 2021 IEEE International Conference on Autonomous Systems (ICAS), pp. 1–5 (2021)
27.
Zurück zum Zitat Villermet, Q., Poiroux, J., Moussallam, M., Louail, T., Roth, C.: Follow the guides: disentangling human and algorithmic curation in online music consumption. In: Proceedings of the 15th ACM Conference on Recommender Systems, pp. 380–389 (2021) Villermet, Q., Poiroux, J., Moussallam, M., Louail, T., Roth, C.: Follow the guides: disentangling human and algorithmic curation in online music consumption. In: Proceedings of the 15th ACM Conference on Recommender Systems, pp. 380–389 (2021)
28.
Zurück zum Zitat Waller, I., Anderson, A.: Generalists and specialists: Using community embeddings to quantify activity diversity in online platforms. In: Proceedings of The Web Conference 2019, pp. 1954–1964. WWW ’19, Association for Computing Machinery, New York, NY, USA (2019) Waller, I., Anderson, A.: Generalists and specialists: Using community embeddings to quantify activity diversity in online platforms. In: Proceedings of The Web Conference 2019, pp. 1954–1964. WWW ’19, Association for Computing Machinery, New York, NY, USA (2019)
29.
Zurück zum Zitat Wang, D., Cui, P., Zhu, W.: Structural deep network embedding. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1225–1234. Association for Computing Machinery, New York (2016) Wang, D., Cui, P., Zhu, W.: Structural deep network embedding. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1225–1234. Association for Computing Machinery, New York (2016)
Metadaten
Titel
Interpreting Node Embedding Distances Through n-Order Proximity Neighbourhoods
verfasst von
Dougal Shakespeare
Camille Roth
Copyright-Jahr
2024
DOI
https://doi.org/10.1007/978-3-031-57515-0_14

Premium Partner