Skip to main content

2024 | OriginalPaper | Buchkapitel

Exploiting Adaptive Contextual Masking for Aspect-Based Sentiment Analysis

verfasst von : S. M. Rafiuddin, Mohammed Rakib, Sadia Kamal, Arunkumar Bagavathi

Erschienen in: Advances in Knowledge Discovery and Data Mining

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Aspect-Based Sentiment Analysis (ABSA) is a fine-grained linguistics problem that entails the extraction of multifaceted aspects, opinions, and sentiments from the given text. Both standalone and compound ABSA tasks have been extensively used in the literature to examine the nuanced information present in online reviews and social media posts. Current ABSA methods often rely on static hyperparameters for attention-masking mechanisms, which can struggle with context adaptation and may overlook the unique relevance of words in varied situations. This leads to challenges in accurately analyzing complex sentences containing multiple aspects with differing sentiments. In this work, we present adaptive masking methods that remove irrelevant tokens based on context to assist in Aspect Term Extraction and Aspect Sentiment Classification subtasks of ABSA. We show with our experiments that the proposed methods outperform the baseline methods in terms of accuracy and F1 scores on four benchmark online review datasets. Further, we show that the proposed methods can be extended with multiple adaptations and demonstrate a qualitative analysis of the proposed approach using sample text for aspect term extraction.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Chen, Y., Keming, C., Sun, X., Zhang, Z.: A span-level bidirectional network for aspect sentiment triplet extraction. In: EMNLP, pp. 4300–4309. ACL (2022) Chen, Y., Keming, C., Sun, X., Zhang, Z.: A span-level bidirectional network for aspect sentiment triplet extraction. In: EMNLP, pp. 4300–4309. ACL (2022)
2.
Zurück zum Zitat Chen, Z., Qian, T.: Enhancing aspect term extraction with soft prototypes. In: EMNLP, pp. 2107–2117. ACL (2020) Chen, Z., Qian, T.: Enhancing aspect term extraction with soft prototypes. In: EMNLP, pp. 2107–2117. ACL (2020)
3.
Zurück zum Zitat Feng, A., Zhang, X., Song, X.: Unrestricted attention may not be all you need-masked attention mechanism focuses better on relevant parts in aspect-based sentiment analysis. IEEE Access 10, 8518–8528 (2022)CrossRef Feng, A., Zhang, X., Song, X.: Unrestricted attention may not be all you need-masked attention mechanism focuses better on relevant parts in aspect-based sentiment analysis. IEEE Access 10, 8518–8528 (2022)CrossRef
4.
Zurück zum Zitat He, R., Lee, W.S., Ng, H.T., Dahlmeier, D.: An interactive multi-task learning network for end-to-end aspect-based sentiment analysis. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 504–515 (2019) He, R., Lee, W.S., Ng, H.T., Dahlmeier, D.: An interactive multi-task learning network for end-to-end aspect-based sentiment analysis. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 504–515 (2019)
5.
Zurück zum Zitat Kenton, J.D.M.W.C., Toutanova, L.K.: Bert: pre-training of deep bidirectional transformers for language understanding. In: NAACL, pp. 4171–4186 (2019) Kenton, J.D.M.W.C., Toutanova, L.K.: Bert: pre-training of deep bidirectional transformers for language understanding. In: NAACL, pp. 4171–4186 (2019)
6.
Zurück zum Zitat Li, J., Zhao, Y., Jin, Z., Li, G., Shen, T., Tao, Z., Tao, C.: Sk2: Integrating Implicit Sentiment Knowledge and Explicit Syntax Knowledge for Aspect-based Sentiment Analysis, CIKM 2022, pp. 1114-1123. ACM (2022) Li, J., Zhao, Y., Jin, Z., Li, G., Shen, T., Tao, Z., Tao, C.: Sk2: Integrating Implicit Sentiment Knowledge and Explicit Syntax Knowledge for Aspect-based Sentiment Analysis, CIKM 2022, pp. 1114-1123. ACM (2022)
7.
Zurück zum Zitat Lin, T., Joe, I.: An adaptive masked attention mechanism to act on the local text in a global context for aspect-based sentiment analysis. IEEE Access, 43055–43066 (2023) Lin, T., Joe, I.: An adaptive masked attention mechanism to act on the local text in a global context for aspect-based sentiment analysis. IEEE Access, 43055–43066 (2023)
9.
Zurück zum Zitat Liu, P., Joty, S., Meng, H.: Fine-grained opinion mining with recurrent neural networks and word embeddings. In: EMNLP, pp. 1433–1443 (2015) Liu, P., Joty, S., Meng, H.: Fine-grained opinion mining with recurrent neural networks and word embeddings. In: EMNLP, pp. 1433–1443 (2015)
10.
Zurück zum Zitat Mao, Y., Shen, Y., Yu, C., Cai, L.: A joint training dual-mrc framework for aspect based sentiment analysis. In: AAAI, vol. 35, pp. 13543–13551 (2021) Mao, Y., Shen, Y., Yu, C., Cai, L.: A joint training dual-mrc framework for aspect based sentiment analysis. In: AAAI, vol. 35, pp. 13543–13551 (2021)
11.
Zurück zum Zitat Phan, M.H., Ogunbona, P.O.: Modelling context and syntactical features for aspect-based sentiment analysis. In: Jurafsky, D., Chai, J., Schluter, N., Tetreault, J. (eds.) ACL, pp. 3211–3220 (Jul 2020) Phan, M.H., Ogunbona, P.O.: Modelling context and syntactical features for aspect-based sentiment analysis. In: Jurafsky, D., Chai, J., Schluter, N., Tetreault, J. (eds.) ACL, pp. 3211–3220 (Jul 2020)
12.
Zurück zum Zitat Sukhbaatar, S., Grave, É., Bojanowski, P., Joulin, A.: Adaptive attention span in transformers. In: ACL, pp. 331–335 (2019) Sukhbaatar, S., Grave, É., Bojanowski, P., Joulin, A.: Adaptive attention span in transformers. In: ACL, pp. 331–335 (2019)
13.
Zurück zum Zitat Tian, Y., Chen, G., Song, Y.: Aspect-based sentiment analysis with type-aware graph convolutional networks and layer ensemble. In: NAACL, pp. 2910–2922 (2021) Tian, Y., Chen, G., Song, Y.: Aspect-based sentiment analysis with type-aware graph convolutional networks and layer ensemble. In: NAACL, pp. 2910–2922 (2021)
14.
Zurück zum Zitat Vaswani, A., et al.: Attention is all you need. Adv. Neural Inform. Proc. Syst. 30 (2017) Vaswani, A., et al.: Attention is all you need. Adv. Neural Inform. Proc. Syst. 30 (2017)
15.
Zurück zum Zitat Wu, S., Fei, H., Ren, Y., Ji, D., Li, J.: Learn from syntax: improving pair-wise aspect and opinion terms extraction with rich syntactic knowledge. In: Zhou, Z.H. (ed.) Proceedings of IJCAI, pp. 3957–3963 (8 2021) Wu, S., Fei, H., Ren, Y., Ji, D., Li, J.: Learn from syntax: improving pair-wise aspect and opinion terms extraction with rich syntactic knowledge. In: Zhou, Z.H. (ed.) Proceedings of IJCAI, pp. 3957–3963 (8 2021)
16.
Zurück zum Zitat Xiao, L., et al.: Multi-head self-attention based gated graph convolutional networks for aspect-based sentiment classification. Multimedia Tools Appli., 1–20 (2022) Xiao, L., et al.: Multi-head self-attention based gated graph convolutional networks for aspect-based sentiment classification. Multimedia Tools Appli., 1–20 (2022)
17.
Zurück zum Zitat Xiao, Y., et al.: Amom: adaptive masking over masking for conditional masked language model. In: AAAI, vol. 37, pp. 13789–13797 (2023) Xiao, Y., et al.: Amom: adaptive masking over masking for conditional masked language model. In: AAAI, vol. 37, pp. 13789–13797 (2023)
18.
Zurück zum Zitat Xu, L., Chia, Y.K., Bing, L.: Learning span-level interactions for aspect sentiment triplet extraction. In: Zong, C., Xia, F., Li, W., Navigli, R. (eds.) ACL, pp. 4755–4766 (Aug 2021) Xu, L., Chia, Y.K., Bing, L.: Learning span-level interactions for aspect sentiment triplet extraction. In: Zong, C., Xia, F., Li, W., Navigli, R. (eds.) ACL, pp. 4755–4766 (Aug 2021)
19.
Zurück zum Zitat Yan, H., Dai, J., Ji, T., Qiu, X., Zhang, Z.: A unified generative framework for aspect-based sentiment analysis. In: Zong, C., Xia, F., Li, W., Navigli, R. (eds.) ACL, pp. 2416–2429 (Aug 2021) Yan, H., Dai, J., Ji, T., Qiu, X., Zhang, Z.: A unified generative framework for aspect-based sentiment analysis. In: Zong, C., Xia, F., Li, W., Navigli, R. (eds.) ACL, pp. 2416–2429 (Aug 2021)
21.
Zurück zum Zitat Zeng, B., Yang, H., Xu, R., Zhou, W., Han, X.: Lcf: a local context focus mechanism for aspect-based sentiment classification. Appl. Sci. 9(16), 3389 (2019)CrossRef Zeng, B., Yang, H., Xu, R., Zhou, W., Han, X.: Lcf: a local context focus mechanism for aspect-based sentiment classification. Appl. Sci. 9(16), 3389 (2019)CrossRef
22.
Zurück zum Zitat Zhang, W., Li, X., Deng, Y., Bing, L., Lam, W.: Towards generative aspect-based sentiment analysis. In: ACL, pp. 504–510 (2021) Zhang, W., Li, X., Deng, Y., Bing, L., Lam, W.: Towards generative aspect-based sentiment analysis. In: ACL, pp. 504–510 (2021)
23.
Zurück zum Zitat Zhang, W., Li, X., Deng, Y., Bing, L., Lam, W.: A survey on aspect-based sentiment analysis: tasks, methods, and challenges. IEEE TKDE., 11019–11038 (2022) Zhang, W., Li, X., Deng, Y., Bing, L., Lam, W.: A survey on aspect-based sentiment analysis: tasks, methods, and challenges. IEEE TKDE., 11019–11038 (2022)
24.
Zurück zum Zitat Zhang, Z., Zhou, Z., Wang, Y.: Syntactic and semantic enhanced graph convolutional network for aspect-based sentiment analysis. In: ACL, pp. 4916–4925 (2022) Zhang, Z., Zhou, Z., Wang, Y.: Syntactic and semantic enhanced graph convolutional network for aspect-based sentiment analysis. In: ACL, pp. 4916–4925 (2022)
Metadaten
Titel
Exploiting Adaptive Contextual Masking for Aspect-Based Sentiment Analysis
verfasst von
S. M. Rafiuddin
Mohammed Rakib
Sadia Kamal
Arunkumar Bagavathi
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2266-2_12

Premium Partner