Skip to main content

2017 | OriginalPaper | Buchkapitel

Dependency-Tree Based Convolutional Neural Networks for Aspect Term Extraction

verfasst von : Hai Ye, Zichao Yan, Zhunchen Luo, Wenhan Chao

Erschienen in: Advances in Knowledge Discovery and Data Mining

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Aspect term extraction is one of the fundamental subtasks in aspect-based sentiment analysis. Previous work has shown that sentences’ dependency information is critical and has been widely used for opinion mining. With recent success of deep learning in natural language processing (NLP), recurrent neural network (RNN) has been proposed for aspect term extraction and shows the superiority over feature-rich CRFs based models. However, because RNN is a sequential model, it can not effectively capture tree-based dependency information of sentences thus limiting its practicability. In order to effectively exploit sentences’ dependency information and leverage the effectiveness of deep learning, we propose a novel dependency-tree based convolutional stacked neural network (DTBCSNN) for aspect term extraction, in which tree-based convolution is introduced over sentences’ dependency parse trees to capture syntactic features. Our model is an end-to-end deep learning based model and it does not need any human-crafted features. Furthermore, our model is flexible to incorporate extra linguistic features to further boost the model performance. To substantiate, results from experiments on SemEval2014 Task4 datasets (reviews on restaurant and laptop domain) show that our model achieves outstanding performance and outperforms the RNN and CRF baselines.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Liu, B., Hu, M., Cheng, J.: Opinion observer: analyzing and comparing opinions on the web. In: WWW, pp. 342–351 (2005) Liu, B., Hu, M., Cheng, J.: Opinion observer: analyzing and comparing opinions on the web. In: WWW, pp. 342–351 (2005)
2.
Zurück zum Zitat Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., Kuksa, P.P.: Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12, 2493–2537 (2011)MATH Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., Kuksa, P.P.: Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12, 2493–2537 (2011)MATH
3.
Zurück zum Zitat Liu, P., Joty, S.R., Meng, H.M.: Fine-grained opinion mining with recurrent neural networks and word embeddings. In: EMNLP, pp. 1433–1443 (2015) Liu, P., Joty, S.R., Meng, H.M.: Fine-grained opinion mining with recurrent neural networks and word embeddings. In: EMNLP, pp. 1433–1443 (2015)
4.
Zurück zum Zitat Jakob, N., Gurevych, I.: Extracting opinion targets in a single and cross-domain setting with conditional random fields. In: EMNLP, pp. 1035–1045 (2010) Jakob, N., Gurevych, I.: Extracting opinion targets in a single and cross-domain setting with conditional random fields. In: EMNLP, pp. 1035–1045 (2010)
5.
Zurück zum Zitat Johansson, R., Moschitti, A.: Syntactic and semantic structure for opinion expression detection. In: CoNLL, pp. 67–76 (2010) Johansson, R., Moschitti, A.: Syntactic and semantic structure for opinion expression detection. In: CoNLL, pp. 67–76 (2010)
6.
Zurück zum Zitat Johansson, R., Moschitti, A.: Extracting opinion expressions and their polarities-exploration of pipelines and joint models. In: ACL, pp. 101–106 (2011) Johansson, R., Moschitti, A.: Extracting opinion expressions and their polarities-exploration of pipelines and joint models. In: ACL, pp. 101–106 (2011)
7.
Zurück zum Zitat Li, F., Han, C., Huang, M., Zhu, X., Xia, Y., Zhang, S., Yu, H.: Structure-aware review mining and summarization. In: COLING, pp. 653–661 (2010) Li, F., Han, C., Huang, M., Zhu, X., Xia, Y., Zhang, S., Yu, H.: Structure-aware review mining and summarization. In: COLING, pp. 653–661 (2010)
8.
Zurück zum Zitat Yin, Y., Wei, F., Dong, L., Xu, K., Zhang, M., Zhou, M.: Unsupervised word and dependency path embeddings for aspect term extraction. In: IJCAI, pp. 2979–2985 (2016) Yin, Y., Wei, F., Dong, L., Xu, K., Zhang, M., Zhou, M.: Unsupervised word and dependency path embeddings for aspect term extraction. In: IJCAI, pp. 2979–2985 (2016)
9.
Zurück zum Zitat Mou, L., Peng, H., Li, G., Xu, Y., Zhang, L., Jin, Z.: Discriminative neural sentence modeling by treebased convolution. In: EMNLP, pp. 2315–2325 (2015) Mou, L., Peng, H., Li, G., Xu, Y., Zhang, L., Jin, Z.: Discriminative neural sentence modeling by treebased convolution. In: EMNLP, pp. 2315–2325 (2015)
10.
Zurück zum Zitat Mou, L., Li, G., Zhang, L., Wang, T., Jin, Z.: Convolutional neural networks over tree structures for programming language processing. In: AAAI, pp. 1287–1293 (2016) Mou, L., Li, G., Zhang, L., Wang, T., Jin, Z.: Convolutional neural networks over tree structures for programming language processing. In: AAAI, pp. 1287–1293 (2016)
11.
Zurück zum Zitat Ma, M., Huang, L., Zhou, B., Xiang, B.: Dependency-based convolutional neural networks for sentence embedding. In: ACL, pp. 174–179 (2015) Ma, M., Huang, L., Zhou, B., Xiang, B.: Dependency-based convolutional neural networks for sentence embedding. In: ACL, pp. 174–179 (2015)
12.
Zurück zum Zitat Hu, M., Liu, B.: Mining and summarizing customer reviews. In: KDD, pp. 168–177 (2004) Hu, M., Liu, B.: Mining and summarizing customer reviews. In: KDD, pp. 168–177 (2004)
13.
Zurück zum Zitat Qiu, G., Liu, B., Bu, J., Chen, C.: Opinion word expansion and target extraction through double propagation. Comput. Linguist. 37(1), 9–27 (2011)CrossRef Qiu, G., Liu, B., Bu, J., Chen, C.: Opinion word expansion and target extraction through double propagation. Comput. Linguist. 37(1), 9–27 (2011)CrossRef
14.
Zurück zum Zitat Jin, W., Ho, H.H.: A novel lexicalized hmm-based learning framework for web opinion mining. In: ICML, pp. 465–472. ACM (2009) Jin, W., Ho, H.H.: A novel lexicalized hmm-based learning framework for web opinion mining. In: ICML, pp. 465–472. ACM (2009)
15.
Zurück zum Zitat Yang, B., Cardie, C.: Extracting opinion expressions with semi-Markov conditional random fields. In: EMNLP, pp. 1335–1345 (2012) Yang, B., Cardie, C.: Extracting opinion expressions with semi-Markov conditional random fields. In: EMNLP, pp. 1335–1345 (2012)
16.
Zurück zum Zitat Toh, Z., Wang, W.: DLIREC: aspect term extraction and term polarity classification system. In: SemEval, pp. 235–240 (2014) Toh, Z., Wang, W.: DLIREC: aspect term extraction and term polarity classification system. In: SemEval, pp. 235–240 (2014)
17.
Zurück zum Zitat Chernyshevich, M.: IHS R&D Belarus: cross-domain extraction of product features using CRF. In: SemEval, pp. 309–313 (2014) Chernyshevich, M.: IHS R&D Belarus: cross-domain extraction of product features using CRF. In: SemEval, pp. 309–313 (2014)
18.
Zurück zum Zitat Titov, I., McDonald, R.T.: Modeling online reviews with multi-grain topic models. In: WWW, pp. 111–120 (2008) Titov, I., McDonald, R.T.: Modeling online reviews with multi-grain topic models. In: WWW, pp. 111–120 (2008)
19.
Zurück zum Zitat Moghaddam, S., Ester, M.: On the design of LDA models for aspect-based opinion mining. In: CIKM, pp. 803–812 (2012) Moghaddam, S., Ester, M.: On the design of LDA models for aspect-based opinion mining. In: CIKM, pp. 803–812 (2012)
20.
Zurück zum Zitat Irsoy, O., Cardie, C.: Opinion mining with deep recurrent neural networks. In: EMNLP, pp. 720–728 (2014) Irsoy, O., Cardie, C.: Opinion mining with deep recurrent neural networks. In: EMNLP, pp. 720–728 (2014)
21.
Zurück zum Zitat Socher, R., Perelygin, A., Wu, J.Y., Chuang, J., Manning, C.D., Ng, A.Y., Potts, C.: Recursive deep models for semantic compositionality over a sentiment treebank. In: EMNLP, pp. 1631–1642 (2013) Socher, R., Perelygin, A., Wu, J.Y., Chuang, J., Manning, C.D., Ng, A.Y., Potts, C.: Recursive deep models for semantic compositionality over a sentiment treebank. In: EMNLP, pp. 1631–1642 (2013)
22.
Zurück zum Zitat Kim, Y.: Convolutional neural networks for sentence classification. In: EMNLP, pp. 1746–1751 (2014) Kim, Y.: Convolutional neural networks for sentence classification. In: EMNLP, pp. 1746–1751 (2014)
23.
Zurück zum Zitat Klein, D., Manning, C.D.: Accurate unlexicalized parsing. In: ACL, pp. 423–430 (2003) Klein, D., Manning, C.D.: Accurate unlexicalized parsing. In: ACL, pp. 423–430 (2003)
Metadaten
Titel
Dependency-Tree Based Convolutional Neural Networks for Aspect Term Extraction
verfasst von
Hai Ye
Zichao Yan
Zhunchen Luo
Wenhan Chao
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-57529-2_28

Premium Partner