Roger Ferrod
Luigi Di Caro
ABSTRACT
Nowadays, many companies are offering chatbots and voicebots to their customers. Despite much recent success in natural language processing and dialogue research, the communication between a human and a machine is still in its infancy. In this context, dialogue personalization could be a key to bridge some of the gap, making sense of users’ experiences, needs, interests and mental models when engaged in a conversation. On this line, we propose to automatically learn user’s features directly from the dialogue with the chatbot, in order to enable the adaptation of the response accordingly and thus improve the interaction with the user. In this paper, we focus on the user’s domain expertise and, assuming that expertise affects linguistic features of the language, we propose a vocabulary-centered model joint with a Deep Learning method for the automatic classification of the users expertise at word- and message-level. An experimentation over 5000 real messages taken from a telco commercial chatbot carried to high accuracy scores, demonstrating the feasibility of the proposed task and paving the way for novel user-aware applications.
Supplemental Material
- Timothy W Bickmore and Rosalind W Picard. 2005. Establishing and maintaining long-term human-computer relationships. ACM Transactions on Computer-Human Interaction (TOCHI) 12, 2(2005), 293–327.Google Scholar
Digital Library
- Henry Blanco and Francesco Ricci. 2013. Acquiring user profiles from implicit feedback in a conversational recommender system. In Proceedings of the 7th ACM conference on Recommender systems. 307–310.Google ScholarDigital Library
- Paulo Blikstein. 2011. Using learning analytics to assess students’ behavior in open-ended programming tasks. In Proceedings of the 1st international conference on learning analytics and knowledge. 110–116.Google ScholarDigital Library
- Piotr Bojanowski, Edouard Grave, Armand Joulin, and Tomas Mikolov. 2016. Enriching Word Vectors with Subword Information. arXiv preprint arXiv:1607.04606(2016).Google Scholar
- Lyle E Bourne Jr, James A Kole, and Alice F Healy. 2014. Expertise: defined, described, explained. Frontiers in psychology 5 (2014), 186.Google Scholar
- Peter Brusilovsky and Mark T Maybury. 2002. From adaptive hypermedia to the adaptive web. Commun. ACM 45, 5 (2002), 30–33.Google ScholarDigital Library
- Jindong Chen, Yizhou Hu, Jingping Liu, Yanghua Xiao, and Haiyun Jiang. 2019. Deep short text classification with knowledge powered attention. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 6252–6259.Google ScholarDigital Library
- Yun-Nung Chen, Dilek Hakkani-Tür, Gökhan Tür, Jianfeng Gao, and Li Deng. 2016. End-to-end memory networks with knowledge carryover for multi-turn spoken language understanding.. In Interspeech. 3245–3249.Google Scholar
- Albert T Corbett and John R Anderson. 1994. Knowledge tracing: Modeling the acquisition of procedural knowledge. User modeling and user-adapted interaction 4, 4 (1994), 253–278.Google Scholar
- Mihai Dascalu, Erol-Valeriu Chioasca, and Stefan Trausan-Matu. 2008. ASAP-An Advanced System for Assessing Chat Participants. In International Conference on Artificial Intelligence: Methodology, Systems, and Applications. Springer, 58–68.Google Scholar
- Michel C Desmarais and Ryan SJ d Baker. 2012. A review of recent advances in learner and skill modeling in intelligent learning environments. User Modeling and User-Adapted Interaction 22, 1 (2012), 9–38.Google ScholarDigital Library
- Michel C Desmarais, Ameen Maluf, and Jiming Liu. 1995. User-expertise modeling with empirically derived probabilistic implication networks. User modeling and user-adapted interaction 5, 3 (1995), 283–315.Google Scholar
- Paul J Feltovich and Robert R Hoffman. 1997. Expertise in context. AAAI Press Menlo Park, CA.Google Scholar
- Nikesh Garera and David Yarowsky. 2009. Modeling latent biographic attributes in conversational genres. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP. 710–718.Google ScholarCross Ref
- SK Garrett, Barrett S Caldwell, EC Harris, and MC Gonzalez. 2009. Six dimensions of expertise: a more comprehensive definition of cognitive expertise for team coordination. Theoretical Issues in Ergonomics Science 10, 2 (2009), 93–105.Google ScholarCross Ref
- Yasmín Hernández, Carlos Acevedo Peña, and Alicia Martínez. 2018. Model for personality detection based on text analysis. In Mexican International Conference on Artificial Intelligence. Springer, 207–217.Google ScholarDigital Library
- Zhiheng Huang, Wei Xu, and Kai Yu. 2015. Bidirectional LSTM-CRF Models for Sequence Tagging. CoRR abs/1508.01991(2015). arxiv:1508.01991http://arxiv.org/abs/1508.01991Google Scholar
- Dietmar Jannach, Ahtsham Manzoor, Wanling Cai, and Li Chen. 2020. A Survey on Conversational Recommender Systems. arXiv preprint arXiv:2004.00646(2020).Google Scholar
- Chaitanya K Joshi, Fei Mi, and Boi Faltings. 2017. Personalization in goal-oriented dialog. arXiv preprint arXiv:1706.07503(2017).Google Scholar
- A. Kobsa, J. Koenemann, and W. Pohl. 2001. Personalized hypermedia presentation techniques for improving online customer relationship. Knowl. Eng. Rev. 16(2)(2001), 111–155.Google Scholar
- François Mairesse, Marilyn A Walker, Matthias R Mehl, and Roger K Moore. 2007. Using linguistic cues for the automatic recognition of personality in conversation and text. Journal of artificial intelligence research 30 (2007), 457–500.Google ScholarDigital Library
- Lorraine McGinty and James Reilly. 2011. On the evolution of critiquing recommenders. In Recommender Systems Handbook. Springer, 419–453.Google Scholar
- Danielle S McNamara, Scott A Crossley, and Philip M McCarthy. 2010. Linguistic features of writing quality. Written communication 27, 1 (2010), 57–86.Google Scholar
- Sein Minn, Michel C Desmarais, Feida Zhu, Jing Xiao, and Jianzong Wang. 2019. Dynamic student classiffication on memory networks for knowledge tracing. In Pacific-Asia Conference on Knowledge Discovery and Data Mining. Springer, 163–174.Google ScholarDigital Library
- Kaixiang Mo, Shuangyin Li, Yu Zhang, Jiajun Li, and Qiang Yang. 2016. Personalizing a dialogue system with transfer reinforcement learning. arXiv preprint arXiv:1610.02891(2016).Google Scholar
- Lin Qiu, Han Lin, Jonathan Ramsay, and Fang Yang. 2012. You are what you tweet: Personality expression and perception on Twitter. Journal of research in personality 46, 6 (2012), 710–718.Google ScholarCross Ref
- Mehul Smriti Raje and Aakarsh Singh. 2016. Personality detection by analysis of twitter profiles. In International Conference on Soft Computing and Pattern Recognition. Springer, 667–675.Google Scholar
- Kent P Vaubel and Charles F Gettys. 1990. Inferring user expertise for adaptive interfaces. Human-Computer Interaction 5, 1 (1990), 95–117.Google ScholarDigital Library
- Yashen Wang, He-Yan Huang, Chong Feng, Qiang Zhou, Jiahui Gu, and Xiong Gao. 2016. Cse: Conceptual sentence embeddings based on attention model. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 505–515.Google ScholarCross Ref
- Yonas Woldemariam, Henrik Björklund, and Suna Bensch. 2017. Predicting User Competence from Linguistic Data. In Proceedings of the 14th International Conference on Natural Language Processing (ICON-2017). 476–484.Google Scholar
- Marcelo Worsley and Paulo Blikstein. 2011. What’s an Expert? Using Learning Analytics to Identify Emergent Markers of Expertise through Automated Speech, Sentiment and Sketch Analysis.. In EDM. 235–240.Google Scholar
- Saizheng Zhang, Emily Dinan, Jack Urbanek, Arthur Szlam, Douwe Kiela, and Jason Weston. 2018. Personalizing dialogue agents: I have a dog, do you have pets too?arXiv preprint arXiv:1801.07243(2018).Google Scholar
Recommendations
(Semi-)Automatic Analysis of Dialogues
ICAART 2014: Proceedings of the 6th International Conference on Agents and Artificial Intelligence - Volume 1We study human-human dialogues and human-computer dialogues with the aim to determine which dialogue acts and communicative strategies do the participants of interaction use, and which structural parts does a dialogue include. In order to simplify the ...
Relating initial turns of human-robot dialogues to discourse
HRI '09: Proceedings of the 4th ACM/IEEE international conference on Human robot interactionSimilarly, User models can be useful for improving dialogue management. In this paper we analyze human-robot dialogues that occur during uncontrolled interactions and estimate relations between the initial dialogue turns and patterns of discourse that ...
Eliciting and Analysing Users’ Envisioned Dialogues with Perfect Voice Assistants
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing SystemsWe present a dialogue elicitation study to assess how users envision conversations with a perfect voice assistant (VA). In an online survey, N=205 participants were prompted with everyday scenarios, and wrote the lines of both user and VA in dialogues ...
Comments