Simulating heterogeneous user behaviors to interact with conversational interfaces
Abstract Research in techniques to simulate users has a long history within the fields of language processing, speech technologies and conversational interfaces. In this paper, we describe a technique to develop heterogeneous user models that are able to interact with this kind of interfaces. By means of simulated users, it is possible not only to automatically evaluate the overall operation of a conversational interface, but also to assess the impact of the user responses on the decisions that are selected by the system. The selection of the user responses by the simulated user are based on a statistical model that considers the complete history of the interaction to carry out this selection. We describe this technique and its practical application to measure the influence of the most important user's features characteristics that affect the interaction of the simulated user with the a conversational interface.
- Referencias
- Cómo citar
- Del mismo autor
- Métricas
Bishop, C. M., 1995. Neural networks for pattern recognition. Oxford University Press.
Chung, G., 2004. Developing a flexible spoken dialog system using simulation. In Proc. of 42nd Annual Meeting of the Association for Computational Linguistics (ACL'04), pages 63–70. Barcelona, Spain. https://doi.org/10.3115/1218955.1218964
Cuayáhuitl, H., Renals, S., Lemon, O., and Shimodaira, H., 2005. Human-Computer Dialogue Simulation Using. https://doi.org/10.1109/asru.2005.1566485
Dutoit, T., 1996. An introduction to text-to-speech synthesis. Kluwer Academic Publishers.
Eckert, W., Levin, E., and Pieraccini, R., 1997. User modeling for spoken dialogue system evaluation. In Proc. of IEEE Automatic Speech Recognition and Understanding Workshop (ASRU'97), pages 80–87. Santa Barbara. https://doi.org/10.1109/asru.1997.658991
Eckert, W., Levin, E., and Pieraccini, R., 1998. Automatic evaluation of spoken dialogue systems. Technical
García, F., Hurtado, L., Sanchis, E., and Segarra, E., 2003. The incorporation of Confidence Measures to Language Understanding. Lecture Notes in Computer Science, 2807:165–172. https://doi.org/10.1007/978-3-540-39398-6_24
Georgila, K., Henderson, J., and Lemon, O., 2005. Learning user simulations for information state update dialogue systems. In Proc. of European Conference on Speech Communications and Technology (Eurospeech'05), pages 893–896. Lisbon, Portugal.
Griol, D., Callejas, Z., López-Cózar, R., and Riccardi, G., 2014. A domain-independent statistical methodology for dialog management in spoken dialog systems. Computer, Speech and Language, 28(3):743–768. https://doi.org/10.1016/j.csl.2013.09.002
Griol, D. and Molina, J., 2015. Modeling Users Emotional State for an Enhanced Human-Machine Interaction. https://doi.org/10.1007/978-3-319-19644-2_30
Wu, W.-L., Lu, R.-Z., Duan, J.-Y., Liu, H., Gao, F., and Chen, Y.-Q., 2010. Spoken language understanding using weakly supervised learning. Computer Speech & Language, 24(2):358–382. https://doi.org/10.1016/j.csl.2009.05.002
Chung, G., 2004. Developing a flexible spoken dialog system using simulation. In Proc. of 42nd Annual Meeting of the Association for Computational Linguistics (ACL'04), pages 63–70. Barcelona, Spain. https://doi.org/10.3115/1218955.1218964
Cuayáhuitl, H., Renals, S., Lemon, O., and Shimodaira, H., 2005. Human-Computer Dialogue Simulation Using. https://doi.org/10.1109/asru.2005.1566485
Dutoit, T., 1996. An introduction to text-to-speech synthesis. Kluwer Academic Publishers.
Eckert, W., Levin, E., and Pieraccini, R., 1997. User modeling for spoken dialogue system evaluation. In Proc. of IEEE Automatic Speech Recognition and Understanding Workshop (ASRU'97), pages 80–87. Santa Barbara. https://doi.org/10.1109/asru.1997.658991
Eckert, W., Levin, E., and Pieraccini, R., 1998. Automatic evaluation of spoken dialogue systems. Technical
García, F., Hurtado, L., Sanchis, E., and Segarra, E., 2003. The incorporation of Confidence Measures to Language Understanding. Lecture Notes in Computer Science, 2807:165–172. https://doi.org/10.1007/978-3-540-39398-6_24
Georgila, K., Henderson, J., and Lemon, O., 2005. Learning user simulations for information state update dialogue systems. In Proc. of European Conference on Speech Communications and Technology (Eurospeech'05), pages 893–896. Lisbon, Portugal.
Griol, D., Callejas, Z., López-Cózar, R., and Riccardi, G., 2014. A domain-independent statistical methodology for dialog management in spoken dialog systems. Computer, Speech and Language, 28(3):743–768. https://doi.org/10.1016/j.csl.2013.09.002
Griol, D. and Molina, J., 2015. Modeling Users Emotional State for an Enhanced Human-Machine Interaction. https://doi.org/10.1007/978-3-319-19644-2_30
Wu, W.-L., Lu, R.-Z., Duan, J.-Y., Liu, H., Gao, F., and Chen, Y.-Q., 2010. Spoken language understanding using weakly supervised learning. Computer Speech & Language, 24(2):358–382. https://doi.org/10.1016/j.csl.2009.05.002
Griol, D., & Molina, J. M. (2016). Simulating heterogeneous user behaviors to interact with conversational interfaces. ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal, 5(4), 59–69. https://doi.org/10.14201/ADCAIJ2016545969
Most read articles by the same author(s)
- David Griol, Jose Manuel Molina, Araceli Sanchís De Miguel, Developing multimodal conversational agents for an enhanced e-learning experience , ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal: Vol. 3 No. 1 (2014)
- David Griol, José Molina, Measuring the differences between human-human and human-machine dialogs , ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal: Vol. 4 No. 2 (2015)
- Ana Cristina Bicharra, Nayat Sanchez-Pi, Luis Correia, José Manuel Molina, Multi-agent simulations for emergency situations in an airport scenario , ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal: Vol. 1 No. 3 (2012)
- David Griol, Jose M. Molina, A proposal to manage multi-task dialogs in conversational interfaces , ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal: Vol. 5 No. 2 (2016)
- David Griol, Jose Manuel Molina, From VoiceXML to multimodal mobile Apps: development of practical conversational interfaces , ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal: Vol. 5 No. 3 (2016)
- David Griol, Jesús García-Herrero, José Manuel Molina, Combining heterogeneous inputs for the development of adaptive and multimodal interaction systems , ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal: Vol. 2 No. 3 (2013)
Downloads
Download data is not yet available.
+
−