Name
Abstract | ||
|---|---|---|
A chatbot is a software that interacts with humans by conducting conversations via textual or auditory methods. Chatbots have recently been used for plethora of applications including travel, medical, education, retail etc. Several cloud-based platforms (e.g. IBM, Amazon, Google, Microsoft) are available for developing and deploying chatbots. However, there is a lack of an evaluation methodology and a tool for evaluating chatbots comprehensively. Current approaches for comparing cloud-based chatbots are manual and rely on expert’s judgement. In this short paper, we propose, devise, implement and demonstrate a tool namely ECHO for empirical evaluation of cloud-based chatbots. ECHO is capable of automatically evaluating multiple cloud-based chatbots and report the outcomes of the comparative evaluation. We validate the efficacy of ECHO by conducting comparative evaluation of 3 popular cloud-based chatbots in 2 different question-answering application scenarios with 3 levels of complexities. |
Year | DOI | Venue |
|---|---|---|
2020 | 10.1109/CCGrid49817.2020.00-26 | 2020 20th IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing (CCGRID) |
Keywords | DocType | ISBN |
Chatbots,NLP,Cloud platform,Conversation,Performance Evaluation | Conference | 978-1-7281-6095-5 |
Citations | PageRank | References |
0 | 0.34 | 0 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Forkan, A.R.M. | 1 | 19 | 1.72 |
| Prem Prakash Jayaraman | 2 | 378 | 44.66 |
| Yongbin Kang | 3 | 55 | 10.61 |
| Ahsan Morshed | 4 | 102 | 11.75 |