Managing and evolving a chatbot's content is a laborious process and there is still a lack of standardization. In this context of standardization, the absence of a management process can lead to bad user experiences with a chatbot. This work proposes the Chatbot Management Process, a methodology for content management on chatbot systems. The proposed methodology is based on the experiences acquired with the development of Evatalk, the chatbot for the Brazilian Virtual School of Government. The focus of this methodology is to evolve the chatbot content through the analysis of user interactions, allowing a cyclic and human-supervised process. We divided the proposed methodology into three distinct phases, namely, manage, build, and analyze. Moreover, the proposed methodology presents a clear definition of the roles of the chatbot team. We validate the proposed methodology along with the creation of the Evatalk chatbot, whose amount of interactions was of 22,771 for the 1,698,957 enrolled attendees in the Brazillian Virtual School of Government in 2020. The application of the methodology on Evatalk's chatbot brought positive results: we reduced the chatbot's human hand-off rate from 44.43% to 30.16%, the chatbot's knowledge base examples increased by 160% whilst maintaining a high percentage of confidence in its responses and keeping the user satisfaction collected in conversations stable.
O aprendizado inicial de algoritmos se torna mais árduo quando a linguagem de programação utilizada possui comandos em uma língua estrangeira não dominada pelo aluno. O propósito deste estudo é compreender o impacto do uso da linguagem nativa do aprendiz nos estudos iniciais de programação. Um questionário foi aplicado ao final de quatro semestres consecutivos de um curso introdutório de programação e cinco perguntas foram selecionadas para o identificar nível de satisfação dos alunos e a eficiência do processo educacional. Os resultados obtidos mostram que a maior parte dos alunos entrevistados se mostrou satisfeita, teve as suas expectativas atendidas e recomenda a metodologia utilizada.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.