Content validation and usability of a chatbot of guidelines for wound dressing

Roque, Geicianfran da Silva Lima; Souza, Rafael Borim de; Nascimento, José William Araújo do; Filho, Amadeu Sá de Campos; Queiroz, Sergio; Santos, Isabel Cristina Ramos Vieira

doi:10.1016/j.ijmedinf.2021.104473

Cited by 15 publications

(20 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The SUS scores were 78.2 in G1 and 82.1 in G2 on a scale of 0 to 100. Similar results can be found in a recent study conducted in Brazil about developing a chatbot-like virtual assistant for providing guidance about dressing techniques to be performed by users in their homes 24 …”

Section: Discussionsupporting

confidence: 89%

“…Similar results can be found in a recent study conducted in Brazil about developing a chatbot-like virtual assistant for providing guidance about dressing techniques to be performed by users in their homes. 24 The average SUS score in published studies has been measured by researchers as 62.1, but 68 is usually used as the criterion standard. 25 Therefore, SUS scores greater than 68 are above average, whereas SUS scores less than 68 are below average.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

A Virtual Assistant in Vaccine Pharmacovigilance

Cavalcanti

Nascimento

Roque

et al. 2023

CIN: Computers, Informatics, Nursing

View full text Add to dashboard Cite

This article describes the process of developing and validating a virtual assistant to perform vaccine pharmacovigilance. We performed a pilot study with a panel of 22 healthcare professionals who performed content validation of the virtual assistant prototype. Usability was tested with 126 users, using the System Usability Scale. The data analysis was performed by the agreement rate and content validity index, and the κ test was used to verify the agreement between the evaluators. The content domains of the virtual assistant achieved excellent suitability, relevance, and representativeness criteria, all greater than 86%; the content validity index ranged from 0.81 to 0.98, with an average of 0.90 and an interrater reliability index of 1.00. There was excellent interrater agreement (average κ value, 0.76). The total usability score among users was 80.1, ranging from 78.2 in group 1 (users without reactions to vaccines) to 82.1 in group 2 (users with reactions) (P = .002). The virtual assistant for vaccine pharmacovigilance obtained a satisfactory level of content validity and usability, giving greater credibility to the claim that this device provides greater surveillance and safety for patients.

show abstract

Section: Discussionsupporting

confidence: 89%

Section: Discussionmentioning

confidence: 99%

A Virtual Assistant in Vaccine Pharmacovigilance

Cavalcanti

Nascimento

Roque

et al. 2023

CIN: Computers, Informatics, Nursing

View full text Add to dashboard Cite

show abstract

“…When considering the representative values of quality, it was possible to verify that the CoronaBot presents the five usability components: ease of learning, efficiency of use, ease of recall, low error rate, and subjective satisfaction. Similar usability data can be observed in the development of other prototypes in the healthcare field 28 …”

Section: Discussionsupporting

confidence: 76%

“…Similar usability data can be observed in the development of other prototypes in the healthcare field. 28 …”

Section: Discussionmentioning

confidence: 99%

“…Similar usability data can be observed in the development of other prototypes in the healthcare field. 28 In the scientific literature, intelligent virtual assistants like chatbots can be observed in aid of the COVID-19 pandemic. These actions performed by chatbots are configured as extremely important, as they help health professionals in decision making, alleviating stressed health systems.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Content and Usability Validation of an Intelligent Virtual Conversation Assistant Used for Virtual Triage During the COVID-19 Pandemic in Brazil

Filho

Cursino

Nascimento

et al. 2022

CIN: Computers, Informatics, Nursing

Self Cite

View full text Add to dashboard Cite

This study aimed to describe the development process, content validation, and usability of a COVID-19 screening system incorporated into a chatbot-type intelligent virtual assistant (CoronaBot). This is a methodological research carried out in three phases. The first corresponded to the development of the flowchart and content of the virtual assistant, the second phase consisted of the implementation of the content in chatbot, and the third phase consisted of content validation. Data analysis was performed by agreement rate, content validity index, and kappa statistical test. Finally, in the third phase, the chatbot's usability was analyzed using the System Usability Scale, by 10 users. The CoronaBot content presented domains with agreement rate above 87.5%, and its items referring to symptomatological scores and interface screens had values of content validity index with a mean of 0.96, kappa test with values from 0.70 to 0.76, and interspecialist agreement of 1.00, demonstrating excellence of prototype content. The global usability score was 80.1. The script developed and incorporated into the chatbot prototype achieved a satisfactory level of content validity. The usability of the chatbot was considered good, adding to the credibility of the device.

show abstract