Application of the Cloze Procedure to Evaluate Comprehension and Demonstrate Rewriting of Pharmacy Educational Materials

Miller, Michael J.; DeWitt, Jane E.; McCleeary, Erin M.; O'Keefe, Kelly J

doi:10.1345/aph.1l642

Cited by 15 publications

(8 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The process described here is an example of what might be used in future interventions with diverse populations. However there are many other approaches to evaluation [ 50 ], such as the Cloze Test that assesses readability and comprehension together [ 51 ].…”

Section: Discussionmentioning

confidence: 99%

Assessing and Validating an Educational Resource Package for Health Professionals to Improve Smoking Cessation Care in Aboriginal and Torres Strait Islander Pregnant Women

Bar‐Zeev

Bovill

Bonevski

et al. 2017

IJERPH

View full text Add to dashboard Cite

Australian Aboriginal pregnant women have a high smoking prevalence (45%). Health professionals lack adequate educational resources to manage smoking. Resources need to be tailored to ensure saliency, cultural-sensitivity and account for diversity of Indigenous populations. As part of an intervention to improve health professionals’ smoking cessation care in Aboriginal pregnant women, a resource package was developed collaboratively with two Aboriginal Medical Services. The purpose of this study was to assess and validate this resource package. A multi-centred community-based participatory 4-step process (with three Aboriginal Medical Services from three Australian states), included: (1) Scientific review by an expert panel (2) ‘Suitability of Materials’ scoring by two Aboriginal Health Workers (3) Readability scores (4) Focus groups with health professionals. Content was analysed using six pre-determined themes (attraction, comprehension, self-efficacy, graphics and layout, cultural acceptability, and persuasion), with further inductive analysis for emerging themes. Suitability of Material scoring was adequate or superior. Average readability was grade 6.4 for patient resources (range 5.1–7.2), and 9.8 for health provider resources (range 8.5–10.6). Emergent themes included ‘Getting the message right’; ‘Engaging with family’; ‘Needing visual aids’; and ‘Requiring practicality under a tight timeframe’. Results were presented back to a Stakeholder and Consumer Aboriginal Advisory Panel and resources were adjusted accordingly. This process ensured materials used for the intervention were culturally responsive, evidence-based and useful. This novel formative evaluation protocol could be adapted for other Indigenous and culturally diverse interventions. The added value of this time-consuming and costly process is yet to be justified in research, and might impact the potential adaption by other projects.

show abstract

Section: Discussionmentioning

confidence: 99%

Assessing and Validating an Educational Resource Package for Health Professionals to Improve Smoking Cessation Care in Aboriginal and Torres Strait Islander Pregnant Women

Bar‐Zeev

Bovill

Bonevski

et al. 2017

IJERPH

View full text Add to dashboard Cite

show abstract

“…Diet and health is complex, and requires a higher order of integrated conceptualization than perhaps multiple response items can divulge. However, the cloze method has been used in assessing the understanding of other health-related topics, such as prostate cancer (16), pharmacy instructions (17), and cardiovascular disease risk (18). Therefore, while the cloze method is used in health arenas other than nutrition, dietitians may be unfamiliar with, uncomfortable with, or lack knowledge about the applicability of this method.…”

Section: Discussionmentioning

confidence: 99%

Establishing Content Validity for the Nutrition Literacy Assessment Instrument

Gibbs¹,

Chapman‐Novakofski²

2013

Prev. Chronic Dis.

View full text Add to dashboard Cite

IntroductionIdentification of low levels of health literacy is important for effective communication between providers and clients. Assessment instruments for general health literacy are inadequate for use in nutrition education encounters because they do not identify nutrition literacy. The primary objective of this 2-part study was to assess content validity for the Nutrition Literacy Assessment Instrument (NLAI).MethodsThis study included a 35-item online survey of registered dietitians (134 of whom answered all questions) and a pilot study in which 5 registered dietitians used the NLAI among 26 clients during nutrition education consultations. To assess agreement with the NLAI by survey participants, we used the following scale: “necessary” (70% agreement), “adequate” (80% agreement), or “good” (90% agreement); comments were analyzed by using content analysis. For the pilot, we made comparisons between subjective assessments, the Rapid Estimate of Adult Literacy in Medicine (REALM), and the NLAI. Registered dietitians also completed a postpilot–study survey.ResultsFor the online survey, we found good agreement (average, 89.7%) for including each section of the NLAI. All sections accomplished their purpose (average, 81.5%). For the pilot, REALM and NLAI correlation (r = 0.38) was not significant; the subjective assessment of clients by dietitians and NLAI lacked agreement 44% of the time, and registered dietitians provided instruction on deficient knowledge and skills identified by the NLAI 90% of the time.ConclusionThe NLAI is a content-valid measure of nutrition literacy. Additional validation of the NLAI is important because an objective instrument is needed for identifying nutrition literacy, a construct that appears to be different from health literacy.

show abstract

“…However, the test is also criticised for the measurement of guesswork and memory. 26 Because there is no perfect method for general reading tests as stated previously, 27 multiple comprehension tests should be applied to measure comprehension. The cloze test is also applicable to the Japanese language.…”

Section: Definition Factors Improvement and Evaluation Methods Of Rmentioning

confidence: 99%

“…The advantages are easier development and the ability to use wrong answers to improve the text. However, the test is also criticised for the measurement of guesswork and memory . Because there is no perfect method for general reading tests as stated previously, multiple comprehension tests should be applied to measure comprehension.…”

Section: Introductionmentioning

confidence: 99%

The role of readability in effective health communication: an experiment using a Japanese health information text on chronic suppurative otitis media

Sakai

2013

Health Info Libraries J

View full text Add to dashboard Cite

Objectives: This study identifies the most significant readability factors and examines ways of improving and evaluating Japanese health information text in terms of ease of reading and understanding. Methods: Six different Japanese texts were prepared based on an original short text written by a medical doctor for a hospital web site intended for laypersons regarding chronic suppurative otitis media. Four were revised for single readability factor (syntax, vocabulary, or text structure) and two were modified in all three factors. Using a web-based survey, 270 high school students read one of the seven texts, including the original, completed two kinds of comprehension tests, and answered questions on their impressions of the text's readability. Results: Significantly higher comprehension test scores were shown in the true or false test for a mixed text that presented important information first for better text structure. They were also found in the cloze test for a text using common vocabulary and a cohesive mixed text. Conclusions: Vocabulary could be a critical single readability factor when presumably combined with better text structure. Using multiple evaluation methods can help assess comprehensive readability. The findings on improvement and evaluation methods of readability can be applied to support effective health communication. Keywords: consumer health information, communication, information literacy, survey Key Messages• Vocabulary could be a critical single readability factor for improving the comprehension of health information text.• Health information text should preferably have better text structure for improved comprehension.• Using multiple methods is a reasonable way of evaluating comprehensive readability.• Extensive research and development of consumer health vocabulary and text structure to improve readability is needed in specific languages.• The findings on the improvement and evaluation methods of readability can be applied for effective communication in healthcare and consumer health information service.

show abstract

Application of the Cloze Procedure to Evaluate Comprehension and Demonstrate Rewriting of Pharmacy Educational Materials

Cited by 15 publications

References 27 publications

Assessing and Validating an Educational Resource Package for Health Professionals to Improve Smoking Cessation Care in Aboriginal and Torres Strait Islander Pregnant Women

Assessing and Validating an Educational Resource Package for Health Professionals to Improve Smoking Cessation Care in Aboriginal and Torres Strait Islander Pregnant Women

Establishing Content Validity for the Nutrition Literacy Assessment Instrument

The role of readability in effective health communication: an experiment using a Japanese health information text on chronic suppurative otitis media

Contact Info

Product

Resources

About