Assessing the Suitability of Written Stroke Materials: An Evaluation of the Interrater Reliability of the Suitability Assessment of Materials (SAM) Checklist

Abstract

Purpose: Written materials are frequently used to provide education to stroke patients and their carers. However, poor quality materials are a barrier to effective information provision. A quick and reliable method of evaluating material quality is needed. This study evaluated the interrater reliability of the Suitability Assessment of Materials (SAM) checklist in a sample of written stroke education materials. Methods: Two independent raters evaluated the materials (n = 25) using the SAM, and ratings were analyzed to reveal total percentage agreements and weighted kappa values for individual items and overall SAM rating. Results: The majority of the individual SAM items had high interrater reliability, with 17 of the 22 items achieving substantial, almost perfect, or perfect weighted kappa value scores. The overall SAM rating achieved a weighted kappa value of 0.60, with a percentage total agreement of 96%. Conclusion: Health care professionals should evaluate the content and design characteristics of written education materials before using them with patients. A tool such as the SAM checklist can be used; however, raters should exercise caution when interpreting results from items with more subjective scoring criteria. Refi nements to the scoring criteria for these items are recommended. The value of the SAM is that it can be used to identify specifi c elements that should be modifi ed before education materials are provided to patients. Key words: health education, interrater reliability, patient education, SAM, stroke, written education materials, written information T he importance and benefi ts of providing patients and their carers with education are widely acknowledged.1 Written patient education materials are frequently used by health professionals and desired by patients, 2-4 and they offer benefi ts such as portability and message consistency. 5 Additionally, patients are able to read information at a time and speed that are suitable for them, choose how much information they receive, refer back to information as needed, and share information with family members who were not present during the consultation.5-7 Health care professionals are encouraged to use written education materials with patients to reinforce and supplement information that is provided orally. 8,9 When only oral information is provided, much of that information is forgotten. [10][11][12] Stroke patients and their carers need to receive information on a wide variety of topics and at all phases of the recovery process.13 Information can assist individuals to understand what has happened, cope with the consequences, know what secondary stroke prevention behaviors to perform, and facilitate self-management of a chronic condition. Providing information to stroke patients and their carers has been found to improve patient and carer knowledge and aspects of patient satisfaction and to reduce patient depression.14 Clinical guidelines for stroke care now recommend that all patients and their families be offered information that is tailored t...

Assessment of Printed Patient-Educational Materials for Chronic Kidney Disease

“…These results are similar to scores that have been published from evaluations of PEMs for other medical conditions, suggesting high availability of health-related PEMs that are decent or good-enough, but relatively few that are outstanding. [15–17,20,21]…”

“…[14] This instrument was originally developed to evaluate the appropriateness and presentation of printed PEMs and has been adapted and validated for evaluation of health-related PEMs for many diseases including congestive heart failure,[15] hypertension,[16] and stroke. [17] The adapted SAM used in these analyses consisted of 26 items grouped into 4 different domains: message content (including learning stimulation and cultural suitability), text appearance/typography, visuals/graphics, and layout/design.…”

Educational technologies for health education on stroke: an integrative review

“…It is necessary that these be in accordance with the educational needs of the population. Thus, it is essential that the educational activities be planned and implemented according to the needs of each situation of illness, through clear objectives that lead to goals established (46)(47)(48) . The educational technologies are indispensable in the practices of health education, because they insert the individuals in the educational process, help empower those involved in and facilitate the development of personal skills that will maintain and improve health (49) .…”

Readability and Suitability Assessment of Adolescent Education Material in Preventing Hookah Smoking

“…Much of this information is forgotten, when only oral information is provided. Thus health workers are encouraged to provide written educational material to people to reinforce and supplement information that has been provided orally (8).…”