Investigating validity and effectiveness of cognitive interviewing as a pretesting method for non-English questionnaires: Findings from Korean cognitive interviews

Park, Hyunjoo; Sha, Mandy; Pan, Yuling

doi:10.1080/13645579.2013.823002

Cited by 23 publications

(19 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Epstein et al [16] has pointed out that currently there is no consensus on cross-cultural adaptation procedure. However, researchers suggest [24], the importance of including the target audience when translating questionnaires to another language. The Icelandic version of HLS-EU-Q16 exhibited high internal consistency, with Cronbach's α = .88, which is in line with results from the German version of the instrument [31].…”

Section: Discussionmentioning

confidence: 99%

“…The technique helps analyse the manner in which respondents understand, mentally process, and ultimately respond to the presented materials [20,22]. The cognitive interview technique is reported to be useful when translating questionnaires to other languages [23], and the validity of the technique has been supported when identifying linguistic problems in the questionnaire's items [24].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Translation and cross-cultural adaptation of the European Health Literacy Survey Questionnaire, HLS-EU-Q16: the Icelandic version

et al. 2020

View full text Add to dashboard Cite

Background: Health literacy (HL) is defined as the knowledge and competences of people to meet the complex demands of health in modern society. It is an important factor in ensuring positive health outcomes, yet Iceland is one of many countries with limited knowledge of HL and no valid HL measurement. The aim of this study was to translate the European Health Literacy Survey Questionnaire-short version (HLS-EU-Q16) into Icelandic, adapt the version, explore its psychometric properties and establish preliminary norms. Methods: The HLS-EU-Q16 translation model included three steps: 1) translation-back-translation of HLS-EU-Q16 including specialists' review (n = 6); 2) cognitive interviewing of lay people (n = 17); and 3) psychometric analysis with survey participants. The HLS-EU-Q16 includes 16 items, with scores ranges from zero (low/no HL) to 16 (high HL). Statistics included were descriptive, internal consistency measured by Cronbach's α, exploratory factor analysis, and multivariate linear regression. Results: After the translation and cognitive interviewing, 11 of the HLS-EU-Q16 items were reworded to adapt the instrument to Icelandic culture while maintaining their conceptual objectives. Survey participants were 251. Internal consistency of the translated and adapted instrument was α = .88. Four factors with eigenvalues > 1.0 explained 62.6% of variance. Principal component analysis with Oblimin rotation presented four latent constructs, "Processing and Using Information from the Doctor" (4 items, α = .77), "Processing and Using Information from the Family and Media" (4 items, α = .85), "Processing Information in Connection to Healthy Lifestyle" (5 items, α = .76), and "Finding Information about Health Problems/Illnesses" (3 items, α = .73). Lower self-rated health was an independent predictor of lower HL (β = −.484, p = .008). Preliminary norms for HL ranged from five to 16 (M 13.7, SD ± 2.6) with 72.5% with sufficient HL (score 13-16), 22% with problematic HL (score 9-12) and 5.5% with inadequate HL (score 0-8). Conclusions: The Icelandic version of HLS-EU-Q16 is psychometrically sound, with reasonably clear factor structure, and comparable to the original model. This opens possibilities to study HL in Iceland and compare the results internationally. The translation model introduced might be helpful for other countries where information on HL is missing based on lack of validated tools.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Translation and cross-cultural adaptation of the European Health Literacy Survey Questionnaire, HLS-EU-Q16: the Icelandic version

et al. 2020

View full text Add to dashboard Cite

show abstract

“…Because pilot studies may not detect all the potential problems with an instrument, question‐testing methods such as cognitive interviewing are valuable for thoroughly examining the instrument and the question‐and‐response process. In Asian languages and cultures in particular, communicative norms are frequently different from those of English language and culture, leading to difficulties in comprehending questions due to participants' lack of lexical knowledge or differences in participants' thought processes (Park, Sha, & Pan, ). Furthermore, cultural variability as well as questionnaire design matters such as response format, question length, and reading level all affect the way that questions are interpreted by participants (Johnson et al, ).…”

Section: Introductionmentioning

confidence: 99%

Enriching the quality of cross‐cultural instrument development through cognitive interviewing: Implications for nursing research

Jang

Kim

Collins

et al. 2019

Japan Journal Nursing Sci

View full text Add to dashboard Cite

Aim During cross‐cultural instrument development, a gap commonly exists between the intended meaning of questionnaire items and the extent to which the participant understands that meaning. Because cognitive interviewing can provide such a powerful means for ensuring an accurate interpretation of items, the purpose of this report is to provide a practical guide to encourage its use in nursing research. Methods This report provides in‐depth information describing: (a) advantages of cognitive interviewing, particularly for cross‐cultural instrument development; (b) specific problems it can identify and solve; (c) strategies for performing cognitive interviews, including the four‐step model of the question‐and‐answer process; (d) practical guidance for conducting successful cognitive interviews. Results To achieve linguistic validity as well as cultural relevance, a variety of factors need to be considered in addition to language, such as cultural interpretations, attitudes, and values. Examples of health‐related studies are presented, demonstrating the advantages of cognitive interviewing for instrument development and cross‐cultural research. These examples show how cognitive interviewing can be productively used to verify question clarity, patient comprehension, and patients' ease of response and judgment while also helping to establish content validity based on patients' perspectives. Conclusions Cognitive interviewing can help nurse researchers discover potential instrument flaws and correct them in advance, subsequently avoiding collection of inaccurate data. Thus, cognitive interviewing should be considered an effective pretesting method for development of accurate instruments, particularly in cross‐cultural nursing research.

show abstract

“…First, there is limited literature addressing cognitive testing among nonmainstream and non-English speaking AAPI populations until recently. [5361] Nor is there literature on conducting cognitive interviews with CA mothers. Instrument development for our study — though time-consuming — breaks new ground with construction of new protocols [Figure 1] for each step from standardized interviewer training to debriefing of the cognitive test to ensure both psychometric properties and cultural and linguistic appropriateness.…”

Section: Discussionmentioning

confidence: 99%

Using qualitative methods to develop a contextually tailored instrument: Lessons learned

Lee

Kiang

Kim

et al. 2015

Asia-Pacific Journal of Oncology Nursing

View full text Add to dashboard Cite

Objective:To develop a population-specific instrument to inform hepatitis B virus (HBV) and human papilloma virus (HPV) prevention education and intervention based on data and evidence obtained from the targeted population of Khmer mothers reflecting their socio-cultural and health behaviors.Methods:The principles of community-based participatory research (CBPR) guided the development of a standardized survey interview. Four stages of development and testing of the survey instrument took place in order to inform the quantitative health survey used to collect data in stage five of the project. This article reports only on Stages 1-4.Results:This process created a new quantitative measure of HBV and HPV prevention behavior based on the revised Network Episode Model and informed by the targeted population. The CBPR method facilitated the application and translation of abstract theoretical ideas of HBV and HPV prevention behavior into culturally-relevant words and expressions of Cambodian Americans (CAs).Conclusions:The design of an instrument development process that accounts for distinctive socio-cultural backgrounds of CA refugee/immigrant women provides a model for use in developing future health surveys that are intended to aid minority-serving health care professionals and researchers as well as targeted minority populations.

show abstract

Investigating validity and effectiveness of cognitive interviewing as a pretesting method for non-English questionnaires: Findings from Korean cognitive interviews

Cited by 23 publications

References 11 publications

Translation and cross-cultural adaptation of the European Health Literacy Survey Questionnaire, HLS-EU-Q16: the Icelandic version

Translation and cross-cultural adaptation of the European Health Literacy Survey Questionnaire, HLS-EU-Q16: the Icelandic version

Enriching the quality of cross‐cultural instrument development through cognitive interviewing: Implications for nursing research

Using qualitative methods to develop a contextually tailored instrument: Lessons learned

Contact Info

Product

Resources

About