Methods for pre-testing and piloting survey questions: illustrations from the KENQOL survey of health-related quality of life

Bowden, A.; Fox-Rushby, J.; Nyandieka, L; Wanjau, J

doi:10.1093/heapol/17.3.322

Cited by 121 publications

(76 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…After first-round piloting, we sought information on flow, salience, acceptability and administrative ease. 20 We revised the questionnaires and vignettes as an iterative process, and after two rounds of amendment all were happy with the content. We used a purposive sampling approach 21 to target the groups of interest.…”

Section: Methodsmentioning

confidence: 99%

Appropriateness of unscheduled hospital admissions from care homes

Harrison

McKay²,

Grant

et al. 2016

Clinical Medicine

View full text Add to dashboard Cite

Section: Methodsmentioning

confidence: 99%

Appropriateness of unscheduled hospital admissions from care homes

Harrison

McKay²,

Grant

et al. 2016

Clinical Medicine

View full text Add to dashboard Cite

“…24 The purpose is to assess the dynamics of the questionnaire in a semistructured interaction. The respondents are asked to examine the questionnaire with regard to its flow, salience, acceptability and administrative ease, 23 identifying unusual, redundant, irrelevant or poorly worded question stems and responses.…”

Section: Testingmentioning

confidence: 99%

A guide for the design and conduct of self-administered surveys of clinicians

Burns¹,

Duffett²,

Kho³

et al. 2008

Canadian Medical Association Journal

1,028

891

View full text Add to dashboard Cite

Survey research is an important form of scientific inquiry 1 that merits rigorous design and analysis. 2 The aim of a survey is to gather reliable and unbiased data from a representative sample of respondents.3 Increasingly, investigators administer questionnaires to clinicians about their knowledge, attitudes and practice 2,4,5 to generate or refine research questions and to evaluate the impact of clinical research on practice. Questionnaires can be descriptive (reporting factual data) or explanatory (drawing inferences between constructs or concepts) and can explore several constructs at a time. Questionnaires can be informal, conducted as preparatory work for future studies, or formal, with specific objectives and outcomes.Rigorous questionnaires can be challenging and labour-intensive to develop, test and administer without the help of a systematic approach. 5 In this article, we outline steps to design, develop, test and administer valid questionnaires with minimal bias and optimal response rates. We focus on selfadministered postal and electronic surveys of clinicians that are amenable to quantitative analysis. We highlight differences between postal and electronic administration of surveys and review strategies that enhance response rates and reporting transparency. Although intended to assist in the conduct of rigorous self-administered surveys, our article may also help clinicians in the appraisal of published surveys.

show abstract

“…However, for practitioners and researchers in international development, the 'unique selling point' of the GPGI is not the final score, which is comparable to the SWLS, but the insight into what people value, and how they feel they are performing in these valued domains. The process additionally offers an opportunity for the respondent to reflect, and enables rapport to develop between administrator and respondent, in a similar manner to participatory learning approaches 6 . The results of the construct validation provided further evidence for the validity of the GPGI.…”

Section: Discussionmentioning

confidence: 99%

“…More recently, cognitive debriefing has been used to understand more about how people respond to measures [2], both with established measures (e.g. [24]), and as part of pre-testing [6]. However, it is still unusual to see qualitative interviews used in a way that focuses on the respondent rather than the measure, by aiming to assess the accuracy with which a measure has represented their worldview 3 .…”

Section: Qualitative Validationmentioning

confidence: 99%

‘Translation is not enough’: using the Global Person Generated Index (GPGI) to assess individual quality of life in Bangladesh, Thailand, and Ethiopia

Camfield

Ruta

2007

Qual Life Res

View full text Add to dashboard Cite

Currently few subjective measures of Quality of Life (QoL) are available for use in developing countries, which limits their theoretical, methodological, and practical contribution (for example, exploring the relationship between economic development and QoL, and ensuring effective and equitable service provision). One reason for this is the difficulty of ensuring that translated measures preserve conceptual, item, semantic, operational, measurement; and functional equivalence (Herdman, M., FoxRushby, J., & Badia, X. (1998). Quality of Life Research, 7, 331), which is illustrated by an account of the translation, pre-piloting, and administration of a new individualised QoL measure, the Global Person Generated Index or 'GPGI'. The GPGI is based on the widely used Patient Generated Index (Ruta, Camfield, & Martin, (2004) Quality of Life Research, 13, 1545.) and offers many of the advantages of the participatory approaches commonly used in developing countries, with added methodological rigour, and quantitative outcomes. It was successfully validated in Bangladesh, Thailand, and Ethiopia, using quantitative and qualitative methods-open-ended, semi-structured interviews (SSIs), conducted immediately post-administration. Both the measure and method of 'qualitative validation' described later in the paper offer an exciting alternative for future researchers and practitioners in this field. The quantitative results suggest the GPGI shows cultural sensitivity, and is able to capture both the areas that are important to respondents, and aspects of life one would expect to impact on QoL in developing countries. There were strong correlation between scores from the GPGI and SSIs for the area of health, and moderate correlations for 'material wellbeing' (MWB)('Material wellbeing' refers to respondents' perceptions of their achievement in the areas of farming, debt reduction, assets, crops, livestock, job, land, property, and agriculture) and children. Weak to moderate correlations were observed between the Satisfaction with Life Scale and the GPGI; however, the highest coefficient was between the GPGI and the most conceptually similar item. Statistically significant differences were seen in GPGI scores between rich and poor, urban and rural respondents, and different countries. Health and material wellbeing scores, derived from the SSIs, also showed a linear relationship with GPGI scores, with a suggestion of curvilinearity at the higher levels, as predicted by a general QoL causal model. In conclusion, the GPGI has great potential for use in this area, especially when supported by extensive interviewer training, and supplemented with a cognitive appraisal schedule.

show abstract

Methods for pre-testing and piloting survey questions: illustrations from the KENQOL survey of health-related quality of life

Cited by 121 publications

References 12 publications

Appropriateness of unscheduled hospital admissions from care homes

Appropriateness of unscheduled hospital admissions from care homes

A guide for the design and conduct of self-administered surveys of clinicians

‘Translation is not enough’: using the Global Person Generated Index (GPGI) to assess individual quality of life in Bangladesh, Thailand, and Ethiopia

Contact Info

Product

Resources

About