"Any other comments?" Open questions on questionnaires – a bane or a bonus to research?

Abstract

BackgroundThe habitual "any other comments" general open question at the end of structured questionnaires has the potential to increase response rates, elaborate responses to closed questions, and allow respondents to identify new issues not captured in the closed questions. However, we believe that many researchers have collected such data and failed to analyse or present it.DiscussionGeneral open questions at the end of structured questionnaires can present a problem because of their uncomfortable status of being strictly neither qualitative nor quantitative data, the consequent lack of clarity around how to analyse and report them, and the time and expertise needed to do so. We suggest that the value of these questions can be optimised if researchers start with a clear understanding of the type of data they wish to generate from such a question, and employ an appropriate strategy when designing the study. The intention can be to generate depth data or 'stories' from purposively defined groups of respondents for qualitative analysis, or to produce quantifiable data, representative of the population sampled, as a 'safety net' to identify issues which might complement the closed questions.SummaryWe encourage researchers to consider developing a more strategic use of general open questions at the end of structured questionnaires. This may optimise the quality of the data and the analysis, reduce dilemmas regarding whether and how to analyse such data, and result in a more ethical approach to making best use of the data which respondents kindly provide.

Sleep Practices of University Students Living in Residence

“…However, the answers that participants provided were often short, with no full sentences. These short-answered questions in surveys can be a problem because such data is neither exactly quantitative nor qualitative (O'Cathain & Thomas, 2004). One particular issue is that the in-depth answers provided by participants may be interpreted with more weight by researchers than those of participants providing only brief responses.…”

“…Consequently, the brief responses may be overlooked. O'Cathain and Thomas (2004) concluded that the numbers of respondents are important to report for this type of data. Thus, following repeated readings by both researchers and discussion to resolve any differences, we summarized the open-ended text responses into categories according to the main ideas and ranked these categories by the frequency with which responses appeared in each category was.…”

Nursery sickness policies and their influence on prescribing for conjunctivitis: audit and questionnaire survey

“…investigation through content analysis. 22 Statistical analysis was performed as above. Binary logistic regression was undertaken to identify any clinician characteristics that increased the likelihood of being influenced by CP policies.…”

Concepções de professoras de ensino fundamental sobre os transtornos de aprendizagem

“…In this article, we will only address the results for the teachers' knowledge about the distinctions between school difficulties, learning disabilities, and dyslexia, as well as their definitions, causes, and manifestations. We used open questions to permit teachers to respond in their own words, which gave us the advantage of collecting a larger amount of data and avoiding the influence of predetermined answers, which can happen with objective questions 23 . potential of the student by developing activities for them 7 .…”