Words or graphics to present a Discrete Choice Experiment: Does it matter?

Veldwijk, Jorien; Lambooij, Mattijs; Til, Janine Astrid van; Groothuis-Oudshoorn, Catharina Gerarda Maria; Smit, Henriëtte A.; Wit, G. Ardine de

doi:10.1016/j.pec.2015.06.002

Cited by 34 publications

(40 citation statements)

References 39 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…They suggest that the presentation of unfamiliar numerical information should use a graphical representation rather than just a numeric one, in order to minimise the likelihood of error. However, the differences identified between the presentation formats did not impact on preferences for a medical practice systematically, unlike the findings of Veldwijk et al [13] where substantial differences in preferences were identified between graphical and non-graphical presentation formats in a study of parental preferences for newborn rotavirus vaccination. These differences may relate either to the very different choice context, or the differences in the approaches to presenting the formats or both.…”

Section: Discussioncontrasting

confidence: 79%

“…These differences may relate either to the very different choice context, or the differences in the approaches to presenting the formats or both. Our study only used graphical representation for the service quality attributes which had numerical attribute levels and were thought likely to present challenges for respondents, rather than for all attributes as was done in Veldwijk et al [13] and Townsend and Kahn [30].…”

Section: Discussionmentioning

confidence: 99%

“…We found only one study which analysed the impact of presentation format in the context of a health related DCE [13]. It found that words were preferred by respondents, graphics did not improve attribute comprehension and that presentation format impacted on preferences for infant vaccination.…”

Section: Introductionmentioning

confidence: 89%

See 2 more Smart Citations

Choosing a Doctor: Does Presentation Format Affect the Way Consumers Use Health Care Performance Information?

Kenny

Goodall

Street

et al. 2017

Patient

View full text Add to dashboard Cite

Telephone +41 2 95144750, Fax +41 2 95144730 2 Abstract BackgroundChoosing a new health service provider can be difficult and is dependent on the type and clarity of the information available. This study examines if the presentation of service quality information affects the decisions of consumers choosing a general medical practice. ObjectivesTo examine the impact of presentation format on attribute level interpretation and relative importance. MethodsA discrete choice experiment eliciting preferences for a general medical practice was conducted using four different presentation formats for service quality attributes: 1) frequency and percentage with an icon array, 2) star ratings, 3) star ratings with a text benchmark, and 4) percentage alone. A total of 1208 respondents from an online panel were randomised to see two formats, answering nine choices for each, where one was a dominated choice. Logistic regression was used to assess the impact of presentation format on the probability of choosing a dominated alternative. A generalised multinomial logit model was used to estimate the relative importance of the attribute levels. ResultsThe probability of incorrectly choosing a dominated alternative was significantly higher when the quality information was presented as a percentage relative to a frequency with icon array, star rating or bench-marked star rating. Preferences for a practice did not differ significantly by presentation format, nor did the probability of finding the information difficult to understand. ConclusionsQuantitative health service quality information will be more useful to consumers if presented by combining the numerical information with a graphic, or using a star rating if appropriate for the context. 3 Key points for decision makersInformation about service quality such as that collected in patient experience surveys would be useful for consumers choosing a new general practice.Presentation of performance quality information for consumers will be most useful if presented as frequency and percent with icons or start ratings.4

show abstract

Section: Discussioncontrasting

confidence: 79%

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Choosing a Doctor: Does Presentation Format Affect the Way Consumers Use Health Care Performance Information?

Kenny

Goodall

Street

et al. 2017

Patient

View full text Add to dashboard Cite

show abstract

“…Measurement effects occur when the same respondent would provide different responses to identically worded questions between different survey modes [8]. Research within the field of DCEs has shown that changes in the design of the survey, for example, attribute framing [9], attribute ordering [10], and the presentation of attributes as either words or graphics [11], have unintended influences on obtained estimates, which might result in biased conclusions. To be able to assess the appropriateness of increased electronic data collection, it is therefore essential to study whether the mode of administration (paper vs. online) also affects DCE results.…”

Section: Introductionmentioning

confidence: 99%

Impact of Survey Administration Mode on the Results of a Health-Related Discrete Choice Experiment: Online and Paper Comparison

et al. 2017

Self Cite

View full text Add to dashboard Cite

We find no indication that online surveys yield inferior results compared with paper-based surveys, whereas the price per respondent is lower for online surveys. Researchers might want to include fewer choice sets per respondent when collecting DCE data online. Because our findings are based on a nonrandomized DCE that covers one health domain only, research in other domains is needed to support our findings.

show abstract

“…There are some emerging examples of DCEs employing pictorial representations as advocated in the risk communication literature more generally [ 23 , 54 , 55 ]. However, as yet, there is mixed evidence of the relative effectiveness of the formats and approaches to risk communication in the context of benefit-risk assessment [ 56 , 57 ]. Demonstrating that the results of DCEs are robust to biases, or at minimum establishing the direction of the potential bias, is vital information if the method is to be used in regulatory decision making.…”

Section: Communicating Riskmentioning

confidence: 99%

Using Discrete Choice Experiments to Inform the Benefit-Risk Assessment of Medicines: Are We Ready Yet?

Vass

Payne

2017

PharmacoEconomics

View full text Add to dashboard Cite

There is emerging interest in the use of discrete choice experiments as a means of quantifying the perceived balance between benefits and risks (quantitative benefit-risk assessment) of new healthcare interventions, such as medicines, under assessment by regulatory agencies. For stated preference data on benefit-risk assessment to be used in regulatory decision making, the methods to generate these data must be valid, reliable and capable of producing meaningful estimates understood by decision makers. Some reporting guidelines exist for discrete choice experiments, and for related methods such as conjoint analysis. However, existing guidelines focus on reporting standards, are general in focus and do not consider the requirements for using discrete choice experiments specifically for quantifying benefit-risk assessments in the context of regulatory decision making. This opinion piece outlines the current state of play in using discrete choice experiments for benefit-risk assessment and proposes key areas needing to be addressed to demonstrate that discrete choice experiments are an appropriate and valid stated preference elicitation method in this context. Methodological research is required to establish: how robust the results of discrete choice experiments are to formats and methods of risk communication; how information in the discrete choice experiment can be presented effectually to respondents; whose preferences should be elicited; the correct underlying utility function and analytical model; the impact of heterogeneity in preferences; and the generalisability of the results. We believe these methodological issues should be addressed, alongside developing a ‘reference case’, before agencies can safely and confidently use discrete choice experiments for quantitative benefit-risk assessment in the context of regulatory decision making for new medicines and healthcare products.

show abstract

Words or graphics to present a Discrete Choice Experiment: Does it matter?

Abstract: Future research on the use of either words or graphics is recommended in order to establish guidelines on how to develop a valid presentation method for attribute levels in the choice tasks of a DCE.

Cited by 34 publications

References 39 publications

Choosing a Doctor: Does Presentation Format Affect the Way Consumers Use Health Care Performance Information?

Choosing a Doctor: Does Presentation Format Affect the Way Consumers Use Health Care Performance Information?

Impact of Survey Administration Mode on the Results of a Health-Related Discrete Choice Experiment: Online and Paper Comparison

Using Discrete Choice Experiments to Inform the Benefit-Risk Assessment of Medicines: Are We Ready Yet?

Contact Info

Product

Resources

About