Evaluating the conduct and application of health utility studies: a review of critical appraisal tools and reporting checklists

Zoratti, Michael J.; Pickard, A. Simon; Stalmeier, Peep F. M.; Ollendorf, Daniel A.; Lloyd, Andrew; Chan, Kelvin K.; Husereau, Don; Brazier, John; Krahn, Murray; Levine, Mitchell; Thabane, Lehana; Xie, Feng

doi:10.1007/s10198-021-01286-0

Cited by 9 publications

(10 citation statements)

References 45 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There is a clear need for standards of reporting that reflect the specific requirements of child health valuations [ 104 ]. A recent review by Zoratti et al [ 105 ] has highlighted the need for reporting standards for adult health valuation studies. However, as child health valuation presents a range of additional challenges, there is a strong need for child-specific reporting standards.…”

Section: Discussionmentioning

confidence: 99%

Preference Elicitation Techniques Used in Valuing Children’s Health-Related Quality-of-Life: A Systematic Review

Bailey

Howell²,

Raghunandan³

et al. 2022

PharmacoEconomics

View full text Add to dashboard Cite

Background and Objectives Valuing children’s health states for use in economic evaluations is globally relevant and is of particular relevance in jurisdictions where a cost-utility analysis is the preferred form of analysis for decision making. Despite this, the challenges with valuing child health mean that there are many remaining questions for debate about the approach to elicitation of values. The aim of this paper was to identify and describe the methods used to value children’s health states and the specific issues that arise in the use of these methods. Methods We conducted a systematic search of electronic databases to identify studies published in English since 1990 that used preference elicitation methods to value child and adolescent (under 18 years of age) health states. Eligibility criteria comprised valuation studies concerning both child-specific patient-reported outcome measures and child health states defined in other ways, and methodological studies of valuation approaches that may or may not have yielded a value set algorithm. Results A total of 77 eligible studies were identified from which data on country setting, aims, condition (general population or clinically specific), sample size, age of respondents, the perspective that participants were asked to adopt, source of values (respondents who completed the preference elicitation tasks) and methods questions asked were extracted. Extracted data were classified and evaluated using narrative synthesis methods. The studies were classified into three groups: (1) studies comparing elicitation methods ( n = 30); (2) studies comparing perspectives ( n = 23); and (3) studies where no comparisons were presented ( n = 26); selected studies could fall into more than one group. Overall, the studies varied considerably both in methods used and in reporting. The preference elicitation tasks included time trade-off, standard gamble, visual analogue scaling, rating/ranking, discrete choice experiments, best-worst scaling and willingness to pay elicited through a contingent valuation. Perspectives included adults’ considering the health states from their own perspective, adults taking the perspective of a child (own, other, hypothetical) and a child/adolescent taking their own or the perspective of another child. There was some evidence that children gave lower values for comparable health states than did adults that adopted their own perspective or adult/parents that adopted the perspective of children. Conclusions Differences in reporting limited the conclusions that can be formed about which methods are most suitable for eliciting preferences for children’s health and the influence of differing perspectives and values. Difficulties encountered in drawing conclusions from the data (such as lack of consensus and poor reporting making it difficult for users to choose and inter...

show abstract

Section: Discussionmentioning

confidence: 99%

Preference Elicitation Techniques Used in Valuing Children’s Health-Related Quality-of-Life: A Systematic Review

Bailey

Howell²,

Raghunandan³

et al. 2022

PharmacoEconomics

View full text Add to dashboard Cite

show abstract

“…These four questions were identified from an appraisal tool (including 17 questions) developed by Nerich et al (2017) [ 32 ] (Full appraisal tool in Appendix 3 ). According to a systematic review of HSUV appraisal tools by Zoratti et al [ 33 ], these four questions from the tool developed by Nerich et al (2017) [ 32 ] were useful to appraise the quality of breast cancer HSUVs. YW independently appraised the quality of studies, and the results of the appraisal were categorised as yes (complete), yes (partial), no, and not assessable.…”

Section: Methodsmentioning

confidence: 99%

The impact of age on health utility values for older women with early-stage breast cancer: a systematic review and meta-regression

Wang

Gavan

Steinke

et al. 2022

Health Qual Life Outcomes

View full text Add to dashboard Cite

Introduction An increasing number of postmenopausal women are diagnosed with breast cancer at an older age (≥ 70 years). There is a lack of synthesised health utility data to support decision-making for managing breast cancer in this older population. This study aimed to identify the availability of, and the subsequent impact of age on, health state utility values (HSUVs) measured by the EQ-5D for older women with early-stage breast cancer. Method This systematic review identified EQ-5D (3L or 5L version) HSUVs for postmenopausal women with early-stage breast cancer. Studies were identified from a previous systematic review (inception to 2009) and an electronic database search (Medline and Embase; 2009 to September 2021). Mean HSUVs were summarised by health state. Quality appraisal was performed on studies reporting HSUVs for older ages (≥ 70 years). Multivariable meta-regression assessed the association between HSUVs and age, health state, treatments received, and time of measuring the utility values (greater or less than one year post-treatment). Results Fifty EQ-5D HSUVs were identified from 13 studies. Mean HSUVs decreased as health state worsened: from the stable (mean=0.83) to progression (mean=0.79) and advanced (mean=0.68) states. Two studies reported six HSUVs estimated from the sample of women with a mean age ≥ 70. Meta-regression model fit improved by including age as an independent variable and attenuated the estimated utility decrements associated with worse health states. Utility decrements for the progression and advanced states were -0.052 (95%CI: -0.097, -0.007) and -0.143 (95%CI: -0.264, -0.022) respectively. The breast cancer-specific utility decrement associated with a one-year increase in age was -0.001 (95%CI: -0.004, 0.002). Conclusion Relevant and accurate HSUVs are essential to help support decision-making about the most effective and cost-effective ways to manage early-stage breast cancer in older women. Age has a vital role in determining health utility values in this population. This study provides analysts and decision-makers with HSUVs and utility decrements that reflect the disease process in this older population.

show abstract

“…Our methodology for the development of the checklist has been adapted from the EQUATOR Network guidelines for developing reporting checklists [ 11 ], such as identifying the need for a checklist via systematic reviews, and around our and others’ recent work (Sections 1 and 2 of the EQUATOR Network guidelines) [ 3 , 8 , 12 ]. The reporting checklist was then developed following the EQUATOR toolkit, including generating a list of items and conducting a series of meetings (Section 3).…”

Section: Developmentmentioning

confidence: 99%

“…The modular approach also allowed us to differentiate between checklist items specific to valuation of child HRQoL and those that are important to include but are also common to reporting of adult HRQoL, thereby providing a standalone comprehensive checklist for children. An initial conceptual framework was developed by the authors to identify relevant modules, informed by existing checklists for adult HRQoL values [ 12 ] and reviews of methods for valuing child HRQoL [ 3 , 8 ]. This was refined through checklist item development and testing, using an iterative process (expanded on below).…”

Section: Developmentmentioning

confidence: 99%

The RETRIEVE Checklist for Studies Reporting the Elicitation of Stated Preferences for Child Health-Related Quality of Life

Bailey,

Howell,

Raghunandan

et al. 2024

PharmacoEconomics

View full text Add to dashboard Cite

Background Recent systematic reviews show varying methods for eliciting, modelling, and reporting preference-based values for child health-related quality-of-life (HRQoL) outcomes, thus producing value sets with different characteristics. Reporting in many of the reviewed studies was found to be incomplete and inconsistent, making them difficult to assess. Checklists can help to improve standards of reporting; however, existing checklists do not address methodological issues for valuing child HRQoL. Existing checklists also focus on reporting methods and processes used in developing HRQoL values, with less focus on reporting of the values’ key characteristics and properties. We aimed to develop a checklist for studies generating values for child HRQoL, including for disease-specific states and value sets for generic child HRQoL instruments. Development A conceptual model provided a structure for grouping items into five modules. Potential items were sourced from an adult HRQoL checklist review, with additional items specific to children developed using recent reviews. Checklist items were reduced by eliminating duplication and overlap, then refined for relevance and clarity via an iterative process. Long and short checklist versions were produced for different user needs. The resulting long RETRIEVE contains 83 items, with modules for reporting methods (A–D) and characteristics of values (E), for researchers planning and reporting child health valuation studies. The short RETRIEVE contains 14 items for decision makers or researchers choosing value sets. Conclusion Applying the RETRIEVE checklists to relevant studies suggests feasibility. RETRIEVE has the potential to improve completeness in the reporting of preference-based values for child HRQOL outcomes and to improve assessment of preference-based value sets. Supplementary Information The online version contains supplementary material available at 10.1007/s40273-023-01333-z.

show abstract

Evaluating the conduct and application of health utility studies: a review of critical appraisal tools and reporting checklists

Cited by 9 publications

References 45 publications

Preference Elicitation Techniques Used in Valuing Children’s Health-Related Quality-of-Life: A Systematic Review

Preference Elicitation Techniques Used in Valuing Children’s Health-Related Quality-of-Life: A Systematic Review

The impact of age on health utility values for older women with early-stage breast cancer: a systematic review and meta-regression

The RETRIEVE Checklist for Studies Reporting the Elicitation of Stated Preferences for Child Health-Related Quality of Life

Contact Info

Product

Resources

About