Background: Immune-checkpoint inhibitors may provide long-term survival benefits via a cured proportion, yet data are usually insufficient to prove this upon submission to health technology assessment bodies. Objective: We revisited the National Institute for Health and Care Excellence assessment of ipilimumab in melanoma (TA319). We used updated data from the pivotal trial to assess the accuracy of the extrapolation methods used and compared these to previously unused techniques to establish whether an alternative extrapolation may have provided more accurate survival projections. Methods: We compared projections from the piecewise survival model used in TA319 and those produced by alternative models (fit to trial data with minimum follow-up of 3 years) to a longer-term data cut (5-year follow-up). We also compared projections to external data to help assess validity. Alternative approaches considered were parametric, spline-based, mixture, and mixture-cure models. Results: Only the survival model used in TA319 and a mixture-cure model provided 5-year survival predictions close to those observed in the 5-year follow-up data set. Standard parametric, spline, and nonecurativemixture models substantially underestimated 5-year survival. Survival estimates from the TA319 model and the mixture-cure model diverge considerably after 5 years and remain unvalidated. Conclusions: In our case study, only models that incorporated an element of external information (through a cure fraction combined with background mortality rates or using registry data) provided accurate estimates of 5-year survival. Flexible models that were able to capture the complex hazard functions observed during the trial, but which did not incorporate external information, extrapolated poorly.

Probabilistic sensitivity analysis (PSA) demonstrates the parameter uncertainty in a decision problem. The technique involves sampling parameters from their respective distributions (rather than simply using mean/median parameter values). Guidance in the literature, and from health technology assessment bodies, on the number of simulations that should be performed suggests a 'sufficient number', or until 'convergence', which is seldom defined. The objective of this tutorial is to describe possible outcomes from PSA, discuss appropriate levels of accuracy, and present guidance by which an analyst can determine if a sufficient number of simulations have been conducted, such that results are considered to have converged. The proposed approach considers the variance of the outcomes of interest in cost-effectiveness analysis as a function of the number of simulations. A worked example of the technique is presented using results from a published model, with recommendations made on best practice. While the technique presented remains essentially arbitrary, it does give a mechanism for assessing the level of simulation error, and thus represents an advance over current practice of a round number of simulations with no assessment of model convergence.

Objective To establish how real-world evidence (RWE) has been used to inform single technology appraisals (STAs) of cancer drugs conducted by the National Institute for Health and Care Excellence (NICE). Methods STAs published by NICE from April 2011 to October 2018 that evaluated cancer treatments were reviewed. Information regarding the use of RWE to directly inform the company-submitted cost-effectiveness analysis was extracted and categorized by topic. Summary statistics were used to describe emergent themes, and a narrative summary was provided for key case studies. Results Materials for a total of 113 relevant STAs were identified and analyzed, of which nearly all (96 percent) included some form of RWE within the company-submitted cost-effectiveness analysis. The most common categories of RWE use concerned the health-related quality of life of patients (71 percent), costs (46 percent), and medical resource utilization (40 percent). While sources of RWE were routinely criticized as part of the appraisal process, we identified only two cases where the use of RWE was overtly rejected; hence, in the majority of cases, RWE was accepted in cancer drug submissions to NICE. Discussion RWE has been used extensively in cancer submissions to NICE. Key criticisms of RWE in submissions to NICE are seldom regarding the use of RWE in general; instead, these are typically concerned with specific data sources and the applicability of these to the decision problem. Within an appropriate context, RWE constitutes an extremely valuable source of information to inform decision making; yet the development of best practice guidelines may improve current reporting standards.

Cost-effectiveness analysis provides information on the potential value of new cancer treatments, which is particularly pertinent for decision makers as demand for treatment grows while healthcare budgets remain fixed. A range of decision-analytic modelling approaches can be used to estimate cost effectiveness. This study summarises the key modelling approaches considered in oncology, alongside their advantages and limitations. A review was conducted to identify single technology appraisals (STAs) submitted to the National Institute for Health and Care Excellence (NICE) and published papers reporting full economic evaluations of cancer treatments published within the last 5 years. The review was supplemented with the existing methods literature discussing cancer modelling. In total, 100 NICE STAs and 124 published studies were included. Partitioned-survival analysis (n = 54) and discrete-time state transition structures (n = 41) were the main structures submitted to NICE. Conversely, the published studies reported greater use of discrete-time state transition models (n = 102). Limited justification of model structure was provided by authors, despite an awareness in the existing literature that the model structure should be considered thoroughly and can greatly influence cost-effectiveness results. Justification for the choice of model structure was limited and studies would be improved with a thorough rationale for this choice. The strengths and weaknesses of each approach should be considered by future researchers. Alternative methods (such as multi-state modelling) are likely to be utilised more frequently in the future, and so justification of these more advanced methods is paramount to their acceptability to inform healthcare decision making.Electronic supplementary materialThe online version of this article (10.1007/s40258-019-00513-3) contains supplementary material, which is available to authorized users.

Background Metastatic Merkel cell carcinoma (mMCC) is a rare and aggressive skin cancer. Until recently, there were no licensed treatment options for patients with mMCC, and prognosis was poor. A cost-effectiveness analysis was conducted for avelumab, a newly available treatment option for mMCC, versus standard care (SC), from a UK National Health Service perspective. Methods A partitioned survival model was developed to assess the lifetime costs and effects of avelumab versus SC. Data from the JAVELIN Merkel 200 trial (NCT02155647) were used to inform estimates of quality-adjusted life-years (QALYs). Unit costs and associated frequencies of use were informed by published literature and clinical expert opinion. Results were presented as incremental cost-effectiveness ratios (ICERs, i.e. the cost per QALY gained) for treatment-experienced (TE) and treatment-naïve (TN) patients. Uncertainty was explored through a range of sensitivity analyses. Results Discounting costs and QALYs at 3.5% per annum, avelumab was associated with ICERs of £35,274 (TE)/£39,178 (TN) per QALY gained. Probabilistic sensitivity analysis results demonstrated that avelumab was associated with an 88.3% (TE)/69.3% (TN) probability of being cost effective at a willingness-to-pay threshold for end-of-life treatments of £50,000 per QALY gained. Results were most sensitive to alternative survival extrapolations and dosing assumptions. Conclusions The analysis results suggest that avelumab is likely to be a cost-effective treatment option for UK mMCC patients. The results for TN patients are subject to some uncertainty, and a confirmatory analysis will be conducted with more mature data.