Background: Immune-checkpoint inhibitors may provide long-term survival benefits via a cured proportion, yet data are usually insufficient to prove this upon submission to health technology assessment bodies. Objective: We revisited the National Institute for Health and Care Excellence assessment of ipilimumab in melanoma (TA319). We used updated data from the pivotal trial to assess the accuracy of the extrapolation methods used and compared these to previously unused techniques to establish whether an alternative extrapolation may have provided more accurate survival projections. Methods: We compared projections from the piecewise survival model used in TA319 and those produced by alternative models (fit to trial data with minimum follow-up of 3 years) to a longer-term data cut (5-year follow-up). We also compared projections to external data to help assess validity. Alternative approaches considered were parametric, spline-based, mixture, and mixture-cure models. Results: Only the survival model used in TA319 and a mixture-cure model provided 5-year survival predictions close to those observed in the 5-year follow-up data set. Standard parametric, spline, and nonecurativemixture models substantially underestimated 5-year survival. Survival estimates from the TA319 model and the mixture-cure model diverge considerably after 5 years and remain unvalidated. Conclusions: In our case study, only models that incorporated an element of external information (through a cure fraction combined with background mortality rates or using registry data) provided accurate estimates of 5-year survival. Flexible models that were able to capture the complex hazard functions observed during the trial, but which did not incorporate external information, extrapolated poorly.

Objectives. In June 2011, the National Institute for Health and Care Excellence (NICE) Decision Support Unit published a Technical Support Document (TSD) providing recommendations on survival analysis for NICE technology appraisals (TAs). Survival analysis outputs are influential inputs into economic models estimating the cost-effectiveness of new cancer treatments. Hence, it is important that systematic and justifiable model selection approaches are used. This study investigates the extent to which the TSD recommendations have been followed since its publication. Methods. We reviewed NICE cancer TAs completed between July 2011 and July 2017. Information on survival analyses undertaken and associated critiques for overall survival (OS) and progression-free survival were extracted from the company submissions, Evidence Review Group (ERG) reports, and final appraisal determination documents. Results. Information was extracted from 58 TAs. Only 4 (7%) followed all TSD recommendations for OS outcomes. The vast majority (91%) compared a range of common parametric models and assessed their fit to the data (86%). Only a minority of TAs included an assessment of the shape of the hazard function (38%) or proportional hazards assumption (40%). Validation of the extrapolated portion of the survival function using external data was attempted in a minority of TAs (40%). Extrapolated survival functions were frequently criticized by ERGs (71%). Conclusions. Survival analysis within NICE TAs remains suboptimal, despite publication of the TSD. Model selection is not undertaken in a systematic way, resulting in inconsistencies between TAs. More attention needs to be given to assessing hazard functions and validation of extrapolated survival functions. Novel methods not described in the TSD have been used, particularly in the context of immuno-oncology, suggesting that an updated TSD may be of value.

Background The NHS emergency and urgent care system is under pressure as demand for services increases each year. NHS 111 is a telephone triage service designed to provide advice and signposting to appropriate services for people with urgent health-care problems. A new service, NHS 111 Online, has been introduced across England as a digital alternative that can be accessed using a website or a smartphone application. The effects and usefulness of this service are unknown. Objectives To explore the impact of NHS 111 Online on the related telephone service and urgent care system activity and the experiences of people who use those services. Design and methods A mixed-methods design of five related work packages comprising an evidence review; a quantitative before-and-after time series analysis of changes in call activity (18/38 sites); a descriptive comparison of telephone and online services with qualitative survey (telephone, n = 795; online, n = 3728) and interview (32 participants) studies of service users; a qualitative interview study (16 participants) of staff; and a cost–consequences analysis. Results The online service had little impact on the number of triaged calls to the NHS 111 telephone service. For every 1000 online contacts, triaged telephone calls increased by 1.3% (1.013, 95% confidence interval 0.996 to 1.029; p = 0.127). Recommendations to attend emergency and urgent care services increased between 6.7% and 4.2%. NHS 111 Online users were less satisfied than users of the telephone service (50% vs. 71%; p < 0.001), and less likely to recommend to others (57% vs. 69%; p < 0.001) and to report full compliance with the advice given (67.5% vs. 88%; p < 0.001). Online users were less likely to report contacting emergency services and more likely to report not making any contact with a health service (31% vs. 16%; p < 0.001) within 7 days of contact. Thirty-five per cent of online users reported that they did not want to use the telephone service, whereas others preferred its convenience and speed. NHS 111 telephone staff reported no discernible increase or decrease in their workload during the first year of operation of NHS 111 Online. If online and telephone services operate in parallel, then the annual costs will be higher unless ≥ 38% of telephone contacts move to online contacts. Conclusions There is some evidence that the new service has the potential to create new demand. The service has expanded significantly, so it is important to find ways of promoting the right balance in numbers of people who use the online service instead of the telephone service if it is to be effective. There is a clear need and preference by some people for an online service. Better information about when to use this service and improvements to questioning may encourage more uptake. Limitations The lack of control arm means that impact could have been an effect of other factors. This work took place during the early implementation phase, so findings may change as the service expands. Future work Further development of the online triage process to make it more ‘user friendly’ and to enable users to trust the advice given online could improve use and increase satisfaction. Better understanding of the characteristics of the telephone and online populations could help identify who is most likely to benefit and could improve information about when to use the service. Trial registration Current Controlled Trials ISRCTN51801112. Funding This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 9, No. 21. See the NIHR Journals Library website for further project information.

Background. After failure of first-line antiretroviral therapy (ART) in the public sector, delayed or missed second-line ART switch is linked with poor outcomes in patients with advanced HIV. Setting:We investigated delayed or missed second-line ART switch following confirmed virologic failure in the largest private sector HIV cohort in Africa.Methods. We included HIV-infected adults with confirmed virologic failure after six months of non-nucleoside reverse-transcriptase inhibitor-based ART. We estimated the effect of timing of switch on the hazard of death using inverse probability of treatment weighting of marginal structural models. We adjusted for time-dependent confounding of CD4 count, viral load, and visit frequency. Results. 5748 patients (53% female) with confirmed virologic failure met inclusion criteria; the median age was 40 (interquartile range [IQR]: 35 -47), advanced HIV was present in 48% and the prior duration of NNRTI-based ART was 1083 days (IQR: 665-1770). Median time to confirmation of virologic failure and to second-line switch was 196 (IQR: 136-316) and 220 days (IQR: 65-542), respectively. Switching to second-line ART after confirmed failure compared to remaining on first-line ART reduced risk of subsequent death [aHR: 0.47 (95% CI: 0.36-0.63)].Compared to patients who experienced delayed switch, those switched immediately had a lower risk of death, regardless of CD4 cell count.

BackgroundAmbulance service quality measures have focused on response times and a small number of emergency conditions, such as cardiac arrest. These quality measures do not reflect the care for the wide range of problems that ambulance services respond to and the Prehospital Outcomes for Evidence Based Evaluation (PhOEBE) programme sought to address this.ObjectivesThe aim was to develop new ways of measuring the impact of ambulance service care by reviewing and synthesising literature on prehospital ambulance outcome measures and using consensus methods to identify measures for further development; creating a data set linking routinely collected ambulance service, hospital and mortality data; and using the linked data to explore the development of case-mix adjustment models to assess differences or changes in processes and outcomes resulting from ambulance service care.DesignA mixed-methods study using a systematic review and synthesis of performance and outcome measures reported in policy and research literature; qualitative interviews with ambulance service users; a three-stage consensus process to identify candidate indicators; the creation of a data set linking ambulance, hospital and mortality data; and statistical modelling of the linked data set to produce novel case-mix adjustment measures of ambulance service quality.SettingEast Midlands and Yorkshire, England.ParticipantsAmbulance services, patients, public, emergency care clinical academics, commissioners and policy-makers between 2011 and 2015.InterventionsNone.Main outcome measuresAmbulance performance and quality measures.Data sourcesAmbulance call-and-dispatch and electronic patient report forms, Hospital Episode Statistics, accident and emergency and inpatient data, and Office for National Statistics mortality data.ResultsSeventy-two candidate measures were generated from systematic reviews in four categories: (1) ambulance service operations (n = 14), (2) clinical management of patients (n = 20), (3) impact of care on patients (n = 9) and (4) time measures (n = 29). The most common operations measures were call triage accuracy; clinical management was adherence to care protocols, and for patient outcome it was survival measures. Excluding time measures, nine measures were highly prioritised by participants taking part in the consensus event, including measures relating to pain, patient experience, accuracy of dispatch decisions and patient safety. Twenty experts participated in two Delphi rounds to refine and prioritise measures and 20 measures scored ≥ 8/9 points, which indicated good consensus. Eighteen patient and public representatives attending a consensus workshop identified six measures as important: time to definitive care, response time, reduction in pain score, calls correctly prioritised to appropriate levels of response, proportion of patients with a specific condition who are treated in accordance with established guidelines, and survival to hospital discharge for treatable emergency conditions. From this we developed six new potential indicators using the linked data set, of which five were constructed using case-mix-adjusted predictive models: (1) mean change in pain score; (2) proportion of serious emergency conditions correctly identified at the time of the 999 call; (3) response time (unadjusted); (4) proportion of decisions to leave a patient at scene that were potentially inappropriate; (5) proportion of patients transported to the emergency department by 999 emergency ambulance who did not require treatment or investigation(s); and (6) proportion of ambulance patients with a serious emergency condition who survive to admission, and to 7 days post admission. Two indicators (pain score and response times) did not need case-mix adjustment. Among the four adjusted indicators, we found that accuracy of call triage was 61%, rate of potentially inappropriate decisions to leave at home was 5–10%, unnecessary transport to hospital was 1.7–19.2% and survival to hospital admission was 89.5–96.4% depending on Clinical Commissioning Group area. We were unable to complete a fourth objective to test the indicators in use because of delays in obtaining data. An economic analysis using indicators (4) and (5) showed that incorrect decisions resulted in higher costs.LimitationsCreation of a linked data set was complex and time-consuming and data quality was variable. Construction of the indicators was also complex and revealed the effects of other services on outcome, which limits comparisons between services.ConclusionsWe identified and prioritised, through consensus processes, a set of potential ambulance service quality measures that reflected preferences of services and users. Together, these encompass a broad range of domains relevant to the population using the emergency ambulance service. The quality measures can be used to compare ambulance services or regions or measure performance over time if there are improvements in mechanisms for linking data across services.Future workThe new measures can be used to assess different dimensions of ambulance service delivery but current data challenges prohibit routine use. There are opportunities to improve data linkage processes and to further develop, validate and simplify these measures.FundingThe National Institute for Health Research Programme Grants for Applied Research programme.

Little is known about the functional relationship of delaying second-line treatment initiation for human immunodeficiency virus–positive patients and mortality, given a patient’s immune status. We included 7,255 patients starting antiretroviral therapy during 2004–2017, from 9 South African cohorts, with virological failure and complete baseline data. We estimated the impact of switch time on the hazard of death using inverse probability of treatment weighting of marginal structural models. The nonlinear relationship between month of switch and the 5-year survival probability, stratified by CD4 count at failure, was estimated with targeted maximum likelihood estimation. We adjusted for measured time-varying confounding by CD4 count, viral load, and visit frequency. Five-year mortality was estimated to be 10.5% (95% CI: 2.2, 18.8) for immediate switch and to be 26.6% (95% CI: 20.9, 32.3) for no switch (51.1% if CD4 count was &lt;100 cells/mm3). The hazard of death was estimated to be 0.37 (95% CI: 0.30, 0.46) times lower if everyone had been switched immediately compared with never. The shorter the delay in switching, the lower the hazard of death—delaying 30–59 days reduced the hazard by 0.53 (95% CI: 0.43, 0.65) times and 60–119 days by 0.58 (95% CI: 0.49, 0.69) times, compared with no switch. Early treatment switch is particularly important for patients with low CD4 counts at failure.

Objective. SPIRIT 2 is the largest phase 3 prospective randomized open-label trial comparing imatinib (I) 400mg with dasatinib (D) 100mg daily in newly diagnosed chronic phase CML. The primary endpoint was 5 year event-free survival. Methods. 812 (406 in each arm) of 814 patients recruited started study medication (median age 53.2, 275/812 (33.8%) were over 60 years old). Patients were recruited at 144 hospitals between August 2008 and March 2013 and randomized to receive either imatinib 400mg or dasatinib 100mg daily. Secondary endpoints included overall survival, rates of treatment failure, cytogenetic/molecular response - RT-PCR BCR-ABL/ABL ratio of <0.1%IS(major molecular response (MMR), 3 log reduction, MR3) and deeper. To address the potential confounding effect on the primary endpoint of patients switching from randomized treatment to an alternative TKI or other treatment, exploratory per-protocol analyses were performed using the inverse probability of censoring weighting (IPCW) method.Results. All patients have now completed 5 years of follow-up. 424/812 (52.2%) patients completed the study whilst still taking first line medication: 230/406 (56.7%) on dasatinib, 194/406 (47.8%) on imatinib. Of the patients who discontinued first line therapy, more patients on the imatinib arm switched due to suboptimal PCR response (as decided by the local investigator) than on dasatinib (D7/406, 1.7%; I71/406, 17.4%) but more patients on the dasatinib arm discontinued due to intolerance (D123/406, 30.3%; I68/406, 16.7%). More patients went on to transplant in the imatinib arm than in the dasatinib arm (D 6/406, 1.5%; I 30/406 7.6%) and in the imatinib patients undergoing transplant the reason for first line treatment failure was disease progression in 5/30 and suboptimal molecular response in 11/30. Using an intention to treat analysis cumulative incidence of MR3 and MR4 on first line therapy within 5 years was higher in the dasatinib arm than the imatinib arm (MR3: D 83.0%, I 63.0% - difference 20.0%, p<0.0001; MR4: D 77.5%, I 57.2% - difference 20.3%, p<0.0001).At 24 months the complete cytogenetic response rate was D 42.6%, I 31.8% - difference 10.8%, Chi-square test p=0.001.At 5 years the probability of treatment failure-free survival was higher with dasatinib than imatinib(D60.9%, I52.9% - HR: 0.73 (95%-CI:0.59-0.90), p=0.004) but there were no significant differences in event free survival (D91.0%, I89.0% - HR:0.80 (95%-CI:0.51-1.25), p=0.319) or overall survival (D91.9%, I91.2% - HR: 0.90 (95%-CI:0.56-1.47), p=0.690). IPCW modelling results will be presented at the meeting.The overall rate of pleural effusion over 5 years in the dasatinib arm was 36.0% with a higher incidence in older patients. 13 patients developed their first pleural effusion after 3 years on study. Conclusions. In SPIRIT 2 we observed a higher molecular and cytogenetic response rate and also a higher pleural effusion rate with dasatinib but a higher treatment failure rate with imatinib often because investigators were concerned about sub-optimal PCR responses. More imatinib-treated patients proceeded to transplant. There were no statistically significant differences in event free survival (the primary endpoint) or overall survival. Imatinib remains a highly effective first line therapy though subgroup analyses are planned to explore whether dasatinib may have advantages in particular clinical scenarios. Disclosures O'Brien: Bristol Myers Squibb: Research Funding; CTI: Other: Chair of Independent Data Monitoring Committee; National Institute for Health and Care Excellence (NICE): Other: Chair of Technology Appraisal Committee. Osborne:Servier: Honoraria; Pfizer: Honoraria; Takeda: Honoraria; MSD: Honoraria; Roche: Honoraria; Novartis: Honoraria. Bell-Gorrod:Bristol-Myers Squibb: Consultancy; Merck EDM Serono: Consultancy; PharmaMar: Consultancy; Novartis: Consultancy; GlaxoSmithKline: Consultancy. Latimer:Pfizer: Consultancy; BMS: Consultancy; Merck: Consultancy; Astra Zeneca: Consultancy; Bluebirdbio: Consultancy; Janssen: Consultancy. Apperley:Incyte: Honoraria, Speakers Bureau; BMS: Honoraria, Speakers Bureau; Pfizer: Honoraria, Speakers Bureau; Novartis: Honoraria, Research Funding, Speakers Bureau. Byrne:Novartis: Consultancy, Speakers Bureau; BMS: Consultancy, Speakers Bureau. Pocock:Kent & Canterbury Hospital: Employment. Copland:Incyte: Consultancy, Honoraria, Membership on an entity's Board of Directors or advisory committees, Research Funding, Speakers Bureau; Pfizer: Honoraria, Membership on an entity's Board of Directors or advisory committees, Speakers Bureau; Novartis: Consultancy, Honoraria, Membership on an entity's Board of Directors or advisory committees, Research Funding, Speakers Bureau; Bristol-Myers Squibb: Consultancy, Honoraria, Membership on an entity's Board of Directors or advisory committees, Research Funding, Speakers Bureau. Clark:Ariad/Incyte: Consultancy; Pfizer: Consultancy, Research Funding; Bristol Myers Squibb: Consultancy, Research Funding; Novartis: Consultancy, Research Funding.

Objectives: Statistical methods to adjust for treatment switching are commonly applied to randomized controlled trials (RCTs) in oncology. Nevertheless, RCTs with extension studies incorporating nonrandomized dropout require consideration of alternative adjustment methods. The current study used a recognized method and a novel method to adjust for treatment switching in relapsing-remitting multiple sclerosis (MS).Methods: The Cladribine Tablets Treating Multiple Sclerosis Orally (CLARITY) RCT evaluated the efficacy of cladribine versus placebo over 96 weeks. Many (but not all) CLARITY participants enrolled in the 96-week CLARITY extension study; placebotreated patients from CLARITY received cladribine (PP/LL), and cladribine-treated patients were re-randomized to placebo (LL/PP) or continued cladribine (LL/LL). End points were time to first qualifying relapse (FQR) and time to 3-month and 6month confirmed disability progression (3mCDP, 6mCDP). We aimed to estimate the effectiveness of the LL/PP treatment strategy compared with a counterfactual (unobserved) PP/PP strategy. We applied the commonly used rank-preserving structural failure time model (RPSFTM) and a novel approach that combined propensity score matching (PSM) with inverse probability of censoring weights (IPCW). Results:The RPSFTM resulted in LL/PP versus PP/PP hazard ratios (HRs) of 0.48 (95% confidence interval [CI] 0.36-0.62) for FQR, 0.62 (95% CI 0.46-0.84) for 3mCDP, and 0.62 (95% CI 0.44-0.88) for 6mCDP. The PSM1IPCW resulted in HRs of 0.47 (95% CI 0.38-0.63) for FQR, 0.61 (95% CI 0.43-0.86) for 3mCDP, and 0.63 (95% CI 0.40-0.87) for 6mCDP. Conclusions:The PSM1IPCW HRs were consistent with those from the RPSFTM, suggesting that the results were not substantially biased by informative dropout, assuming that all relevant confounders were controlled for. There was no statistical evidence of a reduction in the cladribine treatment effect during the extension period.