Background: Implementation fidelity refers to the degree to which an intervention or programme is delivered as intended. Only by understanding and measuring whether an intervention has been implemented with fidelity can researchers and practitioners gain a better understanding of how and why an intervention works, and the extent to which outcomes can be improved.

BackgroundFollowing publication of the first worked example of the “best fit” method of evidence synthesis for the systematic review of qualitative evidence in this journal, the originators of the method identified a need to specify more fully some aspects of this particular derivative of framework synthesis.Methods and ResultsWe therefore present a second such worked example in which all techniques are defined and explained, and their appropriateness is assessed. Specified features of the method include the development of new techniques to identify theories in a systematic manner; the creation of an a priori framework for the synthesis; and the “testing” of the synthesis. An innovative combination of existing methods of quality assessment, analysis and synthesis is used to complete the process. This second worked example was a qualitative evidence synthesis of employees’ views of workplace smoking cessation interventions, in which the “best fit” method was found to be practical and fit for purpose.ConclusionsThe method is suited to producing context-specific conceptual models for describing or explaining the decision-making and health behaviours of patients and other groups. It offers a pragmatic means of conducting rapid qualitative evidence synthesis and generating programme theories relating to intervention effectiveness, which might be of relevance both to researchers and policy-makers.

Stakeholder participation and work modification are more effective and cost effective at returning to work adults with musculoskeletal conditions than other workplace-linked interventions, including exercise.

BackgroundThe Patient Assessment of Chronic Illness Care (PACIC) is a US measure of chronic illness quality of care, based on the influential Chronic Care Model (CCM). It measures a number of aspects of care, including patient activation; delivery system design and decision support; goal setting and tailoring; problem-solving and contextual counselling; follow-up and coordination. Although there is developing evidence of the utility of the scale, there is little evidence about its performance in the United Kingdom (UK). We present preliminary data on the psychometric performance of the PACIC in a large sample of UK patients with long-term conditions.MethodWe collected PACIC, demographic, clinical and quality of care data from patients with long-term conditions across 38 general practices, as part of a wider longitudinal study. We assess rates of missing data, present descriptive and distributional data, assess internal consistency, and test validity through confirmatory factor analysis, and through associations between PACIC scores, patient characteristics and related measures.ResultsThere was evidence that rates of missing data were high on PACIC (9.6% - 15.9%), and higher than on other scales used in the same survey. Most PACIC sub-scales showed reasonable levels of internal consistency (alpha = 0.68 – 0.94), responses did not demonstrate high skewness levels, and floor effects were more frequent (up to 30.4% on the follow up and co-ordination subscale) than ceiling effects (generally <5%). PACIC demonstrated preliminary evidence of validity in terms of measures of long-term condition care. Confirmatory factor analysis suggested that the five factor PACIC structure proposed by the scale developers did not fit the data: reporting separate factor scores may not always be appropriate.ConclusionThe importance of improving care for long-term conditions means that the development and validation of measures is a priority. The PACIC scale has demonstrated potential utility in this regard, but further assessment is required to assess low levels of completion of the scale, and to explore the performance of the scale in predicting outcomes and assessing the effects of interventions.

BackgroundRandomized controlled trials play a central role in evidence-based practice, but recruitment of participants, and retention of them once in the trial, is challenging. Moreover, there is a dearth of evidence that research teams can use to inform the development of their recruitment and retention strategies. As with other healthcare initiatives, the fairest test of the effectiveness of a recruitment strategy is a trial comparing alternatives, which for recruitment would mean embedding a recruitment trial within an ongoing host trial. Systematic reviews indicate that such studies are rare. Embedded trials are largely delivered in an ad hoc way, with interventions almost always developed in isolation and tested in the context of a single host trial, limiting their ability to contribute to a body of evidence with regard to a single recruitment intervention and to researchers working in different contexts.Methods/DesignThe Systematic Techniques for Assisting Recruitment to Trials (START) program is funded by the United Kingdom Medical Research Council (MRC) Methodology Research Programme to support the routine adoption of embedded trials to test standardized recruitment interventions across ongoing host trials. To achieve this aim, the program involves three interrelated work packages: (1) methodology - to develop guidelines for the design, analysis and reporting of embedded recruitment studies; (2) interventions - to develop effective and useful recruitment interventions; and (3) implementation - to recruit host trials and test interventions through embedded studies.DiscussionSuccessful completion of the START program will provide a model for a platform for the wider trials community to use to evaluate recruitment interventions or, potentially, other types of intervention linked to trial conduct. It will also increase the evidence base for two types of recruitment intervention.Trial registrationThe START protocol covers the methodology for embedded trials. Each embedded trial is registered separately or as a substudy of the host trial.

BackgroundPatient understanding of study information is fundamental to gaining informed consent to take part in a randomised controlled trial. In order to meet the requirements of research ethics committees, patient information materials can be long and need to communicate complex messages. There is concern that standard approaches to providing patient information may deter potential participants from taking part in trials. The Systematic Techniques for Assisting Recruitment to Trials (MRC-START) research programme aims to test interventions to improve trial recruitment. The aim of this study was to investigate the effect on recruitment of optimised patient information materials (with improved readability and ease of comprehension) compared with standard materials. The study was embedded within two primary care trials involving patients with long-term conditions.MethodsThe Healthlines Study involves two linked trials evaluating a telehealth intervention in patients with depression (Healthlines Depression) or raised cardiovascular disease risk (Healthlines CVD). We conducted two trials of a recruitment intervention, embedded within the Healthlines host trials. Patients identified as potentially eligible in each of the Healthlines trials were randomised to receive either the original patient information materials or optimised versions of these materials. Primary outcomes were the proportion of participants randomised (Healthlines Depression) and the proportion expressing interest in taking part (Healthlines CVD).ResultsIn Healthlines Depression (n = 1364), 6.3 % of patients receiving the optimised patient information materials were randomised into the study compared to 4.0 % in those receiving standard materials (OR = 1.63, 95 % CI = 1.00 to 2.67). In Healthlines CVD (n = 671) 24.0 % of those receiving optimised patient information materials responded positively to the invitation to participate, compared to 21.9 % in those receiving standard materials (OR = 1.12, 95 % CI = 0.78 to 1.61).ConclusionsEvidence from these two embedded trials suggests limited benefits of optimised patient information materials on recruitment rates, which may only be apparent in some patient populations, with no effects on other outcomes. Further embedded trials are needed to provide a more precise estimate of effect, and to explore further how effects vary by trial context, intervention, and patient population.Trial registrationCurrent Controlled Trials: Healthlines Depression (ISRCTN27508731) on 26 June 2012; and Healthlines CVD (ISRCTN14172341) on 5 July 2012Electronic supplementary materialThe online version of this article (doi:10.1186/s13063-015-0820-0) contains supplementary material, which is available to authorized users.

How to obtain copies of this and other HTA programme reports An electronic version of this title, in Adobe Acrobat format, is available for downloading free of charge for personal use from the HTA website (www.hta.ac.uk). A fully searchable DVD is also available (see below).Printed copies of HTA journal series issues cost £20 each (post and packing free in the UK) to both public and private sector purchasers from our despatch agents.Non-UK purchasers will have to pay a small fee for post and packing. For European countries the cost is £2 per issue and for the rest of the world £3 per issue. How to order:-fax (with credit card details) -post (with credit card details or cheque) -phone during office hours (credit card only).Additionally the HTA website allows you to either print out your order or download a blank order form. Contact details are as follows:Synergie UK (HTA Department) Digital House, The Loddon Centre Wade Road Basingstoke Hants RG24 8QW Email: orders@hta.ac.uk Tel: 0845 812 4000 -ask for 'HTA Payment Services' (out-of-hours answer-phone service) Fax: 0845 812 4001 -put 'HTA Order' on the fax header Payment methods Paying by chequeIf you pay by cheque, the cheque must be in pounds sterling, made payable to University of Southampton and drawn on a bank with a UK address. Paying by credit cardYou can order using your credit card by phone, fax or post. SubscriptionsNHS libraries can subscribe free of charge. Public libraries can subscribe at a reduced cost of £100 for each volume (normally comprising 40-50 titles). The commercial subscription rate is £400 per volume (addresses within the UK) and £600 per volume (addresses outside the UK). Please see our website for details. Subscriptions can be purchased only for the current or forthcoming volume. How do I get a copy of HTA on DVD?Please use the form on the HTA website (www.hta.ac.uk/htacd/index.shtml). HTA on DVD is currently free of charge worldwide.The website also provides information about the HTA programme and lists the membership of the various committees. HTA NIHR Health Technology Assessment programmeT he Health Technology Assessment (HTA) programme, part of the National Institute for Health Research (NIHR), was set up in 1993. It produces high-quality research information on the effectiveness, costs and broader impact of health technologies for those who use, manage and provide care in the NHS. 'Health technologies' are broadly defined as all interventions used to promote health, prevent and treat disease, and improve rehabilitation and long-term care. The research findings from the HTA programme directly influence decision-making bodies such as the National Institute for Health and Clinical Excellence (NICE) and the National Screening Committee (NSC). HTA findings also help to improve the quality of clinical practice in the NHS indirectly in that they form a key component of the 'National Knowledge Service'. The HTA programme is needs led in that it fills gaps in the evidence needed by the NHS. There are three routes to the start of project...

No abstract