Background
In clinical trials, study designs may focus on assessment of superiority, equivalence, or non-inferiority, of a new medicine or treatment as compared to a control. Typically, evidence in each of these paradigms is quantified with a variant of the null hypothesis significance test. A null hypothesis is assumed (null effect, inferior by a specific amount, inferior by a specific amount
and
superior by a specific amount, for superiority, non-inferiority, and equivalence respectively), after which the probabilities of obtaining data more extreme than those observed under these null hypotheses are quantified by
p
-values. Although ubiquitous in clinical testing, the null hypothesis significance test can lead to a number of difficulties in interpretation of the results of the statistical evidence.
Methods
We advocate quantifying evidence instead by means of Bayes factors and highlight how these can be calculated for different types of research design.
Results
We illustrate Bayes factors in practice with reanalyses of data from existing published studies.
Conclusions
Bayes factors for superiority, non-inferiority, and equivalence designs allow for explicit quantification of evidence in favor of the null hypothesis. They also allow for interim testing without the need to employ explicit corrections for multiple testing.
Efficient medical progress requires that we know when a treatment effect is absent. We considered all 207 Original Articles published in the 2015 volume of the New England Journal of Medicine and found that 45 (21.7%) reported a null result for at least one of the primary outcome measures. Unfortunately, standard statistical analyses are unable to quantify the degree to which these null results actually support the null hypothesis. Such quantification is possible, however, by conducting a Bayesian hypothesis test. Here we reanalyzed a subset of 43 null results from 36 articles using a default Bayesian test for contingency tables. This Bayesian reanalysis revealed that, on average, the reported null results provided strong evidence for the absence of an effect. However, the degree of this evidence is variable and cannot be reliably predicted from the p-value. For null results, sample size is a better (albeit imperfect) predictor for the strength of evidence in favor of the null hypothesis. Together, our findings suggest that (a) the reported null results generally correspond to strong evidence in favor of the null hypothesis; (b) a Bayesian hypothesis test can provide additional information to assist the interpretation of null results.
Background
It has been claimed that functional somatic syndromes share a common etiology. This prospective population-based study assessed whether the same variables predict new onsets of irritable bowel syndrome (IBS), chronic fatigue syndrome (CFS) and fibromyalgia (FM).
Methods
The study included 152 180 adults in the Dutch Lifelines study who reported the presence/absence of relevant syndromes at baseline and follow-up. They were screened at baseline for physical and psychological disorders, socio-demographic, psycho-social and behavioral variables. At follow-up (mean 2.4 years) new onsets of each syndrome were identified by self-report. We performed separate analyses for the three syndromes including participants free of the relevant syndrome or its key symptom at baseline. LASSO logistic regressions were applied to identify which of the 102 baseline variables predicted new onsets of each syndrome.
Results
There were 1595 (1.2%), 296 (0.2%) and 692 (0.5%) new onsets of IBS, CFS, and FM, respectively. LASSO logistic regression selected 26, 7 and 19 predictors for IBS, CFS and FM, respectively. Four predictors were shared by all three syndromes, four predicted IBS and FM and two predicted IBS and CFS but 28 predictors were specific to a single syndrome. CFS was more distinct from IBS and FM, which predicted each other.
Conclusions
Syndrome-specific predictors were more common than shared ones and these predictors might form a better starting point to unravel the heterogeneous etiologies of these syndromes than the current approach based on symptom patterns. The close relationship between IBS and FM is striking and requires further research.
The results illustrate the importance of considering both the effect size and the evidence-load when judging the efficacy of a treatment. In doing so, the currently employed Bayesian approach provided clear insights on top of those gained with traditional approaches.
Functional Somatic Symptoms (FSS) are somatic symptoms for which no somatic cause can be identified despite adequate diagnostic testing. FSS are common, costly, and disabling, and treatment options are limited.Psychotherapy is one of few evidence-based treatments for FSS. Yet, this form of therapy is not widely used, since it is usually reserved for severe symptoms, requires a highly trained therapist, and is not well accepted by patients.The current paper describes the development of the online intervention ‘Grip self-help’ and provides a description of the intervention itself. Grip self-help is an early intervention for mild to moderate FSS in primary care, which aims to reduce somatic symptoms and improve quality of life.In the Grip self-help intervention, patients fill out a set of online questionnaires exploring unhelpful cognitions, emotions, behaviors, and social factors associated with the symptoms. Using this information, a personal profile is generated, identifying factors that might maintain FSS in that individual. As a next step, patients are offered online self-help exercises that are tailored to these factors. Guidance is offered by a primary care professional. The intervention will ultimately result in a personalized self-help guide, composed of texts that are extracted from the exercises patients found useful during the intervention.Grip self-help is the first intervention for FSS combining the concepts of e-health, self-help, and personalized medicine. Guided by a primary care professional, patients are offered an easily accessible, yet highly personalized treatment. Grip self-help thus has the potential to meet the needs of the large group of patients with mild to moderate FSS.
More than 40 questionnaires have been developed to assess functional somatic symptoms (FSS), but there are several methodological issues regarding the measurement of FSS. We aimed to identify which items of the somatization subscale of the Symptom Checklist–90 (SCL-90) are more informative and discriminative between persons at different levels of severity of FSS. To this end, item response theory was applied to the somatization scale of the SCL-90, collected from a sample of 82,740 adult participants without somatic conditions in the Lifelines Cohort Study. Sensitivity analyses were performed with all the participants who completed the somatization scale. Both analyses showed that Items 11 “feeling weak physically” and 12 “heavy feelings in arms or legs” were the most discriminative and informative to measure severity levels of FSS, regardless of somatic conditions. Clinicians and researchers may pay extra attention to these symptoms to augment the assessment of FSS.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.