It is not unexpected that apps contained only minimal theoretical content, given that app developers come from a variety of backgrounds and many are not trained in the application of health behavior theory. The relationship between price and theory score corroborates research indicating that higher quality apps are more expensive. There is an opportunity for health and behavior change experts to partner with app developers to incorporate behavior change theories into the development of apps. These future collaborations between health behavior change experts and app developers could foster apps superior in both theory and programming possibly resulting in better health outcomes.

Many of these reviews reported following published guidelines such as PRISMA or MOOSE, yet only half appropriately addressed publication bias in their reviews. Compared with previous research, our study found fewer reviews assessing publication bias and greater likelihood of publication bias among reviews not performing these evaluations.

SummaryThe validity of primary study results included in systematic reviews plays an important role in drawing conclusions about intervention effectiveness and carries implications for clinical decision-making. We evaluated the prevalence of methodological quality and risk of bias assessments in systematic reviews published in the five highest-ranked anaesthesia journals since 2007. The initial PubMed search yielded 315 citations, and our final sample after screening consisted of 207 systematic reviews. One hundred and seventy-four reviews conducted methodological quality/risk of bias analyses. The Jadad scale was most frequently used. Forty-four of the 83 reviews that included high risk of bias studies re-analysed their data omitting these trials: 20 showed differences in pooled effect estimates. Reviews containing a greater number of primary studies evaluated quality less frequently than smaller reviews. Overall, the majority of reviews evaluated bias; however, many applied questionable methods. Given the potential effects of bias on summary outcomes, greater attention is warranted.

Systematic reviews of postoperative pain in children have called into question the consistency of outcomes measured by clinical triallists as well as the measurement instruments used for assessment. Core outcome set methodology may be a solution to improve standardisation. This study provides an evidence-based foundation for the development of a core outcome set for paediatric postoperative pain studies. We searched ClinicalTrials.gov to identify relevant postoperative pain studies in children. The search yielded 300 registered trials. The following data were then extracted from each of the trials: phase of trial; study type; study design; sample size; all outcomes; whether the outcome was listed as primary, secondary, or tertiary; the measurement instrument for each reported outcome; the specific metric for each outcome; and the type of clinical procedure. Following screening, 134 studies were included in our study. Pain measurement was the most commonly reported outcome (n = 123), followed by total postoperative analgesic dosage (n = 83) and side-effects (n = 25). Temporal trends indicated that pain assessment and unexpected events increased in use between 2000 and 2016, whereas postoperative analgesia measurement decreased. We found a lack of standardisation among outcomes and measurement instruments in paediatric postoperative pain studies. Development of a core outcome set may improve the quality of future trials and allow for more accurate study-to-study comparisons.

Heterogeneity among the primary studies included in a systematic review (SR) is one of the most challenging considerations for systematic reviewers. Current practices in anaesthesiology SRs have not been evaluated, but traditional methods may not provide sufficient information to evaluate the true nature of these differences. We address these issues by examining the practices for evaluating heterogeneity in anesthesiology reviews. Also, we propose a mapping method for presenting heterogeneous aspects of the primary studies in SRs.We evaluated heterogeneity practices reported in SRs published in highly ranked anesthesiology journals and Cochrane reviews. Elements extracted from the SRs included heterogeneity tests, models used, analyses conducted, plots used, and I2 values. Additionally, we selected a SR to develop an evidence map in order to display clinical heterogeneity.Our statistical analysis showed 150/207 SRs reporting a test for statistical heterogeneity. Plots were used in 138 reviews to display heterogeneity. Subgroup analyses were the most commonly reported analysis (54%). Meta-regression and sensitivity analyses were used sparingly (25%; 23% respectively). A random effects model was most commonly reported (33%). Heterogeneity statistics across meta-analyses suggested that, in our sample, the majority (55%) did not present sufficient heterogeneity to be of great concern. Cochrane reviews (n=58) were also analysed. Plots were used in 88% of Cochrane reviews. Subgroup analysis was used in 59% Cochrane reviews, while sensitivity analysis was used in 62%.Many reviews did not provide sufficient detail regarding heterogeneity. We are calling for improvement to reporting practices.