Assessing clinical significance using robust normative comparisons

Mangardich, Haykaz; Cribbie, Robert A.

doi:10.1080/10503307.2014.889329

Cited by 5 publications

(4 citation statements)

References 35 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This comparison does not test for elimination of symptoms for the clinical group, but whether the treatment has brought the participants' average level of distress into a range more typical of the general population. Using statistical equivalence testing, Kendall and colleagues (1999) (Cribbie & Arpin-Cribbie, 2009;Mangardich & Cribbie, 2014;Nasiakos, Cribbie, & Arpin-Cribbie, 2010, van Wieringen & Cribbie, 2014. Specifically, Cribbie and Arpin-Cribbie accommodated unequal variances across groups and proposed a new hierarchical procedure for testing normative comparisons.…”

Section: Normative Comparisonsmentioning

confidence: 99%

“…Specifically, Cribbie and Arpin-Cribbie accommodated unequal variances across groups and proposed a new hierarchical procedure for testing normative comparisons. Mangardich and Cribbie (2014) proposed a method of normative comparison that is robust not only to heteroskedasticity, but also to non-normally distributed data (which is often the case in post-treatment samples, and clinical instruments as well). This method (referred to as the Schuirmann-Yuen, or S-Y, method) calculates trimmed means and Winsorized variances, which exclude extreme values from strongly non-normal distributions.…”

Section: Normative Comparisonsmentioning

confidence: 99%

See 1 more Smart Citation

Effectiveness of routine psychotherapy: Method matters

McAleavey¹,

Youn²,

Xiao³

et al. 2017

Preprint

View full text Add to dashboard Cite

Objective: Though many studies have shown that psychotherapy can be effective, psychotherapy available in routine practice may not be adequate. Several methods have been proposed to evaluate routine psychological treatments. The aim of this paper is to demonstrate the combined utility of complementary methods, change-based benchmarking and end-state normative comparisons, across a range of self-reported psychological symptoms. Method: Benchmarks derived from randomized controlled trials (RCTs) and normative comparisons were used to evaluate effectiveness of psychotherapy in a large (N = 9,895) sample of clients in university counseling centers (UCCs). Results: Overall, routine psychotherapy was associated with significant improvement across all symptoms examined. For clients whose initial severity was similar to RCT participants, the observed pre-post effect sizes were equivalent to those in RCTs. However, treatment tended to lead to normative end-state functioning only for those clients who were moderately, but not severely, distressed at the start of psychotherapy. Conclusions: This suggests that although psychotherapy is associated with an effective magnitude of symptom improvement in routine practice, additional services for highly distressed individuals may be necessary. The methods described here comprise a comprehensive analysis of the quality of routine care, and we recommend using both methods in concert.

show abstract

Section: Normative Comparisonsmentioning

confidence: 99%

Section: Normative Comparisonsmentioning

confidence: 99%

Effectiveness of routine psychotherapy: Method matters

McAleavey¹,

Youn²,

Xiao³

et al. 2017

Preprint

View full text Add to dashboard Cite

show abstract

“…In some of these 33 studies, the citation of the term clinical significance was performed without analysis basis and definition of evaluation strategy. This finding refers to the need to prioritize investigations that discuss this type of analysis in the context of nursing practices since statistical significance does not guarantee that the results are clinically meaningful, that is, they may have genuine and applicable effects on patients’ health or health care decisions 25 .…”

Section: Discussionmentioning

confidence: 99%

Jacobson and Truax Method: evaluation of the clinical effectiveness of a home care program after prostatectomy

Mata

Bernardes

Azevedo

et al. 2018

Rev. Latino-Am. Enfermagem

View full text Add to dashboard Cite

Objective:to exemplify the applicability of the Jacobson and Truax Method in a nursing intervention study that analyzed the effectiveness of a home care teaching program after radical prostatectomy. Method:this is a descriptive study concerning the applicability of the Jacobson and Truax Method in the data analysis of a clinical trial. The intervention consisted of a teaching program for hospital discharge after radical prostatectomy through oral guidance, writing, and telephonic reinforcement. Thirty-four men participated in the intervention group and 34 men participated in the control group. A reliable index of change and clinical significance was calculated for the knowledge variable in both groups. Scatterplots were presented to demonstrate the effectiveness of the method. Results:for 30 individuals in the intervention group, the intervention presented clinically relevant change than in knowledge. In the control group, none of the 34 individuals presented clinical significance of the results related to this variable, that is, the statistical significance identified by the inferential tests did not have clinically relevant changes in the knowledge variable. Conclusion:the educational intervention carried out through the combination of oral, written and telephone counseling was shown to be clinically effective in improving knowledge about home care.

show abstract

“…Equivalence testing has a different focus as compared with most methods of clinical significance, in that group change is measured and tested rather than individual change. Several researchers have considered this method of examining clinical significance in more recent studies that assess pre-and posttreatment group equivalence with normative comparison groups (e.g., Mangardich & Cribbie, 2015;van Wieringen & Cribbie, 2014).…”

Section: The Concept Of Clinical Significancementioning

confidence: 99%