Reducing outcome measures in mental health: a systematic review of the methods

Smith, Wayne; Patel, Anita; McCrone, Paul; Jin, Huajie; Osumili, Beatrice; Barrett, Barbara

doi:10.3109/09638237.2015.1101058

Cited by 8 publications

(15 citation statements)

References 40 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…See, also, Boone et al (2014). a modern psychometric method widely used for scale development; and perhaps the only method specifically developed for this purpose (Smith et al 2016). …”

Section: Rasch Analysis 35mentioning

confidence: 99%

“…In CTT, each person is assumed to have an observed score (O) that represents their true score for a trait (T) plus an error term (ε), with O = T + ε. The standard deviation of the errors (the standard error of measurement) is directly related to reliability, with reducing errors moving the observed scores closer to the true scores (Smith et al 2016). However, the deficiencies of traditional methods and additional advantages of modern psychometric methods have led to their falling into disuse.…”

mentioning

confidence: 99%

“…In addition, many rating scales (including our items) employ Likert scale type response formats (with sequentially ordered response options assigned sequentially ordered integers). Traditional methods assume that ordinal level total scores approximate to interval level measures (Allen and Yen, above), which is not the case and should not be treated as such (Smith et al 2016). Other problematic assumptions include a homogeneous contribution of items to the final score and equivalence of response options among different items (Martinez-Martin and Forjaz 2012).…”

mentioning

confidence: 99%

See 2 more Smart Citations

Measuring the Accessibility and Equality of Civil Justice

Pleasence

Balmer

2018

Hague J Rule Law

View full text Add to dashboard Cite

While, in the UK, attitudes to the criminal justice system have been routinely investigated less effort has been made to measure attitudes to the civil justice system. However, globally, there are increasingly numerous examples of studies of attitudes to civil justice. Robust standardised scales are important to establishing change and difference between groups; for example, in the context of United Nations Sustainable Development Goal 16.3. Past focus has been on developing 'composite indicators'. This paper sees the application of modern psychometric methods to the construction of 'reflective' instruments to measure single unidimensional attitude dimensions. Drawing on relevant theoretical frameworks, we administered an item pool of 35 attitude questions to a sample of 1061 adults across England and Wales. Principal component analysis was used to identify attitude domains, followed by Rasch analysis to construct scales with acceptable psychometric properties. An Inaccessibility of Justice (IOJ) scale and a Perceived Inequality of Justice (PIJ) scale resulted. Respondents who regarded themselves as having handled past civil legal problems poorly or having experienced unfair outcomes had higher IOJ and PIJ scores. Negative accounts of lawyers or courts from others were also associated with higher scores. Our substantive findings help explain how negative experiences of problem resolution can result in 'frustrated resignation' for later problems, and show the importance of positive experiences and accounts of the justice system in maintaining public support. The scales have broad justice policy utility and the methods provide a template for future related scale development.

show abstract

“…See, also, Boone et al (2014). a modern psychometric method widely used for scale development; and perhaps the only method specifically developed for this purpose (Smith et al 2016). …”

Section: Rasch Analysis 35mentioning

confidence: 99%

mentioning

confidence: 99%

mentioning

confidence: 99%

See 1 more Smart Citation

Measuring the Accessibility and Equality of Civil Justice

Pleasence

Balmer

2018

Hague J Rule Law

View full text Add to dashboard Cite

show abstract

“…An introduction to Rasch analysis and its use can be found in Boone et al () or Bond and Fox (), while Tennant and Conaghan () provide a helpful guide to using, and reporting findings from, Rasch analysis. Hobart and Cano (), Smith et al (), Wright (), and Hays et al () also provide a more detailed contrast of Rasch analysis, other modern forms of psychometric analysis, and traditional methods…”

Section: Introductionmentioning

confidence: 99%

“…For example, Blanchin et al () noted that interesting psychometrics properties, including the exhaustivity of the score on the latent trait and the specific objectivity, have driven much of the increased use of Rasch in recent years, with Hays and Lipscomb () and Smith et al () also noting growth in use in health.…”

mentioning

confidence: 99%

Development of a General Legal Confidence Scale: A First Implementation of the Rasch Measurement Model in Empirical Legal Studies

Pleasence¹,

Balmer²

2019

J Empirical Legal Studies

View full text Add to dashboard Cite

Legal capability has long been of evident importance in our understanding of legal problem resolution behavior. Although legal capability remains a contested concept, there is much commonality between specifications. Some aspects are generic, while others—such as legal confidence—are particular to law. Such law‐specific measures as have been developed to date have been developed in an ad‐hoc fashion; with no attempts made to test psychometric properties, using either classical test theory or modern psychometric methods. This has been a shortcoming in the empirical legal field, weakening theoretical development and precluding reliable estimation of changes in levels of legal capability over time. In this article, we set out details of a study aimed at introducing new methods to scale development in the field of empirical legal studies based on the approaches that have evolved in other fields and the latest developments in psychometric modeling. Specifically, we set out details of the use of a specially designed item pool—based on an increasingly demanding legal scenario—and Rasch analysis to develop a general legal confidence scale. Once the 12 item pool items were reduced to a final set of six, this yielded a scale with good psychometric properties: a General Legal Confidence (GLC) Scale. The scale showed good overall fit, item fit, person fit, targeting, and internal consistency. All items had ordered thresholds, there was no response dependence, items were unidimensional, and there was no evidence of differential item functioning. The GLC scale constitutes an effective measure of general legal confidence, and demonstrates it is possible to arrive at robust and coherent law‐specific measures of legal capability through the careful design of questions and application of the latest psychometric modeling techniques.

show abstract

Rapid Assessment of Reward‐Related Eating: The RED‐X5

Vainik

Han

Epel

et al. 2019

Obesity

View full text Add to dashboard Cite

Objective: The prevalence of obesity has created a plethora of questionnaires characterizing psychological aspects of eating behavior, such as reward-related eating (RRE). The Reward-based Eating Drive questionnaires (RED-9, RED-13) broadly and deeply assess the RRE construct. However, large-sample research designs require shorter questionnaires that capture RRE quickly and precisely. This study sought to develop a brief, reliable, and valid version of the RED questionnaire. Methods: All-subset correlation was used to find a subset that maximally associated with the full RED-13 in two separate samples. Results were validated in a third independent sample. Internal consistency, testretest reliability, and ability to explain variance in external outcomes were also assessed. Results: A five-item questionnaire (RED-X5) correlated strongly with RED-13 in the independent sample (r = 0.95). RED-X5 demonstrated high internal consistency (omega total ≥ 0.80) and 6-month test-retest reliability (r = 0.72). RED-X5 accurately reproduced known associations between RED-13 and BMI, diabetes status, and craving for sweet and savory foods. As a novel finding, RED questionnaires predicted laboratory intake of chips. Conclusions: RED-X5 is a short, reliable, and valid measure of the RRE construct and can be readily implemented in large-sample research designs in which questionnaire space is limited.

show abstract

Reducing outcome measures in mental health: a systematic review of the methods

Abstract: The Rasch model (RM) is the only model where "'specific objectivity"' is a defining property of the model. This property is necessary for constructing scales in line with the fundamental principles of measurement.

Cited by 8 publications

References 40 publications

Measuring the Accessibility and Equality of Civil Justice

Measuring the Accessibility and Equality of Civil Justice

Development of a General Legal Confidence Scale: A First Implementation of the Rasch Measurement Model in Empirical Legal Studies

Rapid Assessment of Reward‐Related Eating: The RED‐X5

Contact Info

Product

Resources

About