Development of a New Instrument to Assess Work-Related Function: Work Disability Functional Assessment Battery (WD-FAB)

Marfeo, Elizabeth; Ni, Pengsheng; Meterko, Mark; Marino, Molly; Peterik, Kara; McDonough, Christine M.; Rasch, Elizabeth K.; Brandt, D.; Chan, Leighton; Jette, Alan M.

doi:10.5014/ajot.2016.70s1-rp402b

Cited by 5 publications

(2 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We focus on the concrete application of improving the statistical properties of the IRT model underlying the Work Disability Functional Assessment Battery (WD-FAB) [9][10][11][12][13].…”

Section: Work Disability Functional Assessment Battery (Wd-fab)mentioning

confidence: 99%

Regularized Bayesian calibration and scoring of the WD-FAB IRT model improves predictive performance over marginal maximum likelihood

et al. 2022

View full text Add to dashboard Cite

Item response theory (IRT) is the statistical paradigm underlying a dominant family of generative probabilistic models for test responses, used to quantify traits in individuals relative to target populations. The graded response model (GRM) is a particular IRT model that is used for ordered polytomous test responses. Both the development and the application of the GRM and other IRT models require statistical decisions. For formulating these models (calibration), one needs to decide on methodologies for item selection, inference, and regularization. For applying these models (test scoring), one needs to make similar decisions, often prioritizing computational tractability and/or interpretability. In many applications, such as in the Work Disability Functional Assessment Battery (WD-FAB), tractability implies approximating an individual’s score distribution using estimates of mean and variance, and obtaining that score conditional on only point estimates of the calibrated model. In this manuscript, we evaluate the calibration and scoring of models under this common use-case using Bayesian cross-validation. Applied to the WD-FAB responses collected for the National Institutes of Health, we assess the predictive power of implementations of the GRM based on their ability to yield, on validation sets of respondents, ability estimates that are most predictive of patterns of item responses. Our main finding indicates that regularized Bayesian calibration of the GRM outperforms the regularization-free empirical Bayesian procedure of marginal maximum likelihood. We also motivate the use of compactly supported priors in test scoring.

show abstract

“…We focus on the concrete application of improving the statistical properties of the IRT model underlying the Work Disability Functional Assessment Battery (WD-FAB) [9][10][11][12][13].…”

Section: Work Disability Functional Assessment Battery (Wd-fab)mentioning

confidence: 99%

Regularized Bayesian calibration and scoring of the WD-FAB IRT model improves predictive performance over marginal maximum likelihood

et al. 2022

View full text Add to dashboard Cite

show abstract

“…We focus on the concrete application of improving the statistical properties of the IRT model underlying the Work Disability Functional Assessment Battery (WD-FAB) [20,[26][27][28][29].…”

Section: Work Disability Functional Assessment Battery (Wd-fab)mentioning

confidence: 99%

Regularized Bayesian calibration and scoring of the WD-FAB IRT model improves predictive performance over marginal maximum likelihood

Chang,

Porcino,

Rasch

et al. 2020

Preprint

Self Cite

View full text Add to dashboard Cite

Item response theory (IRT) is the statistical paradigm underlying a dominant family of generative probabilistic models for test responses, used to quantify traits in individuals relative to target populations. The graded response model (GRM) is a particular IRT model that is used for ordered polytomous test responses. Both the development and the application of the GRM and other IRT models require statistical decisions. For formulating these models (calibration), one needs to decide on methodologies for item selection, inference, and regularization. For applying these models (test scoring), one needs to make similar decisions, often prioritizing computational tractability and/or interpretability. In many applications, such as in the Work Disability Functional Assessment Battery (WD-FAB), tractability implies approximating an individual's score distribution using estimates of mean and variance, and obtaining that score conditional on only point estimates of the calibrated model. In this manuscript, we evaluate the calibration and scoring of models under this common use-case using Bayesian cross-validation. Applied to the WD-FAB responses collected for the National Institutes of Health, we assess the predictive power of implementations of the GRM based on their ability to yield, on validation sets of respondents, estimates of latent ability with uncertainty that are most predictive of patterns of item responses. IRT models in-general have the concrete interpretation of latent abilities, combining with item parameters, to produce predictions of response patterns. Our main finding is that regularized Bayesian calibration of the GRM outperforms the prior-free empirical Bayesian procedure of maximum marginal likelihood. We also motivate the use of compactly supported priors in test scoring.

show abstract

Characteristics of Enrollees in the Supported Employment Demonstration

Borger

Marrow

Drake

2021

View full text Add to dashboard Cite

Development of a New Instrument to Assess Work-Related Function: Work Disability Functional Assessment Battery (WD-FAB)

Cited by 5 publications

References 0 publications

Regularized Bayesian calibration and scoring of the WD-FAB IRT model improves predictive performance over marginal maximum likelihood

Regularized Bayesian calibration and scoring of the WD-FAB IRT model improves predictive performance over marginal maximum likelihood

Regularized Bayesian calibration and scoring of the WD-FAB IRT model improves predictive performance over marginal maximum likelihood

Characteristics of Enrollees in the Supported Employment Demonstration

Contact Info

Product

Resources

About