When CAT is not an option: complementary methods of test abbreviation for neurocognitive batteries

Moore, Tyler M.; Butler, Ellyn R.; Scott, J. Cobb; Port, Allison M.; Ruparel, Kosha; Njokweni, Lucky J; Gur, Raquel E.; Gur, Ruben C.

doi:10.1080/13546805.2020.1859360

Cited by 4 publications

(2 citation statements)

References 65 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, as is often the case (Moore et al, 2021), building a fully functional CAT is impractical for our present purposes, mostly due to the back-end calculations required for a true CAT. We therefore implemented a method of CAT simulation that facilitates creation of short-forms [ (Moore et al, 2015), see (Reise & Henson, 2000) for early work in this area].…”

Section: Fep-pe Mandates Data Collection By Community Mental Health B...mentioning

confidence: 99%

“…We therefore implemented a method of CAT simulation that facilitates creation of short‐forms [(Moore et al, 2015), see (Reise & Henson, 2000) for early work in this area]. The CAT‐simulation method has been used successfully with both cognitive (Bezdicek et al, 2018; Moore et al, 2021; Roalf et al, 2016) and non‐cognitive (Lawson et al, 2020; Moore et al, 2020; Saine et al, 2020) tests/scales. CATs (and CAT simulations) have been reported to reduce the number of items necessary in a test by approximately 50% (Weiss & Kingsbury, 1984), but the reduction can be even larger in certain settings (Makransky et al, 2013).…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Development of empirically derived brief program evaluation measures in Pennsylvania first‐episode psychosis coordinated specialty care programs

Dong

Moore

Westfall

et al. 2022

Early Intervention Psych

Self Cite

View full text Add to dashboard Cite

Aim The Pennsylvania first episode psychosis program evaluation (PA‐FEP‐PE) core assessment battery was developed as a standard and comprehensive clinical assessment and data collection tool in Pennsylvania coordinated specialty care programs (CSC). To reduce administrative time and maximize clinical utility by maintaining acceptable levels of precision, we aimed to generate a short form using item response theory (IRT)‐based computer‐adaptive test (CAT) simulation and analyse the implementation and acceptability of the short form among providers from PA‐CSC. Methods FEP participants (n = 759; age 14–36) from nine coordinated specialty care programs completed 156 items drawn from the PA‐FEP‐PE battery. Multidimensional IRT‐based CAT simulations were used to select the best PA‐FEP‐PE items for abbreviated forms. Results A 67‐item PA‐FEP‐PE short form was developed to capture six factors: (1) positive affect and surgency (with negative loadings on Anxious‐Misery items); (2) psychiatric services satisfaction; (3) antipsychotic side effect severity; (4) family turmoil and associated traumas; (5) trauma load; and (6) psychosis. The total number of items was reduced more than 50% in the PA‐FEP‐PE shortened forms. The short form demonstrated good psychometric properties, and it was well accepted by our providers in the implementation. Conclusions The empirical derivation and implementation of abbreviated measures of key domains and constructs in FEP care have streamlined and facilitated PA‐FEP program evaluation. Our work supports potential application of IRT based methods to empirically reduce core assessment battery measures in large‐scale data collection efforts such as in the Early Psychosis Intervention Network.

show abstract

Section: Fep-pe Mandates Data Collection By Community Mental Health B...mentioning

confidence: 99%