A computerized adaptive testing advancing the measurement of subjective well-being

Wu, Yi-Ming; Cai, Yan; Tu, Dongbo

doi:10.1017/prp.2019.6

Cited by 6 publications

(5 citation statements)

References 51 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…If the ratio of the first eigenvalue explanatory variance to the second eigenvalue explanatory variance is greater than 4 and the variance of the first factor interpretation is greater than 20% (Reckase, 1979), the data can be considered to basically conform to this assumption (Reeve et al, 2007). Some researchers (Wu et al, 2019; Zhang et al, 2019) have tested this assumption according to the abovementioned standards when developing a unidimensional CAT item bank. In this part, we evaluate the dimensionality of our item bank using exploratory factor analyses via the SPSS 20.0 software by the following procedure.…”

Section: Discussionmentioning

confidence: 99%

Developing an Item Bank of Computerized Adaptive Testing for Eating Disorders in Chinese University Students

Liu

Zhang

et al. 2022

SAGE Open

Self Cite

View full text Add to dashboard Cite

We aimed to develop an item bank of computerized adaptive testing for eating disorders (CAT-ED) in Chinese university students to increase measurement precision and improve test efficiency. A total of 1,025 Chinese undergraduate respondents answered a series of questions about eating disorders in a paper-pencil test. A total of 133 items from four well-validated Chinese-version scales of eating disorders were used to construct the item bank of CAT-ED with the following analysis. First, unidimensionality, model fit, local independence, item ﬁt, discrimination and differential item functioning (DIF) were tested. Then, two simulation studies were applied to test the CAT-ED’s effectivity and rationality by calculating concurrent criterion-related validity, sensitivity and speciﬁcity. The ﬁnal item bank comprised 77 items, which met the requirements of local independence, item ﬁt, high discrimination and no differential item functioning in CAT. The mean number of administered items in CAT with the stopping rule fixed at SE ≤ 0.3 was 11 items. The obtained results showed that CAT-ED had acceptable reliability, validity, sensitivity and speciﬁcity.

show abstract

Section: Discussionmentioning

confidence: 99%

Developing an Item Bank of Computerized Adaptive Testing for Eating Disorders in Chinese University Students

Liu

Zhang

et al. 2022

SAGE Open

Self Cite

View full text Add to dashboard Cite

show abstract

“…Sessions are typically logged in order to provide detailed feedback to therapists. On the cognitive side, these adaptive systems have been designed to evaluate subjective well-being (Wu et al . 2019) and phonological acquisition (Origlia et al .…”

Section: Gamificationmentioning

confidence: 99%

An Application of a Runtime Epistemic Probabilistic Event Calculus to Decision-making in e-Health Systems

D’Asaro¹,

Raggioli²,

Malek³

et al. 2022

Theory and Practice of Logic Programming

View full text Add to dashboard Cite

We present and discuss a runtime architecture that integrates sensorial data and classifiers with a logic-based decision-making system in the context of an e-Health system for the rehabilitation of children with neuromotor disorders. In this application, children perform a rehabilitation task in the form of games. The main aim of the system is to derive a set of parameters the child’s current level of cognitive and behavioral performance (e.g., engagement, attention, task accuracy) from the available sensors and classifiers (e.g., eye trackers, motion sensors, emotion recognition techniques) and take decisions accordingly. These decisions are typically aimed at improving the child’s performance by triggering appropriate re-engagement stimuli when their attention is low, by changing the game or making it more difficult when the child is losing interest in the task as it is too easy. Alongside state-of-the-art techniques for emotion recognition and head pose estimation, we use a runtime variant of a probabilistic and epistemic logic programming dialect of the Event Calculus, known as the Epistemic Probabilistic Event Calculus. In particular, the probabilistic component of this symbolic framework allows for a natural interface with the machine learning techniques. We overview the architecture and its components, and show some of its characteristics through a discussion of a running example and experiments.

show abstract

“…To confirm the unidimensionality of the selected items from seven scales, we first conducted a one-factorial exploratory factor analysis (EFA) to eliminate items with factor loadings less than 0.40 at a time (Wu et al, 2019). This approach was supported by Nunnally's (1978) conclusions, which suggested that factor loadings smaller than 0.30 should not be taken seriously and that factor loadings smaller than 0.40 can easily be overinterpreted.…”

Section: Unidimensionalitymentioning

confidence: 99%

Developing a Computerized Adaptive Test to Assess Stress in Chinese College Students

Tian

Dai

2020

Front. Psychol.

View full text Add to dashboard Cite

Stress is among the most prevalent problems in life; thus, measurement of stress is of great importance for disease prevention and evaluation. This work aims to develop a computerized adaptive test (CAT) application to measure stress (CAT-S) based on item response theory (IRT). Two types of analyses were performed. The first analysis was to meet the psychometric requirements of the CATS. A Paper and Pencil (P&P) test involving 226 items was developed based on eight stress-related scales, and 972 Chinese college students completed the test. The first seven scales were used to build the item bank, and the last scale (i.e., the Perceived Stress Scale, PSS) was used to determine the convergent validity of the CATS. With some statistical considerations, such as item fit, discrimination, differential item functioning (DIF), and the assumption of unidimensionality, the final item bank comprised 93 items. The second analysis was to simulate the CAT adaptively using the existing item response. A Bayesian method called Expected a Posterior method (EAP) was used to estimate θ. For the item selection strategy, the greatest item information was considered at each step. The stopping rule was determined by the fixed length (10, 11, 12,. . ., 20, and 93) or the prespecified level of measurement precision (standard errors of 0.3, 0.4, 0.5, 0.6, 0.7, and 0.8). Finally, the criterion validity was tested by using PSS as a criterion and analyzing the effect of CATS diagnosis with a receiver operating curve (ROC). The results showed that (1) the final stress item bank had good quality based on the psychometric evaluation, (2) the CAT-scores were highly correlated with the scores of the final item bank, (3) the scores of the P&P form of PSS were correlated with those of the CATS (r > 0.5), (4) the value of the area under the ROC curve (AUC) was greater than 0.7 under each stopping rule, and (5) the CATS needed only a small number of items to obtain a highly precise measure of stress. Therefore, the CATS presented the theoretically expected advantages, which enabled a rapid, accurate, and efficient dynamic and intelligent measurement of stress.

show abstract

A computerized adaptive testing advancing the measurement of subjective well-being

Cited by 6 publications

References 51 publications

Developing an Item Bank of Computerized Adaptive Testing for Eating Disorders in Chinese University Students

Developing an Item Bank of Computerized Adaptive Testing for Eating Disorders in Chinese University Students

An Application of a Runtime Epistemic Probabilistic Event Calculus to Decision-making in e-Health Systems

Developing a Computerized Adaptive Test to Assess Stress in Chinese College Students

Contact Info

Product

Resources

About