A Generative Analysis of a Three-Dimensional Spatial Task

Bejar, Issac I.

doi:10.1177/014662169001400302

Cited by 32 publications

(21 citation statements)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A growing number of projects demonstrate the feasibility of the generative approach (e.g., 1990Bejar & Braun, 1997;Bejar & Yocom, 1991;Embretson, 1999;Hornke & Habon, 1986;Irvine, Dunn, & Anderson, 1990;Meisner, Luecht, & Reckase, 1993;Wolfe & Larson, 1990 Hornke & Habon (1986), and Irvine et al (1990) are especially noteworthy because they provided a conceptual and experimental basis for much subsequent work.…”

Section: Item Modelingmentioning

confidence: 99%

A Feasibility Study of On‐the‐fly Item Generation in Adaptive Testing

Bejar

Lawless

Morley

et al. 2002

ETS Research Report Series

View full text Add to dashboard Cite

The goal of this study was to assess the feasibility of an approach to adaptive testing based on item models. A simulation study was designed to explore the affects of item modeling on score precision and bias, and two experimental tests were administered -an experimental, on-the-fly, adaptive quantitative-reasoning test as well as a linear test. Results of the simulation study showed that under different levels of isomorphicity, there was no bias, but precision of measurement was eroded, especially in the middle range of the true-score scale. However, the comparison of adaptive test scores with operational Graduate Record Examinations (GRE) test scores matched the test-retest correlation observed under operational conditions. Analyses of item functioning on linear forms suggested a high level of isomorphicity across items within models. The current study provides a promising first step toward significant cost and theoretical improvement in test creation methodology for educational assessment.

show abstract

Section: Item Modelingmentioning

confidence: 99%

A Feasibility Study of On‐the‐fly Item Generation in Adaptive Testing

Bejar

Lawless

Morley

et al. 2002

ETS Research Report Series

View full text Add to dashboard Cite

show abstract

“…Successful item generation for complex reasoning tasks, such as spatial ability (Bejar, 1990;Bejar & Yocom, 1991) and non-verbal reasoning (Embretson, 1994(Embretson, , 1998Hornke & Habon, t986) has also been reported.…”

mentioning

confidence: 97%

Generating items during testing: Psychometric issues and models

1999

View full text Add to dashboard Cite

show abstract

“…These domains include ability and achievement testing, as well as the measurement of complex skills, such as troubleshooting, clinical diagnoses, and pedagogical skills (Bejar, 1993). There are a growing number of projects demonstrating the feasibility of the generative approach (e.g., Bejar 1990;Bejar & Yocom, 1991;Irvine, Dunn & Anderson, 1990;Meisner, Luecht & Reckase, 1993;Wolfe & Larson, 1990;Homke, 1986). An area that seems ready for generative modeling is statistical problem solving, where Nitko and Lane (1990) have laid a foundation for item generation.…”

mentioning

confidence: 99%

Generative Response Modeling: Leveraging the Computer as a Test Delivery Medium

Bejar

1996

ETS Research Report Series

View full text Add to dashboard Cite

Generative response modeling is an approach to test development and response modeling that calls for the creation of items in such a way that the parameters of the items on some response model can be anticipated through knowledge of the psychological processes and knowledge required to respond to the item. That is, the computer would not merely retrieve an item from a database, as is the case in adaptive testing, but would compose it, or assist in doing so, according to desired specifications. This approach to assessment has implications for both the economics and validity of computer administered tests. To illustrate the concept, a system for measuring writing skills will be outlined where the examinee is expected to rewrite sentences, rather than just recognize errors in a sentence, using a multiple choice format. The possibility of estimating the psychometric parameters of items based on a psychological analysis of the response process will then be examined and shown to be feasible. Such estimates are less precise than estimates based on large samples of test takers. A Monte Carlo study is presented to investigate the possibility of compensating for that imprecision when estimating ability or proficiency. The paper concludes that a generative approach is feasible, and can be a mechanism for taking advantage of the considerable investment required for computer-based testing.Generative response modeling 3 Generative response modeling: Leveraging the computer as a test delivery medium Although the use of computers in testing was envisioned several decades ago (e.g., Green, 1964;Weiss, 1978), it is only recently that nationally administered tests have become operationally feasible for licensing exams (e.g., Lewis and Sheehan, 1990), placement (e.g., Ward, 1984), and admission tests (e.g., Wainer, H., Dorans, N. J., Flaugher, R., Green, B. F., Mislevy, R. J., Steinberg, L., Thissen, D., 1990). Interestingly, the major hurdles along the way to implementation were not psychometric per se, but rather organizational, economical, and technological. Indeed, from the point of view of a testing organization, the implementation of computer-based testing requires a substantial "reengineering" of major aspects of the test production process. However, had a research foundation for creative use ofthe computer not been laid out well before the wide availability of computing power (e.g., Lord, 1980), it is likely that today's computer-based tests would not have taken full advantage of the computer as a medium of delivery. Research must continue to insure that this will be the case in the future and that better tests, not just more economical or convenient ones, will be developed. One possibility is to take advantage of the computer to administer performance-based or open-ended exams that may not have been feasible in a paper and pencil format. A major hurdle in the implementation of performance-based exams is the cost of scoring. Thus, the use of computers to score openended responses (e.g., Bejar, 1991;Bennett, 1993;Bra...

show abstract

A Generative Analysis of a Three-Dimensional Spatial Task

Cited by 32 publications

References 22 publications

A Feasibility Study of On‐the‐fly Item Generation in Adaptive Testing

A Feasibility Study of On‐the‐fly Item Generation in Adaptive Testing

Generating items during testing: Psychometric issues and models

Generative Response Modeling: Leveraging the Computer as a Test Delivery Medium

Contact Info

Product

Resources

About