Combining automatic item generation and experimental designs to investigate the contribution of cognitive components to the gender difference in mental rotation

Arendasy, Martin; Sommer, Markus; Gittler, Georg

doi:10.1016/j.intell.2010.06.006

Cited by 4 publications

(1 citation statement)

References 33 publications

(52 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Precedents of AIG of the figural kind made themselves available during the past 19 years with the works of Arendasy ( Arendasy, 2005 ; Arendasy and Sommer, 2010 ; Arendasy et al, 2010 ), Freund et al (2008) and Embretson and Reise (2000) , among others. Figural item generators include MatrixDeveloper ( Hofer, 2004 ), the Figural Matrices Generator GeomGen, and the Endless Loop Generator EsGen ( Arendasy, 2002 , 2005 ; Arendasy and Sommer, 2005 ).…”

Section: Introductionmentioning

confidence: 99%

Automatic Generation of Figural Analogies With the IMak Package

Blum

Holling

2018

Front. Psychol.

View full text Add to dashboard Cite

Automatic Item Generation (AIG) techniques are offering innovative ways to produce test items as they overcome many disadvantages involving standard item writing, such as time-consuming work and resource-intensive demands. Although this field is relatively new, it is progressing at a high speed, and several contributions have been accomplished. Nevertheless, a scarce amount of AIG software evidencing favorable psychometric properties of the generated items has been made accessible to the broad scientific community. This research had two goals: first, to present an empirical study of items produced with the aid of the Item Maker (IMak) package available online and, second, to present IMak itself for the automatic generation of figural analogies. We were particularly interested in assessing whether automatically created figural analogy rules could predict item psychometric difficulty. A total of 23 items were generated and administered to 307 participants, 49.51% from Germany. The mean age was 28.61 (SD = 10.19) and 57.65% of the participants were female. Results reveal adequate psychometric properties including convergent validity, that most of the manipulated rules contribute to item difficulty, and that rule-based difficulty prediction is possible to some extent. In other words, psychometric quality of the generated items is supported, which reveals the utility of the IMak package in assessment settings. Finally, the package is presented and its functions for figural analogy item generation are further described.

show abstract