Transforming SIBTEST to Account for Multilevel Data Structures

French, Brian F.; Finch, W. Holmes

doi:10.1111/jedm.12071

Cited by 9 publications

(12 citation statements)

References 38 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In IRT terminology, nonuniform DIF is indicated by the crossing between the item characteristic curves of focal and reference groups. SIBTEST is equally powerful for detecting uniform and nonuniform DIF/DBF, whereas EIRM only allows for testing uniform DIF/DBF (French & Finch, 2015;Kan & Bulut, 2014;Narayanon & Swaminathan, 1996).…”

Section: Dif Analysis Frameworkmentioning

confidence: 99%

“…By comparison, SIBTEST is particularly advantageous in situations when examinees' prior knowledge of content (impact) is present in the data (Klockars & Lee, 2008), and its statistics could be compared against the well-established criteria of DIF classification. Moreover, SIBTEST has been found capable for adaptations to the multilevel data structures (French & Finch, 2015), and its DIF statistics have been found robust, compared with other nonparametric DIF detection procedures, when sample sizes for reference and focal groups are small (Klockars & Lee, 2008;Roussos & Stout, 1996b). Nevertheless, both EIRM and SIBTEST could account for differences in ability between the focal and reference groups, have a well-established statistical foundation, they are robust to different sample sizes, and could be used to evaluate items and item-bundles (Briggs, 2008;De Boeck et al, 2011;French & Finch, 2015;Lee, Cohen, & Toro, 2009;Lei & Li, 2013;Roussos & Stout, 1996a).…”

Section: Dif Analysis Frameworkmentioning

confidence: 99%

“…If an examinee fails, then 2 years of academic training will be lost and the chances to continue education at the college and university level get reduced (Aly, 2007;Tinto, 1975). Therefore, DIF is an important topic for educators working in different geographical and educational contexts (Abida et al, 2011;French & Finch, 2015;Gierl, Bisanz, Bisanz, Boughton, & Khaliq, 2001;Gierl et al, 1999;Rogers, Lin, & Rinaldi, 2011).…”

mentioning

confidence: 99%

See 2 more Smart Citations

Differential Performance on National Exams

et al. 2016

View full text Add to dashboard Cite

The purpose of this study is to evaluate two methodological perspectives of test fairness using a national Secondary School Certificate (SSC) examinations. SSC is a suit of multi-subject national qualification tests at Grade 10 level in South Asian countries, such as Bangladesh, India, and Pakistan. Because it is a high-stakes test, the fairness of SSC tests is a major concern among public and educational policy planners. This study is a first attempt to investigate test fairness of the national SSC examination of Pakistan using two independent differential item functioning (DIF) and differential bundle functioning (DBF) procedures. The SSC was evaluated for possible gender bias using multiple-choice tests in three core subjects, namely, English, Mathematics, and Physics. The study was conducted in two phases using explanatory item response model (EIRM) and Simultaneous Item Bias Test (SIBTEST). In Phase 1, test items were studied for DIF, and items with severe DIF were flagged in each subject. In Phase 2, the item bundles were analyzed for DBF. Three items were detected with large DIF, one for each subject, and one item bundle was detected with a negligible DBF. Taken together, the results demonstrate that there is no major threat to the validity of the interpretation of examinees' test scores on the SSC examination. The outcome from this study provided evidence for test fairness, which will enhance test development practices at the national examination authorities.

show abstract

Section: Dif Analysis Frameworkmentioning

confidence: 99%

Section: Dif Analysis Frameworkmentioning

confidence: 99%

mentioning

confidence: 99%

See 1 more Smart Citation

Differential Performance on National Exams

et al. 2016

View full text Add to dashboard Cite

show abstract

Section: Introductionmentioning

confidence: 99%

“…DIF studies have an important role in assessing the validity of test scores (French & Finch, 2013;French & Finch, 2015). Because, it is accepted that the presence of DIF in the test items may reduce the validity of the test (French & Finch, 2015;Li & Zumbo, 2009). In addition, since studies on DIF have led to the determination of bias, it has received increasing interest in measurement practices in education and psychology over the last two decades (Millsap & Everson, 1993).…”

Section: Introductionmentioning

confidence: 99%

Determination of differantial item functioning (DIF) according to SIBTEST, Lord s X^2, Raju s area measurement and Breslow-Day methods

Yörü

Atar²

2019

JPR

View full text Add to dashboard Cite

The aim of this study is to examine whether the items in the mathematics subtest of the Centralized High School Entrance Placement Test [HSEPT] administered in 2012 by the Ministry of National Education in Turkey show DIF according to gender and type of school. For this purpose, SIBTEST, Breslow-Day, Lord's and Raju's area measurement methods were used to determine the DIF of the 20 items in the mathematics subtest of HSEPT in 2012, and it was determined whether the items show DIF according to these methods or not. The research was conducted on the basis of the data obtained from HSEPT that the eighth grade students took in 2012. After the missing data were removed from the data set, DIF analyses were performed for the mathematics subtest of 1,063,570 (nfemale=523,939 and nmale=539,631; nstate school=1,025,979 and nprivate school =37,591) in total. Since it is aimed to examine the current situation, this study is based on a descriptive research design. According to the methods used, the number and DIF levels of the items with DIF differed depending on the variables of gender and type of school. In line with the findings, this research suggests the researchers to use at least two methods to determine the DIF.

show abstract

Test Bias

French

2023

Encyclopedia of Quality of Life and Well-Being Research

View full text Add to dashboard Cite

Transforming SIBTEST to Account for Multilevel Data Structures

Abstract: SIBTEST is a differential item functioning (DIF) detection method that is

Cited by 9 publications

References 38 publications

Differential Performance on National Exams

Differential Performance on National Exams

Determination of differantial item functioning (DIF) according to SIBTEST, Lord s X^2, Raju s area measurement and Breslow-Day methods

Test Bias

Contact Info

Product

Resources

About