Validity and use of the What Is Happening In this Class? (WIHIC) questionnaire in university business statistics classrooms

Validating an Indonesian Version of the What Is Happening in this Class? (WIHIC) Questionnaire Using a Multidimensional Rasch Model

“…We also found adequate internal consistency for all subscales (EAP/PV reliability = 0.87 to 0.96), which is consistent with Cronbach's alpha found in the Singapore version of the WIHIC, with an alpha range around 0.90 (Chionh & Fraser, 2009). The latest psychometric evaluation of the original WIHIC revealed an alpha range from 0.90 to 0.95 (Skordi & Fraser, 2019). Based on the EAP/PV reliability, the Indonesian WIHIC has high reliabilities (EAP/PV reliability = 0.87 to 0.96).…”

“…The result of the Bayesian CFA indicated that the seven-factor model, according to the original structure of the scale (see, Skordi & Fraser, 2019), is confirmed because the values of the indices are above the acceptable threshold (PPP-value = 0.000; BRMSEA = 0.049, BCFI = 0.904, BTLI = 0.899), compared to the one-factor model (PPP-value = 0.000; BRMSEA = 0.091, BCFI = 0.663, BTLI = 0.652). Thus, based on the model comparison, BRMSEA, and BCFI, the results indicated that the seven-factor model was satisfactory and provided representations of the underlying structure of Indonesian WIHIC.…”

“…Based on studies that have found that WIHIC has adequate psychometric characteristics when used in a sample of high school students (Aldridge & Fraser, 2000;Wolf & Fraser, 2008), we adapted WIHIC and administered it to our survey population of high school students. In terms of data analysis methods, the analysis of WIHIC has been tested in previous studies using applied qualitative methods (Charalampous & Kokkinos, 2017;Stetson, 2005), as well as quantitative methods such as cluster analysis (Dorman, Aldridge & Fraser, 2006), principal component analysis (Chionh & Fraser, 2009), multitrait-multimethod (Dorman, 2008), exploratory factor analysis (Skordi & Fraser, 2019), and confirmatory factor analysis (Dorman, 2003).…”

“…Recommendations from previous research suggest that the methods of statistical analysis in analyzing WIHIC could be more sophisticated than those used in their study; for example, confirmatory factor analysis could be used as well as exploratory factor analysis (Skordi & Fraser, 2019). In general, current psychometric practice encourages the utilize of the Rasch model (Rasch, 1960) to provide a more detailed information about characteristics of items and samples because the Rasch model can provide greater information than just that on the relation between an item and a latent factor (DiStefano, Greer, & Dowdy, 2019;Suryadi, Hayat, & Putra, 2021).…”

“…To date, no reports are available investigating the psychometric properties of WIHIC using the Rasch model. The Rasch model is an advanced measurement approach which is able to overcome some limitations of classical test theory (CTT) such as a lack of control over the difficulty level of scale items and appropriate ordering of ordinal response categories (Mitchell-Parker et al, 2018), and the use of Rasch model can overcome limitations from the latest evaluative study of WIHIC (Skordi & Fraser, 2019). To this end, the purpose of this study is to be the first to validate the Indonesian version of WIHIC using a multidimensional Rasch model.…”