The Development of a Four-Tier Diagnostic Test Based on Modern Test Theory in Physics Education

Abstract

<p style="text-align: justify;">Diagnostic tests are generally two or three-tier and based on classical test theory. In this research, the Four-Tier Diagnostic Test (FTDT) was developed based on modern test theory to determine understanding of physics levels: scientific conception (SC), lack of knowledge (LK), misconception (MSC), false negatives (FN), and false positives (FP). The goals of the FTDT are to (a) find FTDT constructs, (b) test the quality of the FTDT, and (c) describe students' conceptual understanding of physics. The development process was conducted in the planning, testing, and measurement phases. The FTDT consists of four-layer multiple-choice with 100 items tested on 700 high school students in Yogyakarta. According to the partial credit models (PCM), the student's responses are in the form of eight categories of polytomous data. The results of the study show that (a) FTDT is built on the aspects of translation, interpretation, extrapolation, and explanation, with each aspect consisting of 25 items with five anchor items; (b) FTDT is valid with an Aiken's V value in the range of 0.85-0.94, and the items fit PCM with Infit Mean Square (INFIT MNSQ) of 0.77-1.30, item difficulty index of 0.12-0.38, and the reliability coefficient of Cronbach's alpha FTDT is 0.9; (c) the percentage of conceptual understanding of physics from large to small is LK type 2 (LK2), FP, LK type 1 (LK1), FN, LK type 3 (LK3), SC, LK type 4 (LK4), and MSC. The percentage sequence of MSC based on the successive material is momentum, Newton's law, particle dynamics, harmonic motion, work, and energy. In addition, failure to understand the concept sequentially is due to Newton's law, particle dynamics, work and energy, momentum, and harmonic motion.</p>

Enhancing Learning Outcomes: A Study on the Development of Higher Order Thinking Skills based Evaluation Instruments for Work and Energy in High School Physics

“…et al, 2023). In conclusion, the results of the reliability analysis demonstrate that the HOTS evaluation instrument consistently provides dependable results in measuring Higher-Order Thinking abilities (Istiyono et al, 2023). This affirms that the instrument can be effectively used for evaluation in the context of high school physics learning in the work and energy topics (Arifin et al, 2023).…”

How Do Science Content Misconceptions Occur in Primary School Teachers with Teaching Certificates?

“…Data in the form of teacher answers that have been obtained from the results of the four tier misconception diagnosis test were categorized according to the decisions put forward by Istiyono et al (2022), Kiray & Simsek, (2021), and Taban & Kiray, (2022) which are presented in Table 2. Kiray, 2022).…”

“…The four tier diagnosis test is the most powerful misconception measurement tool than other measurement tools and has a fairly high accuracy because it measures the confidence of answers on content and reasoning so that it can distinguish between misconceptions and lack of knowledge (Caleon & Subramaniam, 2010;Kaltakci-Gurel et al, 2017;Anam et al, 2019;Kiray & Simsek, 2021). The Four tier misconception diagnosis test has 4 levels, namely the first level contains multiple choice content (responses), the second level contains the level of confidence in the answer at the first level, the third level contains the reason for choosing the answer at the first level (conceptual), and the fourth level contains the level of confidence in the answer at the third level (Kaltakci-Gurel et al, 2017;Istiyono et al, 2022).…”

Ekplorasi Konsep Dinamika Rotasi pada Tari Banjarkemuning Asal Sidoarjo sebagai Sumber Pembelajaran Fisika Berbasis Etnofisika

“…Fisika adalah cabang ilmu sains yang menjelaskan secara kualitatif maupun kuantitatif tentang peristiwa di kehidupan sehari-hari dalam lingkup materil dan pengaplikasiannya (Rahayu et al 2023). Permasalahan yang menjadi topik hingga saat ini adalah rendahnya pemahaman peserta didik terhadap suatu konsep dasar fisika, padahal pemahaman fisika lebih penting dibandingkan sekadar pandai menghitung dalam ilmu fisika (Prahani et al, 2022;Istiyono et al 2023). Hal tersebut bersesuaian dengan penelitian Harefa (2019) serta Husna dan Kurniawan (2022) yang mengungkapkan bahwa mayoritas guru fisika lebih sering menekankan pada hafalan rumus dan kemampuan perhitungan matematis saja.…”