“…However, in its application, there are not a few computerized tests that have a working principle similar to PBT, known as the Computer Based Test (CBT) (Pramono & Retnawati, 2020). The working principle of CBT is that the computer provides several questions that have been determined by the examiner.…”
To speak English fluently like a native speaker, having a vocabulary of 20,000 words are required. In many universities in Indonesia, Vocabulary Size Test (VST) is still held with Paper-Based Test (PBT), so it is less effective and efficient. The aims of this study were 1) to develop Computerized-Adaptive Testing (CAT), which helps get students with a standardized English vocabulary size, and 2) to implement it in measuring vocabulary size. The approach in this study is Research and Development (RD) with product development procedures following the steps of Borg and Gall. The findings of this study are, 1) the CAT program has Item Response Theory (IRT) parameters that can change according to the test takers' answers, and the test will stop if the estimated ability of the test takers is known (Standard Error/SE close to 0.01), and 2) with the application of the CAT program it can be seen that the total vocabulary of English Language and Teaching Department students is still 20,000. Based on these findings, this study implies that for students' vocabulary mastery to be on par with native speakers' abilities, the English Language and Teaching Department needs to evaluate the learning process and determine a particular program to increase student vocabulary.
“…However, in its application, there are not a few computerized tests that have a working principle similar to PBT, known as the Computer Based Test (CBT) (Pramono & Retnawati, 2020). The working principle of CBT is that the computer provides several questions that have been determined by the examiner.…”
To speak English fluently like a native speaker, having a vocabulary of 20,000 words are required. In many universities in Indonesia, Vocabulary Size Test (VST) is still held with Paper-Based Test (PBT), so it is less effective and efficient. The aims of this study were 1) to develop Computerized-Adaptive Testing (CAT), which helps get students with a standardized English vocabulary size, and 2) to implement it in measuring vocabulary size. The approach in this study is Research and Development (RD) with product development procedures following the steps of Borg and Gall. The findings of this study are, 1) the CAT program has Item Response Theory (IRT) parameters that can change according to the test takers' answers, and the test will stop if the estimated ability of the test takers is known (Standard Error/SE close to 0.01), and 2) with the application of the CAT program it can be seen that the total vocabulary of English Language and Teaching Department students is still 20,000. Based on these findings, this study implies that for students' vocabulary mastery to be on par with native speakers' abilities, the English Language and Teaching Department needs to evaluate the learning process and determine a particular program to increase student vocabulary.
“…In the literature review, we found various studies discussing the benefits of CAT [1][5] [6] [7]. These studies' principal objective compares the measurement accuracy of the assessments and assess.…”
By the end of the 20th century, the most common and traditional paper and pencil tests (PBT) were faced with an increasing set of difficulties and drawbacks. Proceed and meet the measurement and evaluation needs of the 21st century; it is mandatory to have radical and qualitative changes. The accelerating pace of technological innovation in Education shows a clear path to computer-based testing, which offers a more engaging and innovative testing environment, as well as the ability to obtain instant results and feedback, the use of dynamic, multimedia learning objects (LO), and the implementation of adaptive, individualized assessment approaches. In this sense, this paper presents an adaptive formative assessment framework in which test adaptation is based on multiple criteria. The presented system bases its adaptation on the test takers' proficiency, schemata, desirable learning goal, cognitive level, and learning style. The main objective of this paper is to discuss the value of the adaptive testing system. Therefore, it presents the design and implementation of the system and the adaptive rules employed.
Purpose: The research aimed to develop a valid, feasible, and efficient computerized adaptive test (CAT) to measure students’ abilities on the end-of-semester exams. Design/Approach/Methods: This research was a 4D research and development with four stages, namely, definition, design, development, and dissemination. Stratified random sampling techniques were used in the study by randomly sampling based on high, moderate, and low levels of academic achievement ability. The study sample was 637 junior high school students in Yogyakarta. Finding: The results showed that the developed CAT program was considered very good and feasible to use. The validity of the contents was obtained by 200 valid questions, and in the characteristics of the item, all items were declared to fit with the Rasch model. All problem items with item difficulty index were relatively good. The reliability of the item estimate was in the very good category while the reliability of the case estimate was in the good category. The lowest and highest ability test results obtained were in the range of 1.1 to 9.85. The ability of test takers was diverse and had scattered distributions. The feasibility of using CAT media was obtained from teachers and students indicating that CAT media was in a very feasible category to use.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.