Computer Adaptive Language Testing According to Nato Stanag 6001 Requirements

Abstract

The article deals with the innovative, cutting age solution within the language testing realm, namely computer adaptive language testing (CALT) in accordance with the NATO Standardization Agreement 6001 (NATO STANAG 6001) requirements for further implementation in foreign language training of personnel of the Armed Forces of Ukraine (AF of Ukraine) in order to increase the quality of foreign language testing. The research provides the CALT method developed according to NATO STANAG 6001 requirements and the CALT algorithm that contains three blocks: “Starting point”, “Item selection algorithm”, “Scoring algorithm” and “Termination criterion”. The CALT algorithm has an adaptive ability, changing a complexity level, sequence and the number of items according to the answers of a test taker. The comparative analysis of the results of the CALT method piloting and the paper-and-pencil testing (PPT) in reading and listening according to the NATO STANAG 6001 requirements justifies the effectiveness of the three-level CALT method. It allows us to determine the following important benefits of CALT: test length reduction, control of measurement accuracy, objective assessment, improved test security, generation of a unique set of items, adaptive ability of the CALT algorithm, high motivation of the test takers, immediate score reporting and test results management. CALT is a qualitative and effective tool to determine test takers’ foreign language proficiency level in accordance with NATO STANAG 6001 requirements within the NATO Defence Educational Enhancement Programme. CALT acquires a special value and relevance in the context of the global COVID 19 pandemic.

Impact of ChatGPT on the Academic Writing Quality of Senior High School Students

“…By comparing the results of CALT and the Paper and Pen Test (PPT), the study demonstrates CALT's efficacy. Gawliczek et al (2021) support the claim that implementing the CALT approach enhances the quality of foreign language testing. A similar study on technology in language learning conducted by Yundayan, Susilawati, and Chairunnisa (2021) found that technology is a valuable and practical learning tool to promote students' writing.…”

“…The absence of scores in the outstanding range (13)(14)(15)(16) indicates that exemplary performances are not recorded in the dataset. This stimulates reflection on potential barriers to outstanding writing quality output, such as appropriate teaching methods and approaches or the need for specific enrichment options.…”

“…ICT has played a significant role in language learning in recent years. This covers both the use of technology in language learning and assessment, such as Computer-Adaptive Language Testing (CALT) (Gawliczek, 2021) and Computer-Assisted Language Learning (CALL) (Gaikwad, 2013).…”

“…The findings consistently showed that CALL positively impacts the development of motivation, enthusiasm, and interest among students. The study conducted by Gawliczek et al (2021) establishes evidence for the effectiveness of Computer-Assisted Language Testing (CALT) in language assessment. By comparing the results of CALT and the Paper and Pen Test (PPT), the study demonstrates CALT's efficacy.…”

Library Digitalization as a Strategic Goal of a Higher Military Educational Institution

“…Currently, the introduction of digital technology in the military education system, namely in the educational and research activities of a higher military educational institution (HMEI) is a priority and urgent task reflected in numerous scientific [1], [2], [4], [5], [8], statutory and regulatory sources [6], [7]. Obviously, the prerequisite for this is an understanding of the need to improve the efficiency of educational and research activities of a HMEI through their digitalization, which will be reflected in the mobility of students and save their time on performing daily and routine tasks.…”