Introduction to the LIVECAT web-based computerized adaptive testing platform

Abstract

This study introduces LIVECAT, a web-based computerized adaptive testing platform. This platform provides many functions, including writing item content, managing an item bank, creating and administering a test, reporting test results, and providing information about a test and examinees. The LIVECAT provides examination administrators with an easy and flexible environment for composing and managing examinations. It is available at http://www.thecatkorea.com/. Several tools were used to program LIVECAT, as follows: operating system, Amazon Linux; web server, nginx 1.18; WAS, Apache Tomcat 8.5; database, Amazon RDMS – Maria DB; and languages, JAVA8, HTML5/CSS, Javascript, and jQuery. The LIVECAT platform can be used to implement several item response theory (IRT) models such as the Rasch and 1-,2-,3-parameter logistic models. The administrator can choose a specific model of test construction in LIVECAT. Multimedia data such as images, audio files, and movies can be uploaded to items in LIVECAT. Two scoring methods (maximum likelihood estimation and expected a posteriori) are available in LIVECAT and the maximum Fisher information item selection method is applied to every IRT model in LIVECAT. The LIVECAT platform showed equal or better performance compared with a conventional test platform. The LIVECAT platform enables users without psychometric expertise to easily implement and perform computerized adaptive testing at their institutions. The most recent LIVECAT version only provides a dichotomous item response model and the basic components of CAT. Shortly, LIVECAT will include advanced functions, such as a polytomous item response model with weighted likelihood estimation and content balancing.

Presidential address: improving item validity and adopting computer-based testing, clinical skills assessments, artificial intelligence, and virtual reality in health professions licensing examinations in Korea

“…Expert-suggested software [5], simulation studies [6,7], and item selection algorithms [8] will be utilized to ensure the successful implementation of CAT.…”

“…After analyzing the data from these examinations and experiences of testing, we will prepare for the implementation of computerized adaptive testing (CAT) for healthcare licensing examinations. Expert-suggested software [ 5 ], simulation studies [ 6 , 7 ], and item selection algorithms [ 8 ] will be utilized to ensure the successful implementation of CAT.…”

Patient-reported outcome measures in cancer care: Integration with computerized adaptive testing

“… 39 CAT platforms are rapidly developing in many countries, for instance, the LIVECAT platform in Korea and the Open-Source Concerto Platform in England. 58 , 59 They provide examination administrators, even those without psychometric expertise, the ability to carry out CAT at their convenience through multiple internet-connected devices, such as desktops, laptops, smartphones, and tablets. This may accelerate the incorporation of CAT into clinical practice.…”

Development of a character qualities test for medical students in Korea using polytomous item response theory and factor analysis: a preliminary scale development study

“…In the field of medical education, item analysis research using the Rasch model is well-known [ 5 ]. In Korean medical education, there have been studies on item parameter estimation using item response theory (IRT) for medical licensing examinations [ 6 , 7 ]. IRT estimates the potential nature of a subject based on unique item trait curves for each item constituting the test.…”