Academic and quantitative literacies (AQL) are essential to success in higher education. These literacies are largely not explicitly taught, but acquired indirectly, mostly through practices in various school subjects. The National Benchmark Tests (NBT) Project assesses students’ AQL competencies to assist in identifying students who need support, with placement into appropriate programmes and with curriculum development. We analyse the performance on the NBT AQL test of students who took the school-leaving examinations in Mathematics, Mathematical Literacy, English Home Language and English First Additional Language. We use the subject choice as a representation of the level of a candidate’s quantitative competence and language proficiency respectively, and investigate the relative contributions made by these subject choices to a student’s AQL. Students who paired Mathematics with English as Home Language subject had the statistically significant highest mean AQL score and those who took both English First Additional Language and Mathematical Literacy had the lowest. Language competence has a stronger effect than mathematical competence on AQL. Students who took the subject combination Mathematics and English Home Language at school are better prepared for the academic demands of higher education than their counterparts who took the alternate subjects. Treating these subjects as equivalent to English Home Language and Mathematics for admissions purposes ignores the differences in preparedness of these students.
Owing to the COVID-19 pandemic, paper-based delivery of the National Benchmark Tests (NBTs) was not possible during the 2020 testing cycle. The NBTs, being a large-scale national assessment project, did not have alternative options, other than to offer the tests online. Moving these high-stakes tests online meant that certain considerations had to be considered to retain the credibility and security of the tests, without compromising the validity and reliability of the scores. Digitising the paper-based NBTs required an innovative, flexible and robust solution, which promotes fairness and ensures the quality of testing is maintained, while in many ways remains comparable to the paper-based implementation. To deliver the NBTs online, the following important considerations needed to be addressed: test security and integrity, test candidate identification processes, the prevention of dishonest behaviour, test scheduling and timing and technical support. The online testing solution chosen integrates the following aspects: it 1) enables all candidates to take the same test at the same time; 2) ensures the quality and similarity in experience of test delivery for all candidates as far as possible; 3) prevents candidates from accessing other applications and devices during the test; 4) enables proctoring before, during and after the tests to encourage appropriate behaviour similar to that expected during paper-based tests; 5) provides live support to assist candidates to deal with technical challenges and to guide them through the test sessions and 6) processes and presents data and scores in the same way as for the paper-based tests. In this article, we analyse the integration and complexity of the online NBTs solution, the opportunities and challenges associated with this form of delivery and reflect on test candidates' and the team's experiences. We discuss components of online assessment and wish to argue that this is also relevant to high-stakes course assessments. This case study should help to refine the scope of further research and development in the use of online high-stakes assessments.
The post-1994 South African constitution proudly affirms the language diversity of the country, as do subsequent laws, while ministerial policies, both at further and higher education level, similarly promote the use of all 11 official languages in education. However, such recognition of diversity presents several challenges to accommodate potential variation. In language education at secondary school, which is nationally assessed, the variety being promoted immediately raises issues of fairness and equivalence. The final high-stakes examination of learners’ ability in home language at the exit level of their pre-tertiary education is currently contentious in South Africa. It is known, for example, that in certain indigenous languages, the exit level assessments barely discriminate among learners with different abilities, while in other languages they do. For that reason, the Council for Quality Assurance in General and Further Education, Umalusi, has commissioned several reports to attempt to understand the nature of the problem. This article will deal with a discussion of a fourth attempt by Umalusi to solve the problem. That attempt, undertaken by a consortium of four universities, has already delivered six interim reports to this statutory body, and the article will consider some of their content and methodology. In their reconceptualisation of the problem, the applied linguists involved first sought to identify the theoretical roots of the current curriculum in order to articulate more sharply the construct being assessed. That provides the basis for a theoretical justification of the several solutions being proposed, as well as for the preliminary designs of modifications to current, and the introduction of new assessments. The impact of equivalence of measurement as a design requirement will be specifically discussed, with reference to the empirical analyses of results of a number of pilots of equivalent tests in different languages.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.