Analysing Test-Takers’ Views on a Computer-Based Speaking Test

The present study explored the comparability in performance scores between the computer-delivered and face-to-face modes for the two speaking tests in the Vietnamese Standardized Test of English Proficiency (VSTEP) (the VSTEP.2 and VSTEP.3–5 Speaking tests) according to Vietnam’s Six-Level Foreign Language Proficiency Framework (VNFLPF) and test takers’ experiences. Data were collected from 75 and 82 VSTEP.2 and VSTEP.3–5 university English-majored test takers respectively in both computer-delivered and face-to-face conditions. A counterbalanced research design was adopted to minimise mode order effects. After test completion, 30 of the test takers, 15 from each proficiency test, were interviewed in the focus group format of 3–4 members per group. The results indicated mixed, selective effects of the testing mode. Overall, test scores were comparable in the VSTEP.2 Speaking test but significantly higher in favour of the face-to-face mode for the VSTEP.3–5 Speaking test. However, the statistically significant difference was observed in only one measure of the many analytical criteria (content development in the former test, and pronunciation in the latter test) with mixed mode advantages. The interview data has provided rich refreshing insights into how test takers viewed each testing mode against real-life communication. Their experiences further revealed a wide range of affective preferences involved in the inherent affordances or constraints of each testing mode and their communication and performance/outcome orientation. The findings offer important implications for extrapolation, test preparation and administration, and test taker/rater training in the particular context of the two English speaking proficiency tests in Vietnam and perhaps beyond.

show abstract

First-Year Japanese Learners' Perceptions of Computerised vs. Face-to-Face Oral Testing

Hasegawa

Chen

Collopy

2020

New Technological Applications for Foreign and Second Language Learning and Teaching

View full text Add to dashboard Cite

This chapter explores the effectiveness of computerised oral testing on Japanese learners' test experiences and associated affective factors in a Japanese program at the Australian tertiary level. The study investigates (1) Japanese beginners' attitudes towards the feasibility of utilising a computer-generated program vs. a tutor-fronted oral interview to assess their oral proficiency, and (2) the challenges and implications of computerised oral testing vis-à-vis Japanese beginners. It presents the initial findings of the qualitatively analysed data collected from student responses to open-ended survey questions and follow-up semi-structured interviews. A thematic analysis approach was employed to examine student perceptions of the two different test settings and their effects on students' oral performance in relation to test anxiety. Despite the fact that computerised oral testing was overall perceived to be beneficial for streamlining the test process and reducing learners' test anxiety, the findings also identified its limitations.

show abstract

Analysing Test-Takers’ Views on a Computer-Based Speaking Test

Cited by 3 publications

References 35 publications

Students' Perception of Computer-Based Tests in the Use of English Programme in Nigerian Universities

Students' Perception of Computer-Based Tests in the Use of English Programme in Nigerian Universities

Computer-delivered vs. face-to-face score comparability and test takers’ perceptions: The case of the two English speaking proficiency tests for Vietnamese EFL learners

First-Year Japanese Learners' Perceptions of Computerised vs. Face-to-Face Oral Testing

Contact Info

Product

Resources

About