Replication research in computer-assisted language learning: Replication of Neri et al. (2008) and Satar & Ӧzdener (2008)

Abstract

This paper argues that key findings from computer-assisted language learning (CALL) research need to be replicated to permit the construction of a valid and reliable evidence-base which can inform the design of future CALL software and activities, together with language teachers’ decisions about their adoption. Through the critical examination of two key studies, the limitations of much current CALL research with respect to the construction of such an evidence-base are highlighted and approaches to replication which may overcome these limitations are discussed. Like much CALL research, both papers are experimental studies. Key issues raised by the two studies are the need to: (1) conduct replications focused on attributes and affordances which transcend multiple technologies which might be employed in CALL, (2) collect process data to increase the explanatory power of studies, and (3) link CALL research to relevant second language acquisition (SLA) theory and research to increase the explanatory power of studies and integrate the findings from individual studies into the CALL and SLA evidence-base more broadly. Emphasis is also placed on the need to conduct replications with different populations in different settings in order to demonstrate the validity and reliability of current findings.

The impact of mobile application features on children’s language and literacy learning: a systematic review

“…Fantozzi et al, 2018;Levinson & Barron, 2018;Wang et al, 2020). There is room for more nuanced theorising and hypothesis-testing relating to the impact of app features on language learning which can be sourced from existing qualitative work (Handley, 2014(Handley, , 2018. More specifically, studies are needed to examine a wider range of features of applications (see Table 1), a greater variety of language skills (e.g.…”

Examining the factor structure and its replicability across multiple listening test forms: Validity evidence for the Michigan English Test

“…Importantly, the research goal of examining subskill replicability across test forms conforms with recent calls for replication studies across various disciplines, including applied linguistics (e.g., Coxhead, 2018; Handley, 2018; Markee, 2017; Marsden et al, 2018), educational measurement (Hosp et al, 2018), and psychology (Stanley et al, 2018). In a systematic review of replication studies in second language (L2) learning, Marsden et al (2018) recommended three subtypes of replication research from Lykken (1968), Makel et al (2012), and Schmidt (2009).…”

Replication research in instructed second language acquisition

“…In addition to a critical reading of literature as a source of motivation, the journal Language Teaching regularly publishes calls for replication studies. This is one resource that can help researchers to think about the motivation for a replication study (e.g., Handley, 2018;McManus, 2020;Révész, 2019). In these calls, researchers have proposed why particular studies need to be replicated with suggestions for variable modifications.…”