A meta-analysis of effectiveness studies on computer technology-supported language learning

Abstract

With the aim of summarizing years of research comparing pedagogies for second/foreign language teaching supported with computer technology and pedagogy not-supported by computer technology, a meta-analysis was conducted of empirical research investigating language outcomes. Thirty-seven studies yielding 52 effect sizes were included, following a search of literature from 1970 to 2006 and screening of studies based on stated criteria. The differences in research designs required subdivision of studies, but overall results favored the technology-supported pedagogy, with a small, but positive and statistically significant effect size. Second/ foreign language instruction supported by computer technology was found to be at least as effective as instruction without technology, and in studies using rigorous research designs the CALL groups outperformed the non-CALL groups. The analyses of instructional conditions, characteristics of participants, and conditions of the research design did not provide reliable results because of the small number of effect sizes representing each group. The meta-analysis results provide an empirically-based response to the questions of whether or not technology-supported pedagogies enhance language learning, and the process of conducting the meta-analysis pointed to areas in research methodology that would benefit from attention in future research. KeywordsDepartment of Statistics, research methods, meta-analysis, secondary research, second/foreign language learning, computer-assisted language learning AbstractWith the aim of summarizing years of research comparing pedagogies for second/foreign language teaching supported with computer technology and pedagogy not-supported by computer technology, a meta-analysis was conducted of empirical research investigating language outcomes. Thirty-seven studies yielding 52 effect sizes were included, following a search of literature from 1970 to 2006 and screening of studies based on stated criteria. The differences in research designs required subdivision of studies, but overall results favored the technology-supported pedagogy, with a small, but positive and statistically significant effect size. Second/foreign language instruction supported by computer technology was found to be at least as effective as instruction without technology, and in studies using rigorous research designs the CALL groups outperformed the non-CALL groups. The analyses of instructional conditions, characteristics of participants, and conditions of the research design did not provide reliable results because of the small number of effect sizes representing each group. The meta-analysis results provide an empirically-based response to the questions of whether or not technology-supported pedagogies enhance language learning, and the process of conducting the meta-analysis pointed to areas in research methodology that would benefit from attention in future research.

Pure pedagogy: educational tools to maintain student interest and engagement in language courses

“…Should technology be used with language students in 2017? Grgurović, Chapelle, and Shelley (2013) showed that technology use in language classrooms can be as effective as language classrooms that do not utilize technology. The observations of Prensky (2001) and Tulgan, Baumann, Graham and MacDonald (2016) clarify that these students are engaged with technology outside of the classroom and educators are currently experimenting with signs of success, as discussed previously with the findings of Liu, Lan, and Jenkins (2014).…”

“…Researchers have evaluated technology implementation in the past and the results lean towards the use of it. Grgurović, Chapelle, and Shelley (2013) analyzed the effectiveness of language pedagogies with technology in contrast with language pedagogies without technology by considering empirical research, which included 85 studies from and found that language instruction with technology was as effective as language instruction without technology. This provides evidence that technology can be beneficial in language classrooms and supports educators who have an interest in implementing technology to maintain the interest and increase engagement with current students.…”

A Linguistic Integrative Model for Enhancing College Students’ English Reading Competence

“…Research (Eskenazi, Michael, & Folk, 2015;Linderholm et al, 2013;O'Sullivan & Dallas, 2010;Reid, 2013;Tang, 2016;Yang, 2010) indicated that reading instruction had influenced students' ability to read fluently and efficiently. Research (Dreyer & Nel, 2003;Grgurović, Chapelle, & Shelley, 2013;Shang, 2015;Tsai et al, 2016;Wright, Fugett, & Francine, 2013) also showed that integrating modern technology into teaching strategies resulted in improving students' performance in reading comprehension and reading strategies. To investigate such integration, the present study collected data from 100 undergraduate students at the College of Languages and Translation, IMAMU University.…”

Building a multilingual niche: code-choice and code-alternation at the Day of Multilingual Blogging

“…Blogs may be one of the most researched technologies in computer-assisted language learning (CALL) (GRGUROVIĆ;CHAPELLE;SHELLEY, 2013). Mostly, they are seen as writing (as opposed to reading, but cf.…”