Testing Language Aptitude

Rogers, Vivienne; Meara, Paul; Rogers, Brian

doi:10.1017/9781009076463.005

Cited by 4 publications

(5 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Even with this effort, LLAMA D did not work well as an implicit test. Our recommendation, therefore, is to stop using LLAMA D as a measure of implicit aptitude and use the test as was originally intended, that is, as a test of sound recognition/listening ability (Meara, 2005;Rogers et al, 2023). This is the direction the LLAMA developer team is heading; the newer version of LLAMA D is accompanied by an explicit type of test instructions (Rogers et al, 2023).…”

Section: Discussionmentioning

confidence: 99%

“…Our recommendation, therefore, is to stop using LLAMA D as a measure of implicit aptitude and use the test as was originally intended, that is, as a test of sound recognition/listening ability (Meara, 2005;Rogers et al, 2023). This is the direction the LLAMA developer team is heading; the newer version of LLAMA D is accompanied by an explicit type of test instructions (Rogers et al, 2023). Additionally, the number of test items increased from 30 to 40 in the newer version, which should mitigate the issue of low reliability (e.g., α = .47-.58 in our study; .54 in Bokander & Bylund, 2020;.20 in Suzuki, 2021).…”

Section: Discussionmentioning

confidence: 99%

“…Additionally, the number of test items increased from 30 to 40 in the newer version, which should mitigate the issue of low reliability (e.g., α = .47-.58 in our study; .54 in Bokander & Bylund, 2020;.20 in Suzuki, 2021). For other changes from Version 2 to 3, see Rogers et al (2023).…”

Section: Discussionmentioning

confidence: 99%

“…However, the creator of the LLAMA tests noted that the tests have not been properly validated, and thus that "they should NOT be used in high-stakes situations" (Meara, 2005, p. 21). More than a decade later this still appears to be true (although some validation work is under way, e.g., Bokander & Bylund, 2020;Rogers et al, 2023). On top of that, the suggestion that LLAMA B, E, and F and LLAMA D tap explicit and implicit language learning aptitude, respectively, is essentially based solely on Granena's (2013aGranena's ( , 2019 work, and such use of the tests is beyond the original intention of the test developer.…”

Section: Llama D As a Measure Of Implicit Learning Aptitudementioning

confidence: 99%

See 3 more Smart Citations

Scrutinizing LLAMA D as a measure of implicit learning aptitude

Iizuka

DeKeyser

2023

Stud Second Lang Acquis

View full text Add to dashboard Cite

Since Gisela Granena’s influential work, LLAMA D v2, a sound recognition subtest of LLAMA aptitude tests, has been used as a measure of implicit learning aptitude in second language acquisition research. The validity of this test, however, is little known and the results of studies with this instrument have been somewhat inconsistent. In this study, we tested the hypothesis that researchers’ variable test instructions are the source of the inconsistent results. One hundred fourteen English monolinguals were randomly assigned to take LLAMA D v2 under one of three test instruction conditions. They also completed two implicit aptitude tests, three explicit aptitude tests, and a sound discrimination test. The results showed that, regardless of the type of test instructions, LLAMA D scores did not align with implicit aptitude test scores, indicating no clear evidence of the test being implicit. On the contrary, LLAMA D scores were negatively associated with scores on one implicit aptitude test, the Serial Reaction Time (SRT) task, but only in the condition where the instructions drew participants’ focal attention to the stimuli. This negative association was interpreted as focal attention working against learning in the SRT task. Implicit learning aptitude may be the degree to which one is able to process input without focal attention.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Section: Llama D As a Measure Of Implicit Learning Aptitudementioning

confidence: 99%

See 2 more Smart Citations

Scrutinizing LLAMA D as a measure of implicit learning aptitude

Iizuka

DeKeyser

2023

Stud Second Lang Acquis

View full text Add to dashboard Cite

show abstract

“…Rather than simply recognizing previously encountered items, associative learning tasks are used to measure how people encode and retrieve associations between stimuli (Arndt, 2012), such as word pairs or word-object pairs or stimuli and their context (Eichenbaum, 2012), such as words and other context-specific details like font color. Within L2 research, declarative memory measures based on associative learning tasks most typically employ word pairs (e.g., Modern Language Aptitude Test section V (MLAT-V): Carroll & Sapon, 1959) or word-object pairs (e.g., LLAMA-B: Meara, 2005; Applied Linguistics Progr Ammes for the Computerised Assessment of Aptitude (ALPACCA): Rogers et al, 2023).…”

Section: Declarative Memory Task Demandsmentioning

confidence: 99%

Do verbal and nonverbal declarative memory tasks in second language research measure the same abilities?

Hamrick,

Was,

Zhang

2024

Stud Second Lang Acquis

View full text Add to dashboard Cite

A growing body of evidence demonstrates that individual differences in declarative memory may be an important predictor of second language (L2) abilities. However, the evidence comes from studies using different declarative memory tasks that vary in their reliance on verbal abilities and task demands, which preclude estimating the size of the relationship between declarative memory and L2 learning. To address these concerns, we examined the relationship between verbal and nonverbal declarative memory abilities within the same task while controlling for task demands and stimulus modality, to estimate the upper bound of the relationship between verbal and nonverbal declarative memory. Results indicate that when task demands and stimulus modality are controlled, verbal and nonverbal declarative memory abilities shared a medium-to-large amount of underlying variance. However, future studies should exercise caution in appraising associations between declarative memory abilities and L2 learning until a more precise understanding of the underlying mechanisms is achieved.

show abstract

Bilinguals outperform trilinguals in implicit language aptitude: the mediating role of selective attention

Huang,

Li,

et al. 2024

Journal of Multilingual and Multicultural Development

View full text Add to dashboard Cite

Testing Language Aptitude

Cited by 4 publications

References 0 publications

Scrutinizing LLAMA D as a measure of implicit learning aptitude

Scrutinizing LLAMA D as a measure of implicit learning aptitude

Do verbal and nonverbal declarative memory tasks in second language research measure the same abilities?

Bilinguals outperform trilinguals in implicit language aptitude: the mediating role of selective attention

Contact Info

Product

Resources

About