Evaluating the comparability of two measures of lexical diversity

deBoer, Fredrik

doi:10.1016/j.system.2014.10.008

Cited by 18 publications

(5 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…This result challenges the Limited Attentional Capacity Hypothesis, as well as the Cognition Hypothesis, which held that lexical complexity would be reduced when the task complexity was increased. In fact, the simplest way to measure the number of different words in a text is to calculate its type-token ratio, but the type-token ratio is easily influenced by the length of the text [45]. In view of this, the present study added three measures, namely, NDW-50, NDWER-50, and NDWES-50.…”

Section: The Main Effects Of Prior Knowledge On Linguistic Complexitymentioning

confidence: 99%

Effects of Task Complexity on Linguistic Complexity for Sustainable EFL Writing Skills Development

Wang

Jin

2022

Sustainability

View full text Add to dashboard Cite

This paper reports the findings from a study that explored the effects of task complexity on linguistic complexity in EFL writing with a within-and-between-subject design for the sustainability of EFL writing skills. A total of 178 English majors and non-English majors participated in the study. They each performed two writing tasks that were manipulated using two variables: the number of elements and prior knowledge. Linguistic complexity was measured from both syntactic and lexical aspects with 39 indices. Data analysis indicated that task complexity produced different effects on different dimensions of linguistic complexity, suggesting that research on task complexity needs to break away from simplicity and that the Cognition Hypothesis and Limited Attentional Capacity Hypothesis require further verification and refinement. This study contributes to a better understanding of task complexity and linguistic complexity in EFL writing, yielding meaningful implications for pedagogy and assessment in this field.

show abstract

Section: The Main Effects Of Prior Knowledge On Linguistic Complexitymentioning

confidence: 99%

Effects of Task Complexity on Linguistic Complexity for Sustainable EFL Writing Skills Development

Wang

Jin

2022

Sustainability

View full text Add to dashboard Cite

show abstract

“…It may be useful to devise formulae or cookbook-level 'preprocessing' steps that are tailored to agglutinating languages so as to obtain meaningful data not only in qualitative assessments, but also, moreover, in larger corpora so as to compute a sort of a semantic lexical diversity or an agglutinationcalibrated lexical diversity (cf. other variants [9,18]). Although we cannot possibly determine this here, it serves to explore this option for further investigation, for a possible chance to reuse the wealth of existing NLP tools.…”

Section: Lexical Diversitymentioning

confidence: 99%

“…The usual notion of lexical diversity (including permutations [9]) and, similarly, word frequency profiling with the log likelihood [18], are not informative as measures for agglutinating languages. The amaphoyisa and imali were but two examples to illustrate the issue with nouns, where notably prepositions are merged with the noun, and bebengakangikhumbuli as illustrative for verbs, which contains also concords for subject, object, and others, such as aspect.…”

Section: Lexical Diversitymentioning

confidence: 99%

An assessment of orthographic similarity measures for several African languages

Keet

2016

Preprint

View full text Add to dashboard Cite

Natural Language Interfaces and tools such as spellcheckers and Web search in one's own language are known to be useful in ICT-mediated communication. Most languages in Southern Africa are under-resourced, however. Therefore, it would be very useful if both the generic and the few language-specific NLP tools could be reused or easily adapted across languages. This depends on the notion, and extent, of similarity between the languages. We assess this from the angle of orthography and corpora. Twelve versions of the Universal Declaration of Human Rights are examined, showing clusters of languages, and which are thus more or less amenable to cross-language adaptation of NLP tools, which do not match with Guthrie zones. To examine the generalisability of these results, we zoom in on isiZulu both quantitatively and qualitatively with four other corpora and texts in different genres. The results show that the UHDR is a typical text document orthographically. The results also provide insight into usability of typical measures such as lexical diversity and genre, and that the same statistic may mean different things in different documents. While NLTK for Python could be used for basic analyses of text, it, and similar NLP tools, will need considerable customization.

show abstract

“…O resultado da medição da DiL através da TTR pode ser expresso no intervalo de 0 e 1, ou em porcentagens. Isso significa que quanto maior o valor da TTR, mais diversificado será o vocabulário do escrevente (DeBoer, 2014).…”

Section: Investigação: Antecedentes E Conceitosunclassified

“…Esse decréscimo parece estar associado ao crescimento do número de tokens e types, visto que o crescimento do número de types não acompanhou o crescimento do número total de tokens, resultando em uma relação inversamente proporcional entre a DiL e o número de tokens. Alguns estudos sobre a DiL (Deboer, 2014) associam essa relação inversa à repetição do vocabulário funcional, e.g. preposições e artigos.…”

Section: Conclusãounclassified

Diversidade e densidade lexical em textos escritos por alunos recém-alfabetizados: um estudo descritivo de produções individuais e em díades

Santos

Calil²,

Pereira³

et al. 2018

Calidoscópio

View full text Add to dashboard Cite

Este é um artigo de acesso aberto, licenciado por Creative Commons Atribuição 4.0 Internacional (CC BY 4.0), sendo permitidas reprodução, adaptação e distribuição desde que o autor e a fonte originais sejam creditados.RESUMO -A Diversidade Lexical (DiL) e a Densidade Lexical (DeL) podem caracterizar textos pertencentes a um determinado gênero, relacionando-os com sua riqueza lexical e com a quantidade de informações que contêm. Este estudo pretende analisar a presença desses dois aspectos em textos produzidos por alunos portugueses de 7 anos de idade na mesma sala de aula (2º ano), estudando textos escritos individualmente e em díades. A partir de oito propostas de produção textual, nas quais o professor pediu a 12 alunos que inventassem histórias, constituímos um corpus com 24 produções individuais e 36 produções em duplas. A unidade de medida adotada para DiL foi a TTR. Para calcular a DeL, foi dividido o número total de itens lexicais pelo total de palavras escritas em cada texto produzido. Os resultados obtidos mostraram que a DeL entre os textos individuais e os textos em dupla é estável, sem variação significativa. No entanto, para DiL, esses textos mostram uma maior variação, e uma relação inversamente proporcional. Comparando apenas as produções individuais, verificou-se uma tendência para o aumento da DeL, especialmente nas produções que tiveram baixa pontuação na 1ª proposta. Foi perceptível uma tendência de aumento da quantidade de palavras entre as duas produções individuais dos alunos. ABSTRACT -Lexical Diversity (LDi) and Lexical Density (LDe) may characterize texts belonging to a certain genre, relating them to its lexical richness and to the amount of information it contains. This study aims to analyze the presence of these two aspects in texts produced by Portuguese 7-year-old students in the same classroom (2 nd year), comparing individually written texts and dyad ones. From eight proposals of textual production in which the teacher asked 12 students to invent stories, we constituted a corpus including 24 individual productions and 36 dyadic productions. The unit of measure adopted for LDi was TTR. We calculated the LDe by dividing the total number of lexical items by the total number of words in each text produced. Our results show that the LDe between individual and dyadic texts is stable, with no significant variation among them. However, for LDi, these texts show a greater variation, and an inversely proportional relationship. Comparing the individual productions, we found a tendency to LDe increase, especially in those productions which had a low score in the 1st proposal. Regarding the amount of words per text, there was an increase between the two texts of the same students. In spite of the fact that this suggests that

show abstract

Evaluating the comparability of two measures of lexical diversity

Cited by 18 publications

References 13 publications

Effects of Task Complexity on Linguistic Complexity for Sustainable EFL Writing Skills Development

Effects of Task Complexity on Linguistic Complexity for Sustainable EFL Writing Skills Development

An assessment of orthographic similarity measures for several African languages

Diversidade e densidade lexical em textos escritos por alunos recém-alfabetizados: um estudo descritivo de produções individuais e em díades

Contact Info

Product

Resources

About