10 Words and paradigms bit by bit: An information‐theoretic approach to the processing of inflection and derivation

Milin, Petar; Kuperman, Victor; Kostić, Aleksandar Đ.; Baayen, Harald

doi:10.1093/acprof:oso/9780199547548.003.0010

Cited by 113 publications

(61 citation statements)

References 199 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Lukatela et al, 1978;Lukatela, Gligorijević, Kostić, & Turvey, 1980;Kostić & Katz, 1987). One possible interpretation is that it mirrors the difference in number of syntactic functions and meanings of Serbian noun cases, where nominative has only three functions/meanings, as compared to a magnitude larger number for the other (oblique) cases used in this study (more about the role of syntactic functions and meanings in Serbian in Kostić, Marković, & Baucal, 2003; also, syntactic functions and meanings are further discussed in the framework of information theory by Milin, Kuperman, Kostić, & Baayen, 2009).…”

Section: Resultsmentioning

confidence: 78%

An amorphous model for morphological processing in visual comprehension based on naive discriminative learning.

Baayen

Milin

Đurđević

et al. 2011

Psychological Review

Self Cite

458

487

View full text Add to dashboard Cite

A two-layer symbolic network model based on the equilibrium equations of the Rescorla-Wagner model (Danks, 2003) is proposed. The study starts by presenting two experiments in Serbian, which reveal for sentential reading the inflectional paradigmatic effects previously observed by Milin, Filipović Durdević, and Moscoso del Prado Martín (2009) for unprimed lexical decision. The empirical results are successfully modeled without having to assume separate representations for inflections or data structures such as inflectional paradigms. In the next step, the same naive discriminative learning approach is pitted against a wide range of effects documented in the morphological processing literature. Frequency effects for complex words as well as for phrases (Arnon & Snider, 2010) emerge in the model without the presence of whole-word or whole-phrase representations. Family size effects Moscoso del Prado Martín, Bertram, Häikiö, Schreuder, & Baayen, 2004) emerge in the simulations across simple words, derived words, and compounds, without derived words or compounds being represented as such. It is shown that for pseudo-derived words no special morpho-orthographic segmentation mechanism as posited by Rastle, Davis, and New (2004) is required. The model also replicates the finding of Plag and Baayen (2009), that, on average, words with more productive affixes elicit longer response latencies, while at the same time predicting that productive affixes afford faster response latencies for new words. English phrasal paradigmatic effects modulating isolated word reading are reported and modelled, showing that the paradigmatic effects characterizing Serbian case inflection have cross-linguistic scope.

show abstract

Section: Resultsmentioning

confidence: 78%

An amorphous model for morphological processing in visual comprehension based on naive discriminative learning.

Baayen

Milin

Đurđević

et al. 2011

Psychological Review

Self Cite

458

487

View full text Add to dashboard Cite

show abstract

“…Information theory can further help to understand the complexities involved when building words from the smallest meaningful units, i.e., morphemes [29,30].…”

Section: Introductionmentioning

confidence: 99%

The Entropy of Words—Learnability and Expressivity across More than 1000 Languages

Bentz

Alikaniotis

Cysouw

et al. 2017

Entropy

View full text Add to dashboard Cite

Abstract:The choice associated with words is a fundamental property of natural languages. It lies at the heart of quantitative linguistics, computational linguistics and language sciences more generally. Information theory gives us tools at hand to measure precisely the average amount of choice associated with words: the word entropy. Here, we use three parallel corpora, encompassing ca. 450 million words in 1916 texts and 1259 languages, to tackle some of the major conceptual and practical problems of word entropy estimation: dependence on text size, register, style and estimation method, as well as non-independence of words in co-text. We present two main findings: Firstly, word entropies display relatively narrow, unimodal distributions. There is no language in our sample with a unigram entropy of less than six bits/word. We argue that this is in line with information-theoretic models of communication. Languages are held in a narrow range by two fundamental pressures: word learnability and word expressivity, with a potential bias towards expressivity. Secondly, there is a strong linear relationship between unigram entropies and entropy rates. The entropy difference between words with and without co-textual information is narrowly distributed around ca. three bits/word. In other words, knowing the preceding text reduces the uncertainty of words by roughly the same amount across languages of the world.

show abstract

“…This research emphasizes the role of patterns of language use and language change in the development of cross-linguistic regularities, rather than placing the burden of explanation on synchronic cognitive factors such as an innate Universal Grammar (Evans & Levinson 2009). This systems approach to language (see also Ramscar & Yarlett 2007, Milin et al 2009 in press, among others) links linguistic study to larger trends in the biological and social sciences (e.g., Epstein 2006, Miller & Page 2007, Capra & Luisi 2014.…”

Section: Discussionmentioning

confidence: 98%

The No Blur Principle Effects as an Emergent Property of Language Systems

Ershova¹

2015

bling_proceedings

View full text Add to dashboard Cite

10 Words and paradigms bit by bit: An information‐theoretic approach to the processing of inflection and derivation

Abstract: This chapter models the role of paradigm structure in lexical processing using cross-entropy measure. New experimental data demonstrates the usefulness of entropy, relative entropy, and cross entropy in modeling analogical generalizations.

Cited by 113 publications

References 199 publications

An amorphous model for morphological processing in visual comprehension based on naive discriminative learning.

An amorphous model for morphological processing in visual comprehension based on naive discriminative learning.

The Entropy of Words—Learnability and Expressivity across More than 1000 Languages

The No Blur Principle Effects as an Emergent Property of Language Systems

Contact Info

Product

Resources

About