Neural mechanisms and time course of the age-related word frequency effect in language production

Statistical Language Model-based Analysis of English Corpora and Literature

“…This study provides an effective method for learning foreign language vocabulary. The author in [2] investigated the specific case of word frequency effects decreasing with age based on word frequency theory in statistical language models and suggested that word frequency effects may occur at different stages of language production. Ge [11] proposed a hybrid research framework combining word frequency analysis from Google Books Ngram Viewer with other analyses in conjunction with statistical language models.…”

“…To obtain the output with the lowest error rate, the log-linear model is used to compute the posterior probability of the sentence pair ( , ) Rf and recalculate the score, i.e., the ranking basis. The calculation procedure is shown in (2).…”

“…Statistical language models are models that use statistics to calculate the probability distribution of word occurrences in a particular language or context, which users use as a basis for operations and predictions [1]. With the maturity of technologies such as machine translation and speech recognition, statistical language models have become more widely used [2]. However, as a data-driven model, a single statistical language model has limited ability to process natural language and cannot reflect the linguistic features of natural language [3].…”