Discontinuous grammar as a foreign language

Fernández-González, Daniel; Gómez-Rodríguez, Carlos

doi:10.1016/j.neucom.2022.12.045

Cited by 4 publications

(2 citation statements)

References 61 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This shift-reduce scheme is the simplest general method to deal with a sentence structure (Zhang, 2020). It has become a standard way to parse a sentence, and its use is an ongoing research topic (Fernández-González and Gómez-Rodríguez, 2019;Yang and Deng, 2020;Grenander et al, 2022;Fernández-González and Gómez-Rodríguez, 2023). Hence, knowledge of a sentence structure's Strahler number can give a lower-limit criterion for the amount of memory required to process the sentence structure.…”

Section: Relation To Number Of Memory Areas Required To Process Treesmentioning

confidence: 99%

Correction to: Statistical Universals of Language

Tanaka-Ishii

2023

Mathematics in Mind

View full text Add to dashboard Cite

show abstract

Section: Relation To Number Of Memory Areas Required To Process Treesmentioning

confidence: 99%

Correction to: Statistical Universals of Language

Tanaka-Ishii

2023

Mathematics in Mind

View full text Add to dashboard Cite

show abstract

“…There are other monolingual dependency parsers(Wang and Tu, 2020;Fernández- González and Gómez-Rodríguez, 2021;Yang and Tu, 2021) achieving state-of-the art results in different settings. These studies focus on parsing algorithms rather than scaling a single parser to multiple languages or zero-shot parsing.…”

mentioning

confidence: 99%

Multilingual Learning and Adaptation for Neural Language Models

Üstün¹

View full text Add to dashboard Cite

This thesis represents more than just an academic achievement. It marks a new chapter in my life, one that has been filled with lots of fun, fulfillment, and rewards that will endure for a lifetime. I would like to sincerely thank everyone who has supported me along the way.First and foremost, I thank my supervisors: Gertjan, Gosse, and Arianna.Gertjan, you were a constant source of support that I needed many times. As my supervisor, you always made me feel secure and confident, not only in my academic pursuits but also as a person. Your guidance on my research direction has played a pivotal role in this thesis. I will also always remember our attempt at a 40 km walk, even though I was not unable to finish it.Gosse, in addition to your continuous mentorship for my research and this thesis, your calm attitude and patience as a supervisor, were perfect examples for me to follow, especially as an ambitious and sometimes impatient student, that helped me become a better researcher. I also genuinely enjoyed our lunchtime chats, particularly about cycling, which made me excited to watch the Tour de France at the end of 4 years.Arianna, I'm very glad that I asked you to be my supervisor when you joined the department. Your knowledge and guidance in my research interests, your attention to precise details and pursuit for "excellence" have deeply influenced this thesis and my perspective on research. I also never imagined having a supervisor with whom I can speak Turkish which is an unexpected delight, especially with your kids. I believe we made a great team, and working together was a truly enjoyable experience. Once again, I thank my supervisors.Throughout my PhD, I had the opportunity to collaborate with a group of exceptional individuals. I would like to thank Asa Cooper Stickland, Alexandre Berard, Barbara Plank, Matthias Gallé, Rob van der Goot, Laurent Besacier, and Sebastian Ruder for their invaluable contribution to my research.I would also like to thank the members of my reading committee, Joakim Nivre, Jörg Tiedemann, and Jack Hoeksema, for reading my thesis and providing me with useful feedback which helped to improve this thesis.

show abstract

Strahler number of natural language sentences in comparison with random trees

Tanaka-Ishii,

Tanaka

2023

J. Stat. Mech.

View full text Add to dashboard Cite

The Strahler number was originally proposed to characterize the complexity of river bifurcation and has found various applications. This article proposes a computation of the Strahler number’s upper and lower limits for natural language sentence tree structures. Through empirical measurements across grammatically annotated data, the Strahler number of natural language sentences is shown to be almost 3 or 4, similar to the case of river bifurcation as reported by Strahler (1957 Eos Trans. Am. Geophys. Union 38 913–20). Based on the theory behind this number, we show that there is a kind of lower limit on the amount of memory required to process sentences. We consider the Strahler number to provide reasoning that explains reports showing that the number of required memory areas to process sentences is 3–4 for parsing (Schuler et al 2010 Comput. Linguist. 36 1–30), and reports indicating a psychological ‘magical number’ of 3–5 (Cowan 2001 Behav. Brain Sci. 24 87–114). An analytical and empirical analysis shows that the Strahler number is not constant but grows logarithmically. Therefore, the Strahler number of sentences is derived from the range of sentence lengths. Furthermore, the Strahler number is not different for random trees, which could suggest that its origin is not specific to natural language.

show abstract

Discontinuous grammar as a foreign language

Cited by 4 publications

References 61 publications

Correction to: Statistical Universals of Language

Correction to: Statistical Universals of Language

Multilingual Learning and Adaptation for Neural Language Models

Strahler number of natural language sentences in comparison with random trees

Contact Info

Product

Resources

About