Diacritics Restoration in the Slovak Texts Using Hidden Markov Model

Hládek, Daniel; Staš, Ján; Juhár, Jozef

doi:10.1007/978-3-319-43808-5_3

Cited by 3 publications

(1 citation statement)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Same approach was utilized for the diacritization of Spanish in which a lexicon provided the observation matrix and a trigram language model was built from training data. The diacritization was formulated as a spelling correction problem (Hládek, Staš and Juhár 2016).…”

Section: Data-driven Diacritization Methodsmentioning

confidence: 99%

A survey of diacritic restoration in abjad and alphabet writing systems

2017

View full text Add to dashboard Cite

A diacritic is a mark placed near or through a character to alter its original phonetic or orthographic value. Many languages around the world use diacritics in their orthography, whatever the writing system the orthography is based on. In many languages, diacritics are ignored either by convention or as a matter of convenience. For users who are not familiar with the text domain, the absence of diacritics within text has been known to cause mild to serious readability and comprehension problems. However, the absence of diacritics in text causes near-intractable problems for natural language processing systems. This situation has led to extensive research on diacritization. Several techniques have been applied to address diacritic restoration (or diacritization) but the existing surveys of techniques have been restricted to some languages and hence left gaps for practitioners to fill. Our survey examined diacritization from the angle of resources deployed and various formulation employed for diacritization. It was concluded by recommending that (a) any proposed technique for diacritization should consider the language features and the purpose served by diacritics, (b) that evaluation metrics needed to be more rigorously defined for easy comparison of performance of models.

show abstract

Section: Data-driven Diacritization Methodsmentioning

confidence: 99%

A survey of diacritic restoration in abjad and alphabet writing systems

2017

View full text Add to dashboard Cite

show abstract

Diacritics Restoration Using Deep Neural Networks

Hucko

Lacko

2018

2018 World Symposium on Digital Intelligence for Systems and Machines (DISA)

View full text Add to dashboard Cite

Diacritics restoration based on word n-grams for Slovak texts

Toth

Zaymus

Duracik

et al. 2021

Open Computer Science

View full text Add to dashboard Cite

Despite the modern boom in technology, we are still faced with the fact that people write texts without diacritics. There are two main reasons for this. The first, historical reason stems from the past when the use of diacritics was troublesome and people would write text without them. The second one is the speed - typing without diacritics is usually faster. Text without diacritics is easy to understand for people, but for some types of documents, missing diacritics can cause a problem. This is also an issue when computers process such text. In this paper, we propose an algorithm based on word n-grams (a contiguous sequence of n words) that can restore diacritics of text written in the Slovak language. We also compare and evaluate our results with other algorithms developed for Slovak text.

show abstract

Diacritics Restoration in the Slovak Texts Using Hidden Markov Model

Cited by 3 publications

References 15 publications

A survey of diacritic restoration in abjad and alphabet writing systems

A survey of diacritic restoration in abjad and alphabet writing systems

Diacritics Restoration Using Deep Neural Networks

Diacritics restoration based on word n-grams for Slovak texts

Contact Info

Product

Resources

About