The Development of the Light Post-editing Module for English-Kazakh Translation

Rakhimova, Diana; Karyukin, Vladislav; Karibayeva, Aidana; Turarbek, Assem; Turganbayeva, Aliya

doi:10.1145/3492547.3492651

Cited by 2 publications

(2 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Light post-editing is one of the initial and superficial stages of editing in the machine translation post-editing system. The light post-editing level involves taking the raw output from machine translation and making minimal changes to the text to make the translation understandable, essentially accurate, and grammatically correct [30,31].…”

Section: Development Of the Light Post-editing Levelmentioning

confidence: 99%

The Task of Post-Editing Machine Translation for the Low-Resource Language

Rakhimova,

Karibayeva,

Turarbek

2024

Applied Sciences

Self Cite

View full text Add to dashboard Cite

In recent years, machine translation has made significant advancements; however, its effectiveness can vary widely depending on the language pair. Languages with limited resources, such as Kazakh, Uzbek, Kalmyk, Tatar, and others, often encounter challenges in achieving high-quality machine translations. Kazakh is an agglutinative language with complex morphology, making it a low-resource language. This article addresses the task of post-editing machine translation for the Kazakh language. The research begins by discussing the history and evolution of machine translation and how it has developed to meet the unique needs of languages with limited resources. The research resulted in the development of a machine translation post-editing system. The system utilizes modern machine learning methods, starting with neural machine translation using the BRNN model in the initial post-editing stage. Subsequently, the transformer model is applied to further edit the text. Complex structural and grammatical forms are processed, and abbreviations are replaced. Practical experiments were conducted on various texts: news publications, legislative documents, IT sphere, etc. This article serves as a valuable resource for researchers and practitioners in the field of machine translation, shedding light on effective post-editing strategies to enhance translation quality, particularly in scenarios involving languages with limited resources such as Kazakh and Uzbek. The obtained results were tested and evaluated using specialized metrics—BLEU, TER, and WER.

show abstract

Section: Development Of the Light Post-editing Levelmentioning

confidence: 99%

The Task of Post-Editing Machine Translation for the Low-Resource Language

Rakhimova,

Karibayeva,

Turarbek

2024

Applied Sciences

Self Cite

View full text Add to dashboard Cite

show abstract

“…The Kazakh language also belongs to the category of low-resource languages. Therefore, it is challenging not only to find high-quality parallel corpora for the Kazakh–English (KZ–EN) language pair ( Rakhimova et al, 2021 ), but even the monolingual texts on the Internet are not represented well. For example, on the OPUS website, there are only about 1 million parallel sentences for this language pair.…”

Section: Introductionmentioning

confidence: 99%

The neural machine translation models for the low-resource Kazakh–English language pair

Karyukin

Rakhimova

Karibayeva

et al. 2023

PeerJ Computer Science

View full text Add to dashboard Cite

The development of the machine translation field was driven by people’s need to communicate with each other globally by automatically translating words, sentences, and texts from one language into another. The neural machine translation approach has become one of the most significant in recent years. This approach requires large parallel corpora not available for low-resource languages, such as the Kazakh language, which makes it difficult to achieve the high performance of the neural machine translation models. This article explores the existing methods for dealing with low-resource languages by artificially increasing the size of the corpora and improving the performance of the Kazakh–English machine translation models. These methods are called forward translation, backward translation, and transfer learning. Then the Sequence-to-Sequence (recurrent neural network and bidirectional recurrent neural network) and Transformer neural machine translation architectures with their features and specifications are concerned for conducting experiments in training models on parallel corpora. The experimental part focuses on building translation models for the high-quality translation of formal social, political, and scientific texts with the synthetic parallel sentences from existing monolingual data in the Kazakh language using the forward translation approach and combining them with the parallel corpora parsed from the official government websites. The total corpora of 380,000 parallel Kazakh–English sentences are trained on the recurrent neural network, bidirectional recurrent neural network, and Transformer models of the OpenNMT framework. The quality of the trained model is evaluated with the BLEU, WER, and TER metrics. Moreover, the sample translations were also analyzed. The RNN and BRNN models showed a more precise translation than the Transformer model. The Byte-Pair Encoding tokenization technique showed better metrics scores and translation than the word tokenization technique. The Bidirectional recurrent neural network with the Byte-Pair Encoding technique showed the best performance with 0.49 BLEU, 0.51 WER, and 0.45 TER.

show abstract

The Development of the Light Post-editing Module for English-Kazakh Translation

Cited by 2 publications

References 10 publications

The Task of Post-Editing Machine Translation for the Low-Resource Language

The Task of Post-Editing Machine Translation for the Low-Resource Language

The neural machine translation models for the low-resource Kazakh–English language pair

Contact Info

Product

Resources

About