Improving Multilingual Neural Machine Translation System for Indic Languages

Abstract

Machine Translation System (MTS) serves as an effective tool for communication by translating text or speech from one language to another language. Recently, neural machine translation (NMT) has emerged to be popular for its performance and cost-effectiveness. However, NMT systems are restricted in translating low-resource languages as it requires huge quantity of data set to learn useful mappings across languages. The need of an efficient translation system becomes obvious in a large multilingual environment like India. Indian Language (ILs) are still treated as low-resource languages due to unavailability of corpora. In order to address such asymmetric nature, multilingual neural machine translation (MNMT) system evolves as an ideal approach in this direction. The MNMT converts many languages using a single model which are extremely useful in terms of training process and lowering online maintenance costs. It is also helpful for improving low-resource translation. In this paper, we propose a MNMT system to address the issues related to low-resource language translation. Our model comprises of two MNMT systems i.e. for English-Indic (one-to-many) and the other for Indic-English (many-to-one) with a shared encoder-decoder containing 15 language pairs (30 translation directions). Since most of IL pairs have scanty amount of parallel corpora, not sufficient for training any machine translation model, we explore various augmentation strategies to improve overall translation quality through the proposed model. A state-of-the-art transformer architecture is used to realize the proposed model. In addition, the paper addresses the use of language relationships (in terms of dialect, script, etc.), particularly about the role of high-resource languages of the same family in boosting the performance of low-resource languages. Moreover, the experimental results also show the advantage of backtranslation and domain adaptation for ILs to enhance the translation quality of both source and target languages. Using all these key approaches, our proposed model emerges to be more efficient than the baseline model in terms of evaluation metrics i.e BLEU (BiLingual Evaluation Understudy) score for a set of ILs.

Statistical machine translation for Indic languages

“…Further, limitations in public communication also bring inconvenience to share feelings, thoughts, opinions, and facts, as well as to deal with business purposes. Moreover, there are many resources available on the internet in EN but many Indians struggle to take benefit of those due to language barriers (Das et al 2024).…”

Dynamic decoding and dual synthetic data for automatic correction of grammar in low-resource scenario

“…GEC has been a very prominent NLP task in recent decades. Various approaches have been presented to improve the performance of the GEC system, ranging from rule-based ( Chauhan et al, 2023 ), n-gram-based ( Li et al, 2022 ), to state-of-the-art neural-based approaches such as statistical machine translation (SMT) ( Das et al, 2023 ) and neural machine translation (NMT) ( Solyman et al, 2022 ; Mahmoud et al, 2023 ). The success of deep learning techniques such as NMT has helped advance GEC applications in both research and industry ( White & Rozovskaya, 2020 ).…”