Evaluating English to Arabic Machine Translation Using BLEU

Abstract

Abstract-This study aims to compare the effectiveness of two popular machine translation systems (Google Translate and Babylon machine translation system) used to translate English sentences into Arabic relative to the effectiveness of English to Arabic human translation. There are many automatic methods used to evaluate different machine translators, one of these methods; Bilingual Evaluation Understudy (BLEU) method, which was adopted and implemented to achieve the main goal of this study. BLEU method is based on the assumptions of automated measures that depend on matching machine translators' output to human reference translations; the higher the score, the closer the translation to the human translation will be. Well known English sayings in addition to manually collected sentences from different Internet web sites were used for evaluation purposes. The results of this study have showed that Google machine translation system is better than Babylon machine translation system in terms of precision of translation from English to Arabic.

Evaluation of domain sulfur industry for DIA translator using bilingual evaluation understudy method

“…BLEU is highly constructed on an essential notion for determining the goodness of a particular MT programme. It could be made briefly by the proximity of the proposed outcome of the MT scheme with indication to a translated text done by an (experienced human) translation of the text itself [8].…”