A survey on the subject-verb agreement in Google Machine Translation

Abstract

To investigate subject-verb agreement of Persian translated sentences in Google machine translation, 100 sentences were taken from the BBC's English web site that 50 sentences were randomly selected to be translated by both Google Machine Translator and four Human translators, to reach a reference translation. Descriptive-statistics method was used to find out; firstly, whether Google translator compared to human translator can apply subject-verb agreement properly. Secondly, whether there is a relationship between human judgment and Machine Translation automated evaluation method. To this end, after reaching a reference translation, the researcher invited four other human translators to judge and score the Google output based on three criteria. A five-point Likert Scale was used for rating the Google translated sentences. The scale (1) was assigned for a completely unacceptable translation and(5) for an excellent one with almost no errors. Then, the researcher evaluated the same 50 Google translated sentences based on three automated metrics of Precision, Recall, and F-measure. Then, the researcher described the findings through his observation of the scores given by four human translators and found out that Google translator in comparison to the human reference translation could not apply the subject-verb agreement properly in all sentences. Then, after analyzing the "human and F-measure" assessment scores by SPSS version 22 and taking the correlation coefficient of the two scores, the researcher figured out that there was a significant relationship between human and F-measure scores.

A Comparative Study of Google Translate Translations: An Error Analysis of English-to-Persian and Persian-to-English Translations

“…Recently, another assessment to the study of Google Translate has been proposed by Bozorgian and Azadmanesh (2015). In case of subject-verb agreement, they considered both Google Translate and human translators and finally they concluded that Google Translate does not handle subject-verb agreement very well while translating English sentences into Persian compared to human translators.…”

The Influences of Machine Translation Dependency on Translation Skill

“…Machine translation was able to fix their spelling mistakes but it not helped them with grammar mistakes. It is proved the statement by [13] that stated about machine translation is not appropriate for both subjects due to its quality of translation is not comparable with a human translator who is more accurate in translating. Furthermore, researcher also found from 1 subject that were different than the others.…”

Machine Translation in Website Localization: Assessing its Translation Quality for Language Learning

“…Sense for-sense translation seems nearly impossible because its capacity is not designed for deep interpretation of different languages. Another research on GT as an MT was conducted by Bozorgian and Azadmanesh (2015). In terms of subject-verb fit, they concluded that GT failed to match subject-verb well when translating English sentences into Persian, unlike human Dewi Kesuma Nasution / Machine Translation in Website Localization: Assessing its Translation Quality translators.…”