A conjoint analysis framework for evaluating user preferences in machine translation

Kirchhoff, Katrin; Capurro, Daniel; Turner, Anne M.

doi:10.1007/s10590-013-9140-x

Cited by 11 publications

(13 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In literature, human, automatic and embedded evaluations are three main types that are used to evaluate MT systems [21]. Many automatic techniques like BLEU, NIST and METEOR are used to evaluate the output of the MT systems.…”

Section: Related Workmentioning

confidence: 99%

Evaluating Urdu to Arabic Machine Translation Tools

Ayesha¹,

Noor²,

Ramzan³

et al. 2017

ijacsa

View full text Add to dashboard Cite

Section: Related Workmentioning

confidence: 99%

Evaluating Urdu to Arabic Machine Translation Tools

Ayesha¹,

Noor²,

Ramzan³

et al. 2017

ijacsa

View full text Add to dashboard Cite

“…Although word sense errors are not the most frequent errors overall, they are among the most disruptive error types. [30, 61]…”

Section: 3 Description Of the Phast Systemmentioning

confidence: 99%

Modeling workflow to design machine translation applications for public health practice

Turner

Brownstein

Cole

et al. 2015

Journal of Biomedical Informatics

Self Cite

View full text Add to dashboard Cite

Objective Provide a detailed understanding of the information workflow processes related to translating health promotion materials for limited English proficiency individuals in order to inform the design of context-driven machine translation (MT) tools for public health (PH). Materials and Methods We applied a cognitive work analysis framework to investigate the translation information workflow processes of two large health departments in Washington State. Researchers conducted interviews, performed a task analysis, and validated results with PH professionals to model translation workflow and identify functional requirements for a translation system for PH. Results The study resulted in a detailed description of work related to translation of PH materials, an information workflow diagram, and a description of attitudes towards MT technology. We identified a number of themes that hold design implications for incorporating MT in PH translation practice. A PH translation tool prototype was designed based on these findings. Discussion This study underscores the importance of understanding the work context and information workflow for which systems will be designed. Based on themes and translation information workflow processes, we identified key design guidelines for incorporating MT into PH translation work. Primary amongst these is that MT should be followed by human review for translations to be of high quality and for the technology to be adopted into practice. Counclusion The time and costs of creating multilingual health promotion materials are barriers to translation. PH personnel were interested in MT's potential to improve access to low-cost translated PH materials, but expressed concerns about ensuring quality. We outline design considerations and a potential machine translation tool to best fit MT systems into PH practice.

show abstract

“…Kirchhoff, Capurro, and Turner study [13] categorize the evaluation of machine translation (MT) into three main categories: human evaluation category, automatic evaluation category, and embedded application evaluation category. This section starts with presenting studies related to Metric for Evaluation of Translation with Explicit Ordering (METEOR) method to automatically evaluate machine translation.…”

Section: Related Workmentioning

confidence: 99%

Comparative Study Between METEOR and BLEU Methods of MT: Arabic into English Translation as a Case Study

Hadla¹,

Hailat²,

Al-Kabi³

2015

ijacsa

View full text Add to dashboard Cite

Abstract-The Internet provides its users with a variety of services, and these services include free online machine translators, which translate free of charge between many of the world's languages such as Arabic, English, Chinese, German, Spanish, French, Russian, etc. Machine translators facilitate the transfer of information between different languages, thus eliminating the language barrier, since the amount of information and knowledge available varies from one language to another, Arabic content on the internet, for example, accounts 1% of the total internet content, while Arabs constitute 5% of the population of the earth, which means that the intellectual productivity of the Arabs is low because within internet use Internet's Arabic content represents 20% of their natural proportion, which in turn encouraged some Arab parties to improve Arabic content within the internet. So, many of those interested specialists rely on machine translators to bridge the knowledge gap between the information available in the Arabic language and those in other living languages such as English.This empirical study aims to identify the best Arabic to English Machine translation system, in order to help the developers of these systems to enhance the effectiveness of these systems. Furthermore, such studies help the users to choose the best. This study involves the construction of a system for Automatic Machine Translation Evaluation System of the Arabic language into language. This study includes assessing the accuracy of the translation by the two known machine translators, Google Translate, and the second, which bears the name of Babylon machine translation from Arabic into English. BLEU and METEOR methods are used the MT quality, and to identify the closer method to human judgments. The authors conclude that BLEU is closer to human judgments METEOR method.

show abstract

A conjoint analysis framework for evaluating user preferences in machine translation

Cited by 11 publications

References 23 publications

Evaluating Urdu to Arabic Machine Translation Tools

Evaluating Urdu to Arabic Machine Translation Tools

Modeling workflow to design machine translation applications for public health practice

Comparative Study Between METEOR and BLEU Methods of MT: Arabic into English Translation as a Case Study

Contact Info

Product

Resources

About