Evaluating translation quality as input to product development

Bohan, Niamh; Breidt, Elisabeth

doi:10.5167/uzh-28555

Cited by 3 publications

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

An automatic evaluation method for localization oriented lexicalised EBMT system

Yao

Zhou

Zhao

et al. 2002

Proceedings of the 19th International Conference on Computational Linguistics -

View full text Add to dashboard Cite

To help developing a localization oriented EBMT system, an automatic machine translation evaluation method is implemented which adopts edit distance, cosine correlation and Dice coefficient as criteria. Experiment shows that the evaluation method distinguishes well between "good" translations and "bad" ones. To prove that the method is consistent with human evaluation, 6 MT systems are scored and compared. Theoretical analysis is made to validate the experimental results. Correlation coefficient and significance tests at 0.01 level are made to ensure the reliability of the results. Linear regression equations are calculated to map the automatic scoring results to human scorings.

show abstract

An automatic evaluation method for localization oriented lexicalised EBMT system

Yao

Zhou

Zhao

et al. 2002

Proceedings of the 19th International Conference on Computational Linguistics -

View full text Add to dashboard Cite

show abstract

Measuring user acceptability of machine translations to diagnose system errors

Hui

2002

COLING-02 on Machine Translation in Asia -

View full text Add to dashboard Cite

Application and Analysis of Sentence Similarity Based Machine Translation Evaluation

Yao¹,

Yu²,

Zhao³

et al. 2004

Journal of Natural Language Processing

View full text Add to dashboard Cite

To help developing a localization oriented example based machine translation (EBMT)system,an automatic machine translation evaluation method is implemented which adopts edit similarity,cosine correlation and Dice coefficient as criteria.Experiment shows that the evaluation method distinguishes well between translations of different intelligibility and fluency.The similarity between Dice coefficient and cosine are analyzed mathematically and observed in the experiments.To verify the consistency between automatic and human evaluation methods,six machine translation systems are scored using both human and automatic methods.The evaluation results are compared which show consistency between different evaluation methods. Statistical analysis is made to validate the experimental results.Correlation coefresults. Linear regression equations are built to map the automatic scoring results to human scorings.The regression equation is utilized to predict human scoring of machine translation systems.The prediction result is promising.Experimental results show that the proposed MT evaluation method is applicable to general MT systems and EBMT as well.

show abstract

Evaluating translation quality as input to product development

Cited by 3 publications

References 0 publications

An automatic evaluation method for localization oriented lexicalised EBMT system

An automatic evaluation method for localization oriented lexicalised EBMT system

Measuring user acceptability of machine translations to diagnose system errors

Application and Analysis of Sentence Similarity Based Machine Translation Evaluation

Contact Info

Product

Resources

About