A multi-perspective evaluation of the NESPOLE!

Lavie, Alon; Metze, Florian; Cattoni, Roldano; Costantini, Erica

doi:10.3115/1118656.1118673

Cited by 13 publications

(3 citation statements)

References 9 publications

(3 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This is comparable to evaluations of other state-of-the-art systems such as NESPOLE! (Lavie et al, 2002), which obtained slightly lower results and were performed on Semantic Dialog Units (see below) instead of utterances (UTT), thus simplifying the translation task. The Catalan-English and English-Catalan pairs were both quite good with 73.1% and 73.5% of the utterances being judged acceptable, respectively, and the Spanish-English pair performs very well with 96.4% of the utterances being acceptable.…”

Section: Task-oriented Evaluation Resultsmentioning

confidence: 99%

Multi-perspective evaluation of the FAME speech-to-speech translation system for Catalan, English and Spanish

Arranz¹,

Comelles²,

Farwell³

2007

Recent Advances in Natural Language Processing IV

View full text Add to dashboard Cite

This paper describes the evaluation of the FAME interlingua-based speech-to-speech translation system for Catalan, English and Spanish. This system is an extension of the already existing NESPOLE! that translates between English, French, German and Italian. This article begins with a brief introduction followed by a description of the system architecture and the components of the translation module including the Speech Recognizer, the analysis chain, the generation chain and the Speech Synthesizer. Then we explain the interlingua formalism used, called Interchange Format (IF). We show the results obtained from the evaluation of the system and we describe the three types of evaluation done. We also compare the results of our system with those obtained by a stochastic translator which has been independently developed over the course of the FAME project. Finally, we conclude with future work.

show abstract

Section: Task-oriented Evaluation Resultsmentioning

confidence: 99%

Multi-perspective evaluation of the FAME speech-to-speech translation system for Catalan, English and Spanish

Arranz¹,

Comelles²,

Farwell³

2007

Recent Advances in Natural Language Processing IV

View full text Add to dashboard Cite

show abstract

“…As part of this work we investigated two different techniques for translation, both interlingua based. The first was purely knowledge-based, following our previous work [3]. The engine developed for this was too large to run on the device, although we were able to run the generation part offline seamlessly connected by a wireless link from the handheld device.…”

Section: Translationmentioning

confidence: 99%

Speechalator: two-way speech-to-speech translation on a consumer PDA

Waibel¹,

Badran²,

Black³

et al. 2003

8th European Conference on Speech Communication and Technology (Eurospeech 2003)

Self Cite

View full text Add to dashboard Cite

This demonstration involves two-way automatic speechto-speech translation on a consumer off-the-shelf PDA. This work was done as part of the DARPA-funded Babylon project, investigating better speech-to-speech translation systems for communication in the field. The development of the Speechalator software-based translation system required addressing a number of hard issues, including a new language for the team (Egyptian Arabic), close integration on a small device, computational efficiency on a limited platform, and scalable coverage for the domain.

show abstract

“…Evaluation of the TTS module is often done in isolation or not mentioned at all (e.g. [2]). The ultimate objective of a speech-to-speech translation system, however, is to provide spoken output in contexts where display or comprehension of text output is not possible, and a clear understanding of performance of TTS under different system conditions is necessary for the evaluation of the system.…”

Section: Introductionmentioning

confidence: 99%