Speech-Enabled Hybrid Multilingual Translation for Mobile Devices

Abstract

This paper presents an architecture and a prototype for speech-to-speech translation on Android devices, based on GF (Grammatical Framework). From the user's point of view, the advantage is that the system works off-line and yet has a lean size; it also gives, as a bonus, grammatical information useful for language learners. From the developer's point of view, the advantage is the open architecture that permits the customization of the system to new languages and for special purposes. Thus the architecture can be used for controlled-language-like translators that deliver very high quality, which is the traditional strength of GF. However, this paper focuses on a general-purpose system that allows arbitrary input. It covers eight languages.

Orthography Engineering in Grammatical Framework

“…Keeping all the grammatical knowledge in a single framework is a definite engineering advantage that gave us knowledge sharing and portability. All of the extensions were extensively tested in practice as part of the translation system demonstrated in Angelov et al (2014).…”

Abstract Syntax as Interlingua: Scaling Up the Grammatical Framework from Controlled Languages to Robust Pipelines

“…The first experiments addressed full-scale morphology implementations (Forsberg and Ranta 2004;Détrez and Ranta 2012), hybrid GF-SMT translation (Enache et al 2012), and multilingual lexicon extraction (Virk et al 2014;Angelov 2014). Much of the focus has been on machine translation, with an early mobile demo (Angelov, Bringert, and Ranta 2014) and an emphasis on explainability rather than optimized BLEU scores. The prospects for Explainable Machine Translation (XMT) are studied in Ranta (2017), and the general name for all the approaches described in this paper could be Explainable NLP.…”

“…This is an appropriate size for a master's thesis; examples include Japanese (Zimina 2012), Greek (Papadopoulou 2013), Maltese (Camilleri 2013), and Icelandic (Traustason 2016). To extend this to a shallow wide-coverage grammar, such as used in Angelov, Bringert, and Ranta (2014), just a few weeks more is needed, if the lexicon can be extracted from available resources (cf. Sections 5.2 and 7.1).…”

Online Customer Care: An Android Application for Mobile Customers using Speech Synthesis

“…In this paper, Angelov and Krasimir [19] presented an architecture for speech-to-speech translation on android devices which is based on Grammatical Framework (GF). The architecture is to avail for language-controlled like translator that gives very high quality, which is a strong point of GF.…”