An automatic speech translation system on PDAs for travel conversation

Isotani, Ryosuke; Yamabana, Kiyoshi; Ando, Shin; Hanazawa, Ken; Ishikawa, S.; Emori, Tadashi; Iso, Ken-ichi; Hattori, Hiroaki; Okumura, Akitoshi; Watanabe, Takao

doi:10.1109/icmi.2002.1166995

Cited by 15 publications

(7 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The second is to evaluate total performance, including the users' subjective opinions. As performance has been evaluated using different application systems, such as an automatic speech translation system (Isotani, et al, 2002) and a speechactivated text retrieval system (Ikeda, et al, 2005), we concentrated on evaluating the total performance based on surveying users' opinions about the blogs they created using the developed system. The survey results were analyzed in terms of speech recognition accuracy and users' blog making experience to improve the system.…”

Section: Discussionmentioning

confidence: 99%

“…To solve this problem, we used a compact and scalable large-vocabulary continuous speech recognition framework, which has been shown to work on low-power devices, such as PDAs (Isotani et al,2005). The framework achieves compact and high-speed processing by the following techniques: -Efficient reduction of Gaussian components using MDL criterion (Shinoda, et al, 2002) -High-speed likelihood calculation using treestructured probability density functions (Watanabe, et al, 1995) -Compaction of search algorithm using lexical prefix tree and shared usage of calculated language model scores (Isotani et al, 2005) The framework we developed contained a Japanese lexicon of 50,000 words typically used in travel conversations based on a speech translation system (Isotani, et al, 2002). We were able to evaluate the developed system by making a travel blog using Japanese dialogue with PaPeRo.…”

Section: Continuous Speech Recognitionmentioning

confidence: 99%

See 1 more Smart Citation

Multimedia blog creation system using dialogue with intelligent robot

Okumura

Ikeda

Nishizawa

et al. 2007

Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions - ACL '07

View full text Add to dashboard Cite

A multimedia blog creation system is described that uses Japanese dialogue with an intelligent robot. Although multimedia blogs are increasing in popularity, creating blogs is not easy for users who lack highlevel information literacy skills. Even skilled users have to waste time creating and assigning text descriptions to their blogs and searching related multimedia such as images, music, and illustrations. To enable effortless and enjoyable creation of multimedia blogs, we developed the system on a prototype robot called PaPeRo. Video messages are recorded and converted into text descriptions by PaPeRo using continuous speech recognition. PaPeRo then searches for suitable multimedia contents on the internet and databases, and then, based on the search results, chooses appropriate sympathetic comments by using natural language text retrieval. The retrieved contents, PaPeRo's comments, and the video recording on the user's blog is automatically uploaded and edited. The system was evaluated by 10 users for creating travel blogs and proved to be helpful for both inexperienced and experienced users. The system enabled easy multimediarich blog creation and even provided users the pleasure of chatting with PaPeRo.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Continuous Speech Recognitionmentioning

confidence: 99%

Multimedia blog creation system using dialogue with intelligent robot

Okumura

Ikeda

Nishizawa

et al. 2007

Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions - ACL '07

View full text Add to dashboard Cite

show abstract

“…Speech translation systems, which are realized by integrating speech recognition, machine translation and text-tospeech synthesis, have already been investigated [1][2][3]. And some systems have been built on handheld devices [4,5]. However, speech translation systems encounter two problems, namely, recognition error and translation error [6].…”

Section: Introductionmentioning

confidence: 99%

A multi modal supporting tool for multi lingual communication by inducing partner's reply

Imoto

Sasajima

Shimomori

et al. 2006

Proceedings of the 11th International Conference on Intelligent User Interfaces

View full text Add to dashboard Cite

This paper introduces a new tool for supporting multilingual communication between speakers of different languages. Conventional tools such as electronic dictionaries enable users to communicate basic intentions to others, but are often insufficient to help understand replies. The input of a Japanese sentence in the proposed tool not only produces a translation of the sentences but also displays a window featuring possible answers. The authors have evaluated the function of a prototype system which resulted in a thorough understanding of the merits and comings of the proposed tool.

show abstract

“…Projects concerning speech translation such as TC-STAR (Hoge, 2002) and DARPA Babylon have been executed, and conferences on spoken language translation such as IWSLT have been held. Though some speech translation systems have been developed so far (Frederking et al, 2002;Isotani et al, 2003;Liu et al, 2003;Takezawa et al, 1998), these systems, because of their sentence-by-sentence translation, cannot start to translate a sentence until it has been fully uttered. The following problems may arise in cross-language communication:…”

Section: Introductionmentioning

confidence: 99%

Simultaneous English-Japanese spoken language translation based on incremental dependency parsing and transfer

Ryu

Matsubara

Inagaki

2006

Proceedings of the COLING/ACL on Main Conference Poster Sessions -

View full text Add to dashboard Cite

This paper proposes a method for incrementally translating English spoken language into Japanese. To realize simultaneous translation between languages with different word order, such as English and Japanese, our method utilizes the feature that the word order of a target language is flexible. To resolve the problem of generating a grammatically incorrect sentence, our method uses dependency structures and Japanese dependency constraints to determine the word order of a translation. Moreover, by considering the fact that the inversion of predicate expressions occurs more frequently in Japanese spoken language, our method takes advantage of a predicate inversion to resolve the problem that Japanese has the predicate at the end of a sentence. Furthermore, our method includes the function of canceling an inversion by restating a predicate when the translation is incomprehensible due to the inversion. We implement a prototype translation system and conduct an experiment with all 578 sentences in the ATIS corpus. The results indicate improvements in comparison to two other methods.

show abstract

An automatic speech translation system on PDAs for travel conversation

Cited by 15 publications

References 9 publications

Multimedia blog creation system using dialogue with intelligent robot

Multimedia blog creation system using dialogue with intelligent robot

A multi modal supporting tool for multi lingual communication by inducing partner's reply

Simultaneous English-Japanese spoken language translation based on incremental dependency parsing and transfer

Contact Info

Product

Resources

About