A multi modal supporting tool for multi lingual communication by inducing partner's reply

Imoto, Kazunori; Sasajima, Munehiko; Shimomori, Taishii; Yamanaka, Noriko; Yajima, Makoto; Masai, Yasuyuki

doi:10.1145/1111449.1111527

Cited by 10 publications

(4 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The system transcribes the speech to text, translates the text into the non-native speakers' first language, and outputs speech synthesized from the translated text. However, due to technological limitations, communication is often disrupted by the combination of recognition errors and translation errors [3]. Furthermore, the development of new domains for translation is difficult and costly [2].…”

Section: Introductionmentioning

confidence: 99%

Effects of real-time transcription on non-native speaker's comprehension in computer-mediated communications

Pan

Jiang

Picheny

et al. 2009

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

We performed an empirical study to understand the relative contributions of real-time transcription to a non-native speaker's comprehension in audio/video meetings. 48 participants were assigned to 2 presentation modes (audio, audio+video) and 3 transcription modes (no transcript, realtime transcripts in the streaming mode, transcripts with all past records) in a 3x2 factorial experimental design. The results suggest that comprehension can be significantly improved for both audio and audio+video conditions when real-time transcription is provided. Also, the participants reported positive subjective responses to the presence of real-time transcription in terms of usefulness, preference, and willingness to use such a feature if provided. No cognitive load issues were reported by the participants in the ability to synthesize across modalities. Implications for system development and design, as well as future work utilizing automation speech recognition to provide the transcripts are discussed.

show abstract

Section: Introductionmentioning

confidence: 99%

Effects of real-time transcription on non-native speaker's comprehension in computer-mediated communications

Pan

Jiang

Picheny

et al. 2009

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

show abstract

“…The proposed system supports conversations of two users who talk for the first time. There are many support systems of conversation by foreigners [1,2] and support system of communications by handicapped people [3,4]. However, few system supports conversations by people for the first time.…”

Section: Two Functions Obtained From the Case Studiesmentioning

confidence: 99%

Topic Recommendation Method related to a Present Topic for Continuing a Conversation

Sunayama

Shibata

Nishihara

2017

Information Engineering Express

View full text Add to dashboard Cite

This paper proposes a topic recommendation method. The methods recommends next topics related to a present topic. The purpose of the proposed method is to support to continue conversations. The proposed method detects spoken words of two users, makes a log text of the spoken words. Then, the method extracts a present topic from the log text, and evaluates relations between the present topic and next topic candidates. The method chooses next topics and recommends them to the users. The proposed method has been realized as a conversation support system that has an interface of Head Mounted Display (HMD) showing the log text, a word of the present topic, and words of the next topic. One of the users of the system wearing the HMD can grasp what topic is talked, and can choose a next topic from recommended them. The users can continue a conversation by talking about recommended topics. Experimental results showed that the realized system could support to continue conversations. We also found that the realized system supported users to obtain equal chances to speak.

show abstract

“…One of these is a support system using speech-to-speech translation for foreign travelers [5]. Another topic of research is a tool that supports communication between speakers of different languages and uses parallel texts for speech recognition [6]. In systems such as this, the user inputs speech and the system outputs a translated sentence; however, the system cannot output sentences that have not been previously registered.…”

Section: Related Workmentioning

confidence: 99%

Design of a Face-to-Face Multilingual Communication System for a Handheld Device in the Medical Field

Shun

Matsunobe

Yoshino

et al. 2011

Lecture Notes in Computer Science

View full text Add to dashboard Cite

In the medical field, a serious problem exists with regard to communication between hospital staff and foreign patients. For example, medical translators cannot provide support in cases in which round-the-clock support is required during hospitalization. We propose the use of a multilingual communication support system called the Petit Translator between people speaking different languages in the hospital setting. From the results of experiments performed in such a setting, we found the following: (1) by clicking the conversation scene, the interface can retrieve the parallel text more efficiently than the paper media, and (2) when a questioner appropriately limits the type of reply for a respondent, prompt conversation can occur.

show abstract

A multi modal supporting tool for multi lingual communication by inducing partner's reply

Cited by 10 publications

References 3 publications

Effects of real-time transcription on non-native speaker's comprehension in computer-mediated communications

Effects of real-time transcription on non-native speaker's comprehension in computer-mediated communications

Topic Recommendation Method related to a Present Topic for Continuing a Conversation

Design of a Face-to-Face Multilingual Communication System for a Handheld Device in the Medical Field

Contact Info

Product

Resources

About