"Let Me Ask Them to Clarify If You Don't Want To" - A Clarification Agent for Nonnative Speakers

Self Cite

Collaborating 1 using a common language can be challenging for non-native speakers (NNS). These challenges can be reduced when native speakers (NS) adjust their speech behavior for NNS, for example by speaking more slowly. In this study, we examined whether the use of real-time speech rate feedback (a speech speedometer) would help NS monitor their speaking speed and adjust for NNS accordingly. We conducted a laboratory experiment with 20 triads of 2 NS and 1 NNS. NS in half of the groups were given the speech speedometer. We found that NS with the speech speedometer were significantly more motivated to slow down their speech but they did not actually speak more slowly, although they made other speech adjustments. Furthermore, NNS perceived the speech of NS with the speedometer less clear, and they felt less accommodated. The results highlight the need for tools that create scaffolding to help NS make speech accommodations. We conclude with some design ideas for these scaffolding tools.

Section: Challenges In Multiparty Communication Between Ns and Nnsmentioning

confidence: 99%

Section: Scaffolding Ns Accommodationmentioning

confidence: 99%

Increasing Native Speakers' Awareness of the Need to Slow Down in Multilingual Conversations Using a Real-Time Speech Speedometer

Duan

Yamashita²,

Fussell

2019

Self Cite

Exploring the Effects of Incorporating Human Experts to Deliver Journaling Guidance through a Chatbot

Lee

Yamashita

Huang

2021

Chatbots are regarded as a promising technology for delivering guidance. Prior studies show that chatbots have the potential of coaching users to learn different skills; however, several limitations of chatbot-based approaches remain. People may become disengaged from using chatbot-guided systems and fail to follow the guidance for complex tasks. In this paper, we design chatbots with (HC) and without (OC) human support to deliver guidance for people to practice journaling skills. We conducted a mixed-method study with 35 participants to investigate their actual interaction, perceived interaction, and the effects of interacting with the two chatbots. The participants were randomly assigned to use one of the chatbots for four weeks. Our results show that the HC participants followed the guidance more faithfully during journaling practices and perceived a significantly higher level of engagement and trust with the chatbot system than the OC participants. However, after finishing the journaling-skill training session, the OC participants were more willing to keep using the learned skills than the HC participants. Our work provides new insights into the design of integrating human support into chatbot-based interventions for delivering guidance.

Bridging Fluency Disparity between Native and Nonnative Speakers in Multilingual Multiparty Collaboration Using a Clarification Agent

Duan

Yamashita²,

Shirai

et al. 2021

Multiparty collaboration using a common language is often challenging for nonnative speakers (NNS). Conversation can move forward rapidly, with terms and references unfamiliar to NNS often going unexplained because NNS do not request clarification due to cognitive overload or face concerns. Language difficulties may further lead to NNS having a low level of participation in a conversation, which could be a loss for multilingual teams. To help NNS resolve potential confusions due to unfamiliar language use without risking face concerns, we created a conversation agent that asked clarification questions intended to help NNS follow and participate in multiparty conversations. We conducted a within-subjects laboratory experiment with 17 triads of 2 NS and 1 NNS, who performed a series of collaborative tasks under three conditions: a) no agent, b) a high-level agent that resembles a NNS with good command of English, and c) a low-level agent that resembles a NNS with poor English skills. Results suggest that NS made significantly more clarifications in both agent conditions than without an agent. In the high-level agent condition, NNS reported an increase in understanding after the agent's interruption and spoke significantly more. Further, NNS evaluated their communication competence in English highest in the low-level agent condition and lowest in the control condition. Our findings suggest several directions to improve the tool to better facilitate multilingual multiparty communication.