Multimodal Open-Domain Conversations with the Nao Robot

Jokinen, Kristiina; Wilcock, Graham

doi:10.1007/978-1-4614-8280-2_19

Cited by 39 publications

(15 citation statements)

References 13 publications

(19 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Progress in artificial intelligence and robot technology has made possible service robots and agents for the home as well as office. Furthermore, robots are acquiring both verbal and nonverbal communication functions [63], [64]. Beyond the original scope of this study, the system might be able to be used for understanding communications in mixed humannon-human groups [65], [66].…”

Section: Feasibility Of Other Applicationsmentioning

confidence: 99%

Development of Acoustic Nonverbal Information Estimation System for Unconstrained Long-Term Monitoring of Daily Office Activity

Yokoyama

Nakayama

Murata

et al. 2019

IEICE Trans. Inf. & Syst.

View full text Add to dashboard Cite

Aimed at long-term monitoring of daily office conversations without recording the conversational content, a system is presented for estimating acoustic nonverbal information such as utterance duration, utterance frequency, and turn-taking. The system combines a sound localization technique based on the sound energy distribution with 16 beamforming microphone-array modules mounted in the ceiling for reducing the influence of multiple sound reflection. Furthermore, human detection using a wide field of view camera is integrated to the system for more robust speaker estimation. The system estimates the speaker for each utterance and calculates nonverbal information based on it. An evaluation analyzing data collected over ten 12-hour workdays in an office with three assigned workers showed that the system had 72% speech segmentation detection accuracy and 86% speaker identification accuracy when utterances were correctly detected. Even with false voice detection and incorrect speaker identification and even in cases where the participants frequently made noise or where seven participants had gathered together for a discussion, the order of the amount of calculated acoustic nonverbal information uttered by the participants coincided with that based on human-coded acoustic nonverbal information. Continuous analysis of communication dynamics such as dominance and conversation participation roles through nonverbal information will reveal the dynamics of a group. The main contribution of this study is to demonstrate the feasibility of unconstrained long-term monitoring of daily office activity through acoustic nonverbal information.

show abstract

Section: Feasibility Of Other Applicationsmentioning

confidence: 99%

Development of Acoustic Nonverbal Information Estimation System for Unconstrained Long-Term Monitoring of Daily Office Activity

Yokoyama

Nakayama

Murata

et al. 2019

IEICE Trans. Inf. & Syst.

View full text Add to dashboard Cite

show abstract

“…DigiSami focuses especially on North Sámi, and sets to collect data, provide tools, and develop technology to enable North Sámi speech-based applications to be developed (Jokinen and Wilcock, 2014a). Moreover, the project aims to encourage community effort for online content creation, and for this, Wikipedia-based applications are supported, such as WikiTalk (Jokinen and Wilcock, 2014b;Wilcock et al, 2016). This is a robot-application which allows the user to interact with a robot concerning information in the Wikipedia articles.…”

Section: Related Work On North Sámimentioning

confidence: 99%

Low-Resource Active Learning of Morphological Segmentation

Grönroos

Hiovain

Smit

et al. 2016

NEJLT

Self Cite

View full text Add to dashboard Cite

Many Uralic languages have a rich morphological structure, but lack morphological analysis tools needed for efficient language processing. While creating a high-quality morphological analyzer requires a significant amount of expert labor, data-driven approaches may provide sufficient quality for many applications. We study how to create a statistical model for morphological segmentation with a large unannotated corpus and a small amount of annotated word forms selected using an active learning approach. We apply the procedure to two Finno-Ugric languages: Finnish and North Sámi. The semi-supervised Morfessor FlatCat method is used for statistical learning. For Finnish, we set up a simulated scenario to test various active learning query strategies. The best performance is provided by a coverage-based strategy on word initial and final substrings. For North Sámi we collect a set of humanannotated data. With 300 words annotated with our active learning setup, we see a relative improvement in morph boundary F 1 -score of 19% compared to unsupervised learning and 7.8% compared to random selection.

show abstract

“…NAO robots have been used in many real-world applications, as a consequence of which real-time processing is of importance [1][2][3]. One of the uses of NAO robots is in the Robot Soccer World Cup Standard Platform League (RoboCup SPL) [4,5].…”

Section: Introductionmentioning

confidence: 99%

Real-Time Automatic Colour Calibration for NAO Humanoids

Bolotnikova

Anbarjafari

2018

Teh. vjesn.

View full text Add to dashboard Cite

A challenge in NAO soccer robots is colour calibration. Good colour calibration can result in robust and accurate self-localization of the robot. Currently manual calibration is the only solution, which is used. In this paper, we are proposing an automatic real-time, accurate YUV colour space based colour calibration technique. In order to define average values for the desired colour classes namely orange, white, green and purple, a specified set of frames from the NAO camera are analysed. These average values are corrected by luminance analysis of a new frame and are passed to the K-means clustering algorithm as a set of initial means. In addition to these four values, a set of initial means of the K-means algorithm contains 16 values that are calculated in the following manner: the frame being processed is divided into 4 by 4 grids and the average value from every grid serves as an initial mean for K-means clustering. Consequently, colours of a similar type are combined into clusters. The final step of the proposed technique is cluster classification in which the average values of the desired colour classes are corrected by luminance analysis. As NAO cameras provide video streams in YUV format and the proposed algorithm uses this format there is no need for additional computational steps for conversation between the colour spaces. As a result, computational process is reduced compared to current techniques.

show abstract

Multimodal Open-Domain Conversations with the Nao Robot

Cited by 39 publications

References 13 publications

Development of Acoustic Nonverbal Information Estimation System for Unconstrained Long-Term Monitoring of Daily Office Activity

Development of Acoustic Nonverbal Information Estimation System for Unconstrained Long-Term Monitoring of Daily Office Activity

Low-Resource Active Learning of Morphological Segmentation

Real-Time Automatic Colour Calibration for NAO Humanoids

Contact Info

Product

Resources

About