When industrial robots become social: On the design and evaluation of a multimodal interface for welding robots

Niculescu, Andreea I.; D’Haro, Luis Fernando; Banchs, Rafael E.

doi:10.1109/apsipa.2017.8282006

Cited by 3 publications

(2 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Improvement suggestions referred to the recognition robustness, understanding capabilities, support for error recovery and decreasing information redundancy. More information about the evolution can be found in [24].…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

An integrated framework for multimodal human-robot interaction

D’Haro

Niculescu

Cai³

et al. 2017

2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC)

View full text Add to dashboard Cite

Recent research progresses in speech recognition, text-to-speech, natural language understanding, or dialog management components are improving the way humans interact with advanced robot machines. However, far from being solved, we are just starting the process of creating meaningful multimodal platforms that can allow operators to use and control industrial robots through spoken dialogue.This paper describes our ongoing efforts on creating a modular platform that combines different technologies to cover typical requirements in an industrial setting, i.e. robust speech recognition, low level skill functions to operate the robot, recommendations and validation procedures to setup parameters, combination of audio-visual information for challenging environments, integration of domain-knowledge by means of an ontology, a flexible definition of the dialog model and natural language rules, as well as a test and control interface to quickly check the functionality of each module during development and operation. All platform modules are intercommunicated by the ROS operative system which allows the integration of external plugins and modules easily.Finally, a preliminary user study with IT experts simulating a welding task has been doing giving us clues on what should be the focus of our next developments.

show abstract

Section: Discussionmentioning

confidence: 99%

“…Also, we plan to include new speech and NLP modules from our internal platform [28][29] by porting them to ROS framework. Finally, we will be introducing additional strategies for error handling as proposed in [30].…”

Section: Discussionmentioning

confidence: 99%