RoboTHOR: An Open Simulation-to-Real Embodied AI Platform

Matt, Deitke,; Han, Winson; Herrasti, Alvaro; Kembhavi, Aniruddha; Kolve, Eric; Mottaghi, Roozbeh; Salvador, Jordi; Schwenk, Dustin; Eli, VanderBilt,; Wallingford, Matthew; Weihs, Luca; Yatskar, Mark; Farhadi, Ali

doi:10.48550/arxiv.2004.06799

Cited by 1 publication

(1 citation statement)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Further, AI systems trained and tested only in simulation and on abstract images may not transfer well to realworld use cases -the 'sim-to-real' problem [15]. Therefore, an important first objective for our future work is to collect new data and create shared tasks in more realistic environments and to ensure that results and models are ecologically valid [13], i.e.…”

Section: New Data Collections For Multi-agent Conversational Collabor...mentioning

confidence: 99%

Conversational AI for multi-agent communication in Natural Language

Lemon

2022

AIC

View full text Add to dashboard Cite

Research at the Interaction Lab focuses on human-agent communication using conversational Natural Language. The ultimate goal is to create systems where humans and AI agents (including embodied robots) can spontaneously form teams and coordinate shared tasks through the use of Natural Language conversation as a universal communication interface. This paper first introduces machine learning approaches to problems in conversational AI in general, where computational agents must coordinate with humans to solve tasks using conversational Natural Language. It also covers some of the practical systems developed in the Interaction Lab, ranging from speech interfaces on smart speakers to embodied robots interacting using visually grounded language. In several cases communication between multiple agents is addressed. The paper surveys the central research problems addressed here, the approaches developed, and our main results. Some key open research questions and directions are then discussed, leading towards a future vision of conversational, collaborative multi-agent systems.

show abstract

Section: New Data Collections For Multi-agent Conversational Collabor...mentioning

confidence: 99%

Conversational AI for multi-agent communication in Natural Language

Lemon

2022

AIC

View full text Add to dashboard Cite

show abstract

RoboTHOR: An Open Simulation-to-Real Embodied AI Platform

Cited by 1 publication

References 0 publications

Conversational AI for multi-agent communication in Natural Language

Conversational AI for multi-agent communication in Natural Language

Contact Info

Product

Resources

About