A New Formalism, Method and Open Issues for Zero-Shot Coordination

Johannes, Treutlein,; Dennis, Michael; Oesterheld, Caspar; Foerster, Jakob

doi:10.48550/arxiv.2106.06613

Cited by 2 publications

(2 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In their work, however, Fern et al [9] also consider that the teammate's actions to be accessible to the assistant. The problem of zero-shot coordination [15], unlike ad hoc teamwork, studies how independently trained agents may interact with one another on first-attempt [6,17,28]. This can be seen as a flavor of ad hoc teamwork where there is only one teammate which the ad hoc agent knows to have computed an optimal solution to the task being performed.…”

Section: Similar Lines Of Researchmentioning

confidence: 99%

Making Friends in the Dark: Ad Hoc Teamwork Under Partial Observability

Ribeiro,

Martinho,

Sardinha

et al. 2023

Frontiers in Artificial Intelligence and Applications

View full text Add to dashboard Cite

This paper introduces a formal definition of the setting of ad hoc teamwork under partial observability and proposes a first-principled model-based approach which relies only on prior knowledge and partial observations of the environment in order to perform ad hoc teamwork. We make three distinct assumptions that set it apart previous works, namely: i) the state of the environment is always partially observable, ii) the actions of the teammates are always unavailable to the ad hoc agent and iii) the ad hoc agent has no access to a reward signal which could be used to learn the task from scratch. Our results in 70 POMDPs from 11 domains show that our approach is not only effective in assisting unknown teammates in solving unknown tasks but is also robust in scaling to more challenging problems. Supplementary material is available at https://github.com/jmribeiro/adhoc-teamwork-under-partial-observability.

show abstract

Section: Similar Lines Of Researchmentioning

confidence: 99%

Making Friends in the Dark: Ad Hoc Teamwork Under Partial Observability

Ribeiro,

Martinho,

Sardinha

et al. 2023

Frontiers in Artificial Intelligence and Applications

View full text Add to dashboard Cite

show abstract

“…In their work, however, [9] also consider that the teammate's actions to be accessible to the assistant. The problem of zero-shot coordination [13], unlike in ad hoc teamwork, studies how independently trained agents may interact with one another on first-attempt [6,15,25] (therefore falling out of the scope of ad hoc teamwork). Finally, the IPOMDP framework [12], considers how an agent can augment the state space of a POMDP taking into account all possible, unknown, teammates.…”

Section: Related Workmentioning

confidence: 99%

Assisting Unknown Teammates in Unknown Tasks: Ad Hoc Teamwork under Partial Observability

Ribeiro¹,

Martinho²,

Sardinha³

et al. 2022

Preprint

View full text Add to dashboard Cite

In this paper, we present a novel Bayesian online prediction algorithm for the problem setting of ad hoc teamwork under partial observability (ATPO), which enables on-the-fly collaboration with unknown teammates performing an unknown task without needing a pre-coordination protocol. Unlike previous works that assume a fully observable state of the environment, ATPO accommodates partial observability, using the agent's observations to identify which task is being performed by the teammates. Our approach assumes neither that the teammate's actions are visible nor an environment reward signal. We evaluate ATPO in three domains-two modified versions of the Pursuit domain with partial observability and the overcooked domain of Carroll et al. [7]. Our results show that ATPO is effective and robust in identifying the teammate's task from a large library of possible tasks, efficient at solving it in near-optimal time, and scalable in adapting to increasingly larger problem sizes.

show abstract

A New Formalism, Method and Open Issues for Zero-Shot Coordination

Cited by 2 publications

References 0 publications

Making Friends in the Dark: Ad Hoc Teamwork Under Partial Observability

Making Friends in the Dark: Ad Hoc Teamwork Under Partial Observability

Assisting Unknown Teammates in Unknown Tasks: Ad Hoc Teamwork under Partial Observability

Contact Info

Product

Resources

About