“…23 Intuitively, even if at some point in the game player i comes to believe with probability one that the set of players who cooperated in period 1 was v, she continues to entertain the possibility that the set of period 1 cooperators was actually some v 0 ≠ v, and she keeps track of a state x v 0 i ∈ fG, Bg for each possible set v 0 . The interpretation of player i's state is as follows: as in Hörner and Olszewski (2006), Deb, Sugaya, and Wolitzky (2020), and Sugaya and Yamamoto (2020, player i can be viewed as the arbiter of player i 1 1's payoff, meaning that player i 1 1's equilibrium continuation payoff is high when player i is in the good state G, and player i 1 1's equilibrium continuation payoff is low when player i is in the bad state B. Specifically, x v i 5 G means that, if in the coming block the players reach agreement that the set of period 1 cooperators was v, then player i prescribes a high continuation payoff for player i 1 1 (which is delivered both by player i cooperating with player i 1 1 herself and by player i instructing other players to cooperate with player i 1 1); similarly, x v i 5 B means that, if agreement is reached that the set of period 1 cooperators was v, then player i prescribes a low continuation payoff for player i 1 1 (and thus defects against player i 1 1 herself while also instructing others to defect against player i 1 1).…”