“…This alignment determines whether individuals engage in behaviors that increase or decrease uncertainty. We draw on literature concerning the exploration-exploitation dilemma in reinforcement learning (Gershman, 2018b;Gottlieb & Oudeyer, 2018;Kaelbling, Littman, & Moore, 1996;Walker, Luque, Le Pelley, & Beesley, 2019) to distinguish opening behaviors that generate further uncertainty and opportunities for learning from closing behaviors that reduce uncertainty and rely on existing knowledge. This literature provides detailed accounts of the psychological processes that determine whether an individual exploits existing knowledge to obtain immediate rewards or explores uncertain options for possible long-term gains (Schulz & Gershman, 2019;Wilson, Geana, White, Ludvig, & Cohen, 2014).…”