2020
DOI: 10.1016/j.tics.2020.05.011
|View full text |Cite
|
Sign up to set email alerts
|

Curious Inferences: Reply to Sun and Firestone on the Dark Room Problem

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
2
1

Citation Types

0
14
0

Year Published

2021
2021
2023
2023

Publication Types

Select...
8
1

Relationship

0
9

Authors

Journals

citations
Cited by 16 publications
(15 citation statements)
references
References 8 publications
(9 reference statements)
0
14
0
Order By: Relevance
“…We suggest the answer to the dark room problem is that the value of a generative model depends on how well the model does on average, over the course of the agent's life, at keeping the agent adapted to the dynamical environment in which it is situated. To optimise the value of a generative model it pays to sometimes be curious in ways that lead to temporary increases in error, so long as in doing so the agent makes progress in learning (see Kiverstein, Miller and Rietveld 2019;Van de Cruys, Friston & Clark 2020;Seth et al 2020).…”
Section: Discussionmentioning
confidence: 99%
“…We suggest the answer to the dark room problem is that the value of a generative model depends on how well the model does on average, over the course of the agent's life, at keeping the agent adapted to the dynamical environment in which it is situated. To optimise the value of a generative model it pays to sometimes be curious in ways that lead to temporary increases in error, so long as in doing so the agent makes progress in learning (see Kiverstein, Miller and Rietveld 2019;Van de Cruys, Friston & Clark 2020;Seth et al 2020).…”
Section: Discussionmentioning
confidence: 99%
“…The present perspective may inform controversies surrounding the explanatory scope of PP in cases where utility and accuracy conflict with one another, such as reward-biased perception [73], affect-biased attention [74], and more general issues linked to the Dark Room Problem [75] (cf. [39,76,77]). Future open questions include whether utility-biased expectations differ…”
Section: Discussionmentioning
confidence: 99%
“…In some cases, this concern has also targeted mAI, although perhaps inappropriately once mAI is understood as purely a theory of low-level motor control after decisions have been made. 3 One prominent example concern is the "dark room problem" (Friston, Thornton, & Clark, 2012;A. K. Seth, Millidge, Buckley, & Tschantz, 2020;Sun & Firestone, 2020;S.…”
Section: Addressing Concerns About the (Apparent) Purely Doxastic Ontology Of Active Inferencementioning
confidence: 99%
“…As the reader may already gather, this concern is somewhat misplaced in the context of dAI (Badcock, Friston, Ramstead, Ploeger, & Hohwy, 2019;A. K. Seth et al, 2020;S.…”
Section: Addressing Concerns About the (Apparent) Purely Doxastic Ontology Of Active Inferencementioning
confidence: 99%