Logo image
Learning, Reward, and Decision Making
Book chapter   Peer reviewed

Learning, Reward, and Decision Making

John P. O'Doherty, Jeffrey Cockburn and Wolfgang M. Pauli
Annual Review of Psychology. Volume 68. 2017, pp. 73-100, pp.73-100
Annual Review of Psychology, Annual Reviews
01/03/2017
DOI: 10.1146/annurev-psych-010416-044216
PMCID: PMC6192677
PMID: 27687119
url
https://www.ncbi.nlm.nih.gov/pmc/articles/6192677View
Open Access

Abstract

In this review, we summarize findings supporting the existence of multiple behavioral strategies for controlling reward-related behavior, including a dichotomy between the goal-directed or model-based system and the habitual or model-free system in the domain of instrumental conditioning and a similar dichotomy in the realm of Pavlovian conditioning. We evaluate evidence from neuroscience supporting the existence of at least partly distinct neuronal substrates contributing to the key computations necessary for the function of these different control systems. We consider the nature of the interactions between these systems and show how these interactions can lead to either adaptive or maladaptive behavioral outcomes. We then review evidence that an additional system guides inference concerning the hidden states of other agents, such as their beliefs, preferences, and intentions, in a social context. We also describe emerging evidence for an arbitration mechanism between model-based and model-free reinforcement learning, placing such a mechanism within the broader context of the hierarchical control of behavior.
Psychology Psychology, Multidisciplinary Social Sciences

Details

Metrics

Logo image