Logo image
Back
Functions of Learning Rate in Adaptive Reward Learning
Journal article   Open access   Peer reviewed

Functions of Learning Rate in Adaptive Reward Learning

Xi Wu, Ting Wang, Chang Liu, Tao Wu, Jiefeng Jiang, Dong Zhou and Jiliu Zhou
Frontiers in human neuroscience, Vol.11, pp.592-592
12/06/2017
DOI: 10.3389/fnhum.2017.00592
PMCID: PMC5723661
PMID: 29270119
url
https://doi.org/10.3389/fnhum.2017.00592View
Published (Version of record) Open Access

Abstract

As a crucial cognitive function, learning applies prediction error (the discrepancy between the prediction from learning and the world state) to adjust predictions of the future. How much prediction error affects this adjustment also depends on the learning rate. Our understanding to the learning rate is still limited, in terms of (1) how it is modulated by other factors, and (2) the specific mechanisms of how learning rate interacts with prediction error to update learning. We applied computational modeling and functional magnetic resonance imaging to investigate these issues. We found that, when human participants performed a reward learning task, reward magnitude modulated learning rate. Modulation strength further predicted the difference in behavior following high vs. low reward across subjects. Imaging results further showed that this modulation was reflected in brain regions where the reward feedback is also encoded, such as the medial prefrontal cortex (MFC), precuneus, and posterior cingulate cortex. Furthermore, for the first time, we observed that the integration of the learning rate and the reward prediction error was represented in MFC activity. These findings extend our understanding of adaptive learning by demonstrating how it functions in a chain reaction of prediction updating.
 reward fMRI Neuroscience adaptive learning Bayesian modeling learning rate

Details

Metrics

15 Record Views
11 Times Cited - Web of Science
Logo image