Journal article
Chronologically consistent large language models
Journal of financial economics, Vol.185, 104374
10/06/2026
DOI: 10.1016/j.jfineco.2026.104374
Abstract
Large language models are increasingly used in social sciences, but their training data can introduce lookahead bias and training leakage. A good chronologically consistent language model requires efficient use of training data to maintain accuracy despite time-restricted data. Here, we overcome this challenge by training a suite of chronologically consistent large language models, ChronoBERT and ChronoGPT, which incorporate only the text data that would have been available at each point in time. Despite this strict temporal constraint, our models achieve strong performance on natural language processing benchmarks, outperforming or matching widely used models (e.g., BERT), and remain competitive with larger open-weight models. Lookahead bias is model and application-specific because even if a chronologically consistent language model has poorer language comprehension, a regression or prediction model applied on top of the language model can compensate. In an asset pricing application predicting next-day stock returns from financial news embeddings, we find that ChronoBERT and ChronoGPT’s real-time outputs achieve Sharpe ratios comparable to a much larger and potentially biased Llama model. Our results demonstrate a scalable, practical framework to mitigate training leakage, ensuring more credible backtests and predictions across finance and other social science domains.
Details
- Title: Subtitle
- Chronologically consistent large language models
- Creators
- Songrun He - Chinese University of Hong KongLinying Lv - Washington University in St. LouisAsaf Manela - Washington University in St. LouisJimmy Wu - University of Iowa
- Resource Type
- Journal article
- Publication Details
- Journal of financial economics, Vol.185, 104374
- DOI
- 10.1016/j.jfineco.2026.104374
- ISSN
- 0304-405X
- Publisher
- Elsevier
- Language
- English
- Date published
- 10/06/2026
- Academic Unit
- Finance
- Record Identifier
- 9985241791402771
Metrics
1 Record Views