Logo image
Enhancing hydrological modeling with transformers: a case study for 24-h streamflow prediction
Journal article   Open access   Peer reviewed

Enhancing hydrological modeling with transformers: a case study for 24-h streamflow prediction

Bekir Zahit Demiray, Muhammed Sit, Omer Mermer and Ibrahim Demir
Water science and technology, Vol.89(9), pp.2326-2341
04/04/2024
DOI: 10.2166/wst.2024.110
url
https://doi.org/10.2166/wst.2024.110View
Published (Version of record) Open Access

Abstract

In this paper, we address the critical task of 24-h streamflow forecasting using advanced deep-learning models, with a primary focus on the Transformer architecture which has seen limited application in this specific task. We compare the performance of five different models, including Persistence, long short-term memory (LSTM), Seq2Seq, GRU, and Transformer, across four distinct regions. The evaluation is based on three performance metrics: Nash-Sutcliffe Efficiency (NSE), Pearson's r, and normalized root mean square error (NRMSE). Additionally, we investigate the impact of two data extension methods: zero-padding and persistence, on the model's predictive capabilities. Our findings highlight the Transformer's superiority in capturing complex temporal dependencies and patterns in the streamflow data, outperforming all other models in terms of both accuracy and reliability. Specifically, the Transformer model demonstrated a substantial improvement in NSE scores by up to 20% compared to other models. The study's insights emphasize the significance of leveraging advanced deep learning techniques, such as the Transformer, in hydrological modeling and streamflow forecasting for effective water resource management and flood prediction.
Engineering Physical Sciences Technology Engineering, Environmental Environmental Sciences Environmental Sciences & Ecology Life Sciences & Biomedicine Science & Technology Water Resources UIOWA OA Agreement

Details

Metrics

Logo image