Publication: A novel application of transformer neural network (TNN) for estimating pan evaporation rate
Date
2023
Authors
Abed M.
Imteaz M.A.
Ahmed A.N.
Huang Y.F.
Journal Title
Journal ISSN
Volume Title
Publisher
Springer Science and Business Media Deutschland GmbH
Abstract
For decision-making in farming, the operation of dams and irrigation systems, as well as other fields of water resource management and hydrology, evaporation, as a key activity throughout the universal hydrological processes, entails efficient techniques for measuring its variation. The main challenge in creating accurate and dependable predictive models is the evaporation procedure's non-stationarity, nonlinearity, and stochastic characteristics. This work examines, for the first time, a transformer-based deep learning architecture for evaporation prediction in four different Malaysian regions. The effectiveness of the proposed deep learning (DL) model, signified as TNN, is evaluated against two competitive reference DL models, namely Convolutional Neural Network and Long Short-Term Memory, and with regards to various statistical indices using the monthly-scale dataset collected from four Malaysian meteorological stations in the 2000�2019 period. Using a variety of input variable combinations, the impact of every meteorological data on the Ep forecast is also examined. The performance assessment metrics demonstrate that compared to the other benchmark frameworks examined in this work, the developed TNN technique was more precise in modelling monthly water loss owing to evaporation. In terms of predictive effectiveness, the proposed TNN model, enhanced with the self-attention mechanism, outperforms the benchmark models, demonstrating its potential use in the forecasting of evaporation. Relating to application, the predictive model created for Ep projection offers a precise estimate of water loss due to evaporation and can thus be used in irrigation management, agriculture planning based on irrigation, and the decrease in fiscal and economic losses in farming and related industries where consistent supervision and estimation of water are considered necessary for viable living and economy. � 2022, The Author(s).
Description
Keywords
Convolutional neural network , Evaporation , Long short-term memory , Self-attention , Transformer neural network , Malaysia , Benchmarking , Brain , Convolution , Convolutional neural networks , Crops , Decision making , Evaporation , Farms , Forecasting , Irrigation , Stochastic models , Stochastic systems , Water management , Convolutional neural network , Learning models , Malaysians , Neural-networks , Novel applications , Pan evaporation , Predictive models , Self-attention , Transformer neural network , Water loss , artificial neural network , data set , evaporation , machine learning , numerical model , prediction , Long short-term memory