An Intra-Day Electricity Price Forecasting Based on a Probabilistic Transformer Neural Network Architecture

This paper describes the development of a deep neural network architecture based on transformer encoder blocks and Time2Vec layers for the prediction of electricity prices several steps ahead (8 h), from a probabilistic approach, to feed future decision-making tools in the context of the widespread...

Full description

Autores:
Cantillo-Luna, Sergio
Moreno-Chuquen, Ricardo
López Sotelo, Jesús Alfonso
Tipo de recurso:
Article of investigation
Fecha de publicación:
2023
Institución:
Universidad Autónoma de Occidente
Repositorio:
RED: Repositorio Educativo Digital UAO
Idioma:
spa
OAI Identifier:
oai:red.uao.edu.co:10614/15861
Acceso en línea:
https://hdl.handle.net/10614/15861
https://red.uao.edu.co/
Palabra clave:
Decision making
Deep learning
Electricity price forecasting (EPF)
Probabilistic forecasting
Time series forecasting
Rights
openAccess
License
Derechos reservados -MDPI, 2023
Description
Summary:This paper describes the development of a deep neural network architecture based on transformer encoder blocks and Time2Vec layers for the prediction of electricity prices several steps ahead (8 h), from a probabilistic approach, to feed future decision-making tools in the context of the widespread use of intra-day DERs and new market perspectives. The proposed model was tested with hourly wholesale electricity price data from Colombia, and the results were compared with different state-of-the-art forecasting baseline-tuned models such as Holt–Winters, XGBoost, Stacked LSTM, and Attention-LSTM. The findings show that the proposed model outperforms these baselines by effectively incorporating nonlinearity and explicitly modeling the underlying data’s behavior, all of this under four operating scenarios and different performance metrics. This allows it to handle high-, medium-, and low-variability scenarios while maintaining the accuracy and reliability of its predictions. The proposed framework shows potential for significantly improving the accuracy of electricity price forecasts, which can have significant benefits for making informed decisions in the energy sector