Prescriptive selection of machine learning hyperparameters with applications in power markets: Retailer"s optimal trading Articles
Overview
published in
publication date
- November 2022
start page
- 370
end page
- 388
issue
- 1
volume
- 306
Digital Object Identifier (DOI)
full text
International Standard Serial Number (ISSN)
- 0377-2217
Electronic International Standard Serial Number (EISSN)
- 1872-6860
abstract
- We present a data-driven framework for optimal scenario selection in stochastic optimization with ap- plications in power markets. The proposed methodology relies on the existence of auxiliary information and the use of machine learning techniques to narrow the set of possible realizations (scenarios) of the variables of interest. In particular, we implement a novel validation algorithm that allows optimizing each machine learning hyperparameter to further improve the prescriptive power of the resulting set of scenarios. Supervised machine learning techniques are examined, including kNN and decision trees, and the validation process is adapted to work with time-dependent datasets. Moreover, we extend the pro- posed methodology to work with unsupervised techniques with promising results. We test the proposed methodology in a realistic power market application: optimal trading strategy in forward and spot mar- kets for an electricity retailer under uncertain spot prices. The results indicate that the retailer can greatly benefit from the proposed data-driven methodology and improve its market performance. Moreover, we perform an extensive set of numerical simulations to analyze under which conditions the best machine learning hyperparameters, in terms of prescriptive performance, differ from those that provide the best predictive accuracy.
Classification
subjects
- Statistics
keywords
- or in energy; data-driven; electricity retailer; hyperparameter selection; machine learning