Prescriptive selection of machine learning hyperparameters with applications in power markets: Retailer"s optimal trading Articles uri icon

publication date

  • November 2022

start page

  • 370

end page

  • 388

issue

  • 1

volume

  • 306

International Standard Serial Number (ISSN)

  • 0377-2217

Electronic International Standard Serial Number (EISSN)

  • 1872-6860

abstract

  • We present a data-driven framework for optimal scenario selection in stochastic optimization with ap- plications in power markets. The proposed methodology relies on the existence of auxiliary information and the use of machine learning techniques to narrow the set of possible realizations (scenarios) of the variables of interest. In particular, we implement a novel validation algorithm that allows optimizing each machine learning hyperparameter to further improve the prescriptive power of the resulting set of scenarios. Supervised machine learning techniques are examined, including kNN and decision trees, and the validation process is adapted to work with time-dependent datasets. Moreover, we extend the pro- posed methodology to work with unsupervised techniques with promising results. We test the proposed methodology in a realistic power market application: optimal trading strategy in forward and spot mar- kets for an electricity retailer under uncertain spot prices. The results indicate that the retailer can greatly benefit from the proposed data-driven methodology and improve its market performance. Moreover, we perform an extensive set of numerical simulations to analyze under which conditions the best machine learning hyperparameters, in terms of prescriptive performance, differ from those that provide the best predictive accuracy.

subjects

  • Statistics

keywords

  • or in energy; data-driven; electricity retailer; hyperparameter selection; machine learning