Algorithms for maximum-likelihood bandwidth selection in kernel density estimators Articles uri icon

publication date

  • October 2012

start page

  • 1717

end page

  • 1724

issue

  • 13

volume

  • 33

international standard serial number (ISSN)

  • 0167-8655

electronic international standard serial number (EISSN)

  • 1872-7344

abstract

  • In machine learning and statistics, kernel density estimators are rarely used on multivariate data due to the difficulty of finding an appropriate kernel bandwidth to overcome overfitting. However, the recent advances on information-theoretic learning have revived the interest on these models. With this motivation, in this paper we revisit the classical statistical problem of data-driven bandwidth selection by cross-validation maximum likelihood for Gaussian kernels. We find a solution to the optimization problem under both the spherical and the general case where a full covariance matrix is considered for the kernel. The fixed-point algorithms proposed in this paper obtain the maximum likelihood bandwidth in few iterations, without performing an exhaustive bandwidth search, which is unfeasible in the multivariate case. The convergence of the methods proposed is proved. A set of classification experiments are performed to prove the usefulness of the obtained models in pattern recognition.