Cost-Sensitive Learning based on Bregman Divergences Articles uri icon

authors

  • SANTOS RODRIGUEZ, RAUL
  • GUERRERO CURIESES, ALICIA
  • ALAIZ RODRIGUEZ, ROCIO
  • CID SUEIRO, JESUS

publication date

  • September 2009

start page

  • 271

end page

  • 285

issue

  • 76

volume

  • 2-3

international standard serial number (ISSN)

  • 0885-6125

electronic international standard serial number (EISSN)

  • 1573-0565

abstract

  • This paper analyzes the application of a particular class of Bregman divergencesto design cost-sensitive classifiers for multiclass problems. We show that these divergence measures can be used to estimate posterior probabilities with maximal accuracy for the probability values that are close to the decision boundaries. Asymptotically, the proposed divergence measures provide classifiers minimizing the sum of decision costs in non-separable problems, and maximizing a margin in separable MAP problems.

keywords

  • cost sensitive learning; bregman divergence; posterior class probabilities; maximum margin