Is a single model enough? The systematic comparison of computational approaches for detecting populist radical right content Articles uri icon

authors

  • Makhortykh, Mykola
  • de León, Ernesto
  • Christner, Clara
  • Sydorova, Maryna
  • Urman, Aleksandra
  • Adam, Silke
  • Maier, Michaela
  • GIL LOPEZ, TERESA

publication date

  • January 2025

start page

  • 1163

end page

  • 1207

issue

  • Suppl. 2

volume

  • 59

International Standard Serial Number (ISSN)

  • 0033-5177

abstract

  • Germanophone test datasets and how their performance is affected by different modes of
    text preprocessing. In addition to individual models, we examine the performance of 330
    ensemble models combining the above-mentioned approaches for the dataset with a particularly high volume of noise. Our findings demonstrate that the DL models, in combination with more computationally intense forms of preprocessing, show the best performance among the individual models, but it remains suboptimal in the case of more noisy datasets. While the use of ensemble models shows some improvement for specific modes of preprocessing, overall, it mostly remains on par with individual DL models, thus stressing the challenging nature of computational detection of PRR content.

subjects

  • Information Science

keywords

  • automated content analysis; populist radical right; supervised machine learning; neural networks; dictionaries; ensemble modeling