Probabilistic Topic Model for Context-Driven Visual Attention Understanding Articles uri icon

publication date

  • April 2019

start page

  • 1653

end page

  • 1667

issue

  • 6

volume

  • 30

International Standard Serial Number (ISSN)

  • 1051-8215

Electronic International Standard Serial Number (EISSN)

  • 1558-2205

abstract

  • Modern computer vision techniques have to dealwith vast amounts of visual data, which implies a computationaleffort that has often to be accomplished in broad and challenging scenarios. The interest in efficiently solving these imageand video applications has led researchers to develop methodsto expertly drive the corresponding processing to conspicuousregions that either depend on the context or are based on specificrequirements. In this paper, we propose a general hierarchicalprobabilistic framework, independent of the application scenario,and relied on the most outstanding psychological studies aboutattention and eye movements which support that guidance isnot based directly on the information provided by early visualprocesses but on a contextual representation that arose fromthem. The approach defines the task of context-driven visualattention as a mixture of latent sub-tasks, which are, in turn,modeled as a combination of specific distributions associatedto low-, mid-, and high-level spatio-temporal features. Learningfrom fixations gathered from human observers, we incorporatean intermediate level between feature extraction and visualattention estimation that enables to obtain comprehensivelyguiding representations. The experiments show how our proposalsuccessfully learns particularly adapted hierarchical explanationsof visual attention in diverse video genres, outperforming severalleading models in the literature.

keywords

  • top-down visual attention; hierarchical probabilistic framework; context-aware model; latent topic models