Exploiting visual saliency for assessing the impact of car commercials upon viewers Articles uri icon

publication date

  • August 2018

start page

  • 18903

end page

  • 18933

issue

  • 15

volume

  • 77

International Standard Serial Number (ISSN)

  • 1380-7501

Electronic International Standard Serial Number (EISSN)

  • 1573-7721

abstract

  • Content based video indexing and retrieval (CBVIR) is a lively area of research which focuses on automating the indexing, retrieval and management of videos. This area has a wide spectrum of promising applications where assessing the impact of audiovisual productions emerges as a particularly interesting and motivating one. In this paper we present a computational model capable to predict the impact (i.e. positive or negative) upon viewers of car advertisements videos by using a set of visual saliency descriptors. Visual saliency provides information about parts of the image perceived as most important, which are instinctively targeted by humans when looking at a picture or watching a video. For this reason we propose to exploit visual information, introducing it as a new feature which reflects high-level semantics objectively, to improve the video impact categorization results. The suggested salience descriptors are inspired by the mechanisms that underlie the attentional abilities of the human visual system and organized into seven distinct families according to different measurements over the identified salient areas in the video frames, namely population, size, location, geometry, orientation, movement and photographic composition. Proposed approach starts by computing saliency maps for all the video frames, where two different visual saliency detection frameworks have been considered and evaluated: the popular graph based visual saliency (GBVS) algorithm, and a state-of-the-art DNN-based approach.

subjects

  • Telecommunications

keywords

  • visual attention; saliency; scene analysis; aesthetics assessment; feature extraction; video impact assessment