I feel you: the design and evaluation of a domotic affect-sensitive spoken conversational agent Articles uri icon

authors

  • LEBAI LUTFI, SYAHEERAH
  • FERNANDEZ MARTINEZ, FERNANDO
  • LORENZO TRUEBA, JAIME
  • BARRA CHICOTE, ROBERTO
  • MONTERO, JUAN MANUEL

publication date

  • August 2013

start page

  • 10519

end page

  • 10538

issue

  • 8

volume

  • 13

International Standard Serial Number (ISSN)

  • 1424-3210

Electronic International Standard Serial Number (EISSN)

  • 1424-8220

abstract

  • We describe the work on infusion of emotion into a limited-task autonomous spoken conversational agent situated in the domestic environment, using a need-inspired task-independent emotion model (NEMO). In order to demonstrate the generation of affect through the use of the model, we describe the work of integrating it with a natural-language mixed-initiative HiFi-control spoken conversational agent (SCA). NEMO and the host system communicate externally, removing the need for the Dialog Manager to be modified, as is done in most existing dialog systems, in order to be adaptive. The first part of the paper concerns the integration between NEMO and the host agent. The second part summarizes the work on automatic affect prediction, namely, frustration and contentment, from dialog features, a non-conventional source, in the attempt of moving towards a more user-centric approach. The final part reports the evaluation results obtained from a user study, in which both versions of the agent (non-adaptive and emotionally-adaptive) were compared. The results provide substantial evidences with respect to the benefits of adding emotion in a spoken conversational agent, especially in mitigating users' frustrations and, ultimately, improving their satisfaction.

keywords

  • spoken conversational agents; affect prediction; domotic applications; affective agents; frustration; contentment; conversational features; user satisfaction; emotion model; emotion design and evaluation