Empirical investigation of the temporal relations between speech and facial expressions of emotion
Type
Articles dans des revues avec comité de lectureDate
2010Journal
Journal on Multimodal User InterfacesAbstract
Behavior models implemented within Embodied Conversational Agents (ECAs) require nonverbal communication to be tightly coordinated with speech. In this paper we present an empirical study seeking to explore the influence of the temporal coordination between speech and facial expressions of emotions on the perception of these emotions by users (measuring their performance in this task, the perceived realism of behavior, and user preferences).We generated five different conditions of temporal coordination between facial expression and speech: facial expression displayed before a speech utterance, at the beginning of the utterance, throughout, at the end of, or following the utterance. 23 subjects participated in the experiment and saw these 5 conditions applied to the display of 6 emotions (fear, joy, anger, disgust, surprise and sadness). Subjects recognized emotions most efficiently when facial expressions were displayed at the end of the spoken sentence. However, the combination users viewed as most realistic, preferred over others, was the display of the facial expression throughout speech utterance. We review existing literature to position our work and discuss the relationship between realism and communication performance. We also provide animation guidelines and draw some avenues for future work.
Files in this item
Related items
Showing items related by title, author, creator and subject.
-
ROOSEN, Christine; INACIO, Emilie; BUISINE, Stéphanie; MARANZANA, Nicolas (2013)L'invention TIPATSMA (Tableau Interactif pour Patients atteints de Troubles Sévères de la Maladie d'Alzheimer) se rapporte à un tableau interactif destiné aux patients atteints de la maladie d'Alzheimer.
-
DELAS, Alexia; MARANZANA, Nicolas; MANTELET, Fabrice; BUISINE, Stéphanie (Taylor & Francis, 2015)This paper aims at formalizing an innovation process well suited for small- and medium-sized enterprises (SMEs) specialized in retail. The design research consisted in analyzing conceptual models of innovation process from ...
-
PLOS, Ornella; BUISINE, Stéphanie; AOUSSAT, Améziane; MANTELET, Fabrice; DUMAS, Claude (Elsevier, 2012)Assistive Technologies are specialized products aiming to partly compensate for the loss of autonomy experienced by disabled people. Because they address special needs in a highly-segmented market, they are often considered ...
-
GUEGAN, Jérôme; BUISINE, Stéphanie; MANTELET, Fabrice; MARANZANA, Nicolas; SEGONDS, Frédéric (ELSEVIER, 2016)An important challenge today is to support creativity while enabling geographically distant people to work together. In line with the componential theory of creativity, self-perception theory and recent research on the ...
-
BUISINE, Stéphanie; GUEGAN, Jérôme; BARRE, Jessy; SEGONDS, Frédéric; AOUSSAT, Améziane (SPRINGER, 2016)To face innovation challenges of the twenty-first century, companies should learn from proven successful strategies and draw on technological evolutions as well. Our proposal consists in aligning ideation to innovation ...