Empirical investigation of the temporal relations between speech and facial expressions of emotion
TypeArticles dans des revues avec comité de lecture
Behavior models implemented within Embodied Conversational Agents (ECAs) require nonverbal communication to be tightly coordinated with speech. In this paper we present an empirical study seeking to explore the influence of the temporal coordination between speech and facial expressions of emotions on the perception of these emotions by users (measuring their performance in this task, the perceived realism of behavior, and user preferences).We generated five different conditions of temporal coordination between facial expression and speech: facial expression displayed before a speech utterance, at the beginning of the utterance, throughout, at the end of, or following the utterance. 23 subjects participated in the experiment and saw these 5 conditions applied to the display of 6 emotions (fear, joy, anger, disgust, surprise and sadness). Subjects recognized emotions most efficiently when facial expressions were displayed at the end of the spoken sentence. However, the combination users viewed as most realistic, preferred over others, was the display of the facial expression throughout speech utterance. We review existing literature to position our work and discuss the relationship between realism and communication performance. We also provide animation guidelines and draw some avenues for future work.
Showing items related by title, author, creator and subject.
Distinct and combined effects of disciplinary composition and methodological support on problem solving in groups SCHÖFER, Malte; MARANZANA, Nicolas; AOUSSAT, Améziane; BERSANO, Giacomo; BUISINE, Stéphanie (Wiley, 2018)Several reasons for the use of multidisciplinary teams composed of individuals with natural science and engineering background in problem‐solving processes exist. The most important are the integration of science‐based ...
Collaborative design tools in engineering education: Insight to choose the appropriate PLM software MARANZANA, Nicolas; SEGONDS, Frédéric; BUISINE, Stéphanie (SAGE Publications, 2018)The shift from sequential to concurrent engineering has led to changes in the way design projects are managed. In order to assist designers, many effective tools have been developed to support collaborative engineering. ...
ROOSEN, Christine; INACIO, Emilie; BUISINE, Stéphanie; MARANZANA, Nicolas (2013)L'invention TIPATSMA (Tableau Interactif pour Patients atteints de Troubles Sévères de la Maladie d'Alzheimer) se rapporte à un tableau interactif destiné aux patients atteints de la maladie d'Alzheimer.
MARTIN, Jean-Claude; BUISINE, Stéphanie; PITEL, Guillaume; BERNSEN, Niels Ole (Elsevier, 2006)Most existing multi-modal prototypes enabling users to combine 2D gestures and speech input are task-oriented. They help adult users solve particular information tasks often in 2D standard Graphical User Interfaces. This ...
SCHMITT, Lara; BUISINE, Stéphanie; CHABOISSIER, Jonathan; AOUSSAT, Améziane; VERNIER, Frédéric (Elsevier, 2012)We designed a tabletop brainwriting interface to examine the effects of time pressure and social pressure on the creative performance. After positioning this study with regard to creativity research and human activity in ...