• français
    • English
    français
  • Login
Help
View Item 
  •   Home
  • Laboratoire Conception de Produits et Innovation (LCPI)
  • View Item
  • Home
  • Laboratoire Conception de Produits et Innovation (LCPI)
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.

Empirical investigation of the temporal relations between speech and facial expressions of emotion

Article dans une revue avec comité de lecture
Author
BUISINE, Stéphanie
127758 Laboratoire Conception de Produits et Innovation [LCPI]
WANG, Yun
GRYNSZPAN, Ouriel

URI
http://hdl.handle.net/10985/6760
DOI
10.1007/s12193-010-0050-4
Date
2010
Journal
Journal on Multimodal User Interfaces

Abstract

Behavior models implemented within Embodied Conversational Agents (ECAs) require nonverbal communication to be tightly coordinated with speech. In this paper we present an empirical study seeking to explore the influence of the temporal coordination between speech and facial expressions of emotions on the perception of these emotions by users (measuring their performance in this task, the perceived realism of behavior, and user preferences).We generated five different conditions of temporal coordination between facial expression and speech: facial expression displayed before a speech utterance, at the beginning of the utterance, throughout, at the end of, or following the utterance. 23 subjects participated in the experiment and saw these 5 conditions applied to the display of 6 emotions (fear, joy, anger, disgust, surprise and sadness). Subjects recognized emotions most efficiently when facial expressions were displayed at the end of the spoken sentence. However, the combination users viewed as most realistic, preferred over others, was the display of the facial expression throughout speech utterance. We review existing literature to position our work and discuss the relationship between realism and communication performance. We also provide animation guidelines and draw some avenues for future work.

Files in this item

Name:
LCPI_JMUI_2009_BUISINE.pdf
Size:
1.329Mb
Format:
PDF
View/Open

Collections

  • Laboratoire Conception de Produits et Innovation (LCPI)

Related items

Showing items related by title, author, creator and subject.

  • Avatar-mediated creativity: When embodying inventors makes engineers more creative 
    Article dans une revue avec comité de lecture
    GUEGAN, Jérôme; BUISINE, Stéphanie; ccMARANZANA, Nicolas; ccMANTELET, Fabrice; ccSEGONDS, Frederic (ELSEVIER, 2016)
    An important challenge today is to support creativity while enabling geographically distant people to work together. In line with the componential theory of creativity, self-perception theory and recent research on the ...
  • Social identity cues to improve creativity and identification in face-to-face and virtual groups 
    Article dans une revue avec comité de lecture
    GUEGAN, Jérôme; BARRE, Jessy; BUISINE, Stéphanie; ccMARANZANA, Nicolas; ccMANTELET, Fabrice; ccSEGONDS, Frederic (Elsevier, 2017)
    This research draws on the social identity approach to investigate group performance in face-to-face and virtual brainstorming settings. In particular, we display Social Identity Cues (SIC) on participants or on avatars ...
  • Conception de tableaux interactifs pour patients atteints de troubles sévères de la maladie d’Alzheimer (Tipatsma) 
    Article dans une revue avec comité de lecture
    DUCHOSSOY, M.; ROOSEN, Christine; TRIVALLE, C.; BUISINE, Stéphanie; MARANZANA, Nicolas (Elsevier, 2015)
    Les troubles de la déambulation et de la manipulation incessante d’objets sont un phénomène fréquent chez les malades à un stade avancé de la maladie d’Alzheimer. Leur prise en charge est très complexe pour les institutions ...
  • A Proposal for a Methodology of Technical Creativity Mixing TRIZ and Additive Manufacturing 
    Communication avec acte
    LANG, Armand; GAZO, Claude; ccJEAN, Camille; GUEGAN, Jérôme; BUISINE, Stéphanie; ccMANTELET, Fabrice; ccSEGONDS, Frederic (Springer, 2019)
    The industry has quickly realized the importance of bringing creativity into product design. The industrial context requires robust and efficient methods and tools to access untapped sources of ideas. Furthermore, Additive ...
  • Supports technologiques collaboratifs à la méthode des Personas 
    Article dans une revue avec comité de lecture
    BARRE, Jessy; BUISINE, Stéphanie; GUEGAN, Jérôme; ccMANTELET, Fabrice; ccSEGONDS, Frederic; ccAOUSSAT, Améziane (Europia, 2016)
    In this paper, we present two experiments to test the impact of collaborative technology to support the Persona method. In the first experiment, 24 designers used the Persona method to anticipate user needs for the design ...

Browse

All SAMCommunities & CollectionsAuthorsIssue DateCenter / InstitutionThis CollectionAuthorsIssue DateCenter / Institution

Newsletter

Latest newsletterPrevious newsletters

Statistics

Most Popular ItemsStatistics by CountryMost Popular Authors

ÉCOLE NATIONALE SUPERIEURE D'ARTS ET METIERS

  • Contact
  • Mentions légales

ÉCOLE NATIONALE SUPERIEURE D'ARTS ET METIERS

  • Contact
  • Mentions légales