• français
    • English
    français
  • Login
Help
View Item 
  •   Home
  • Laboratoire Conception de Produits et Innovation (LCPI)
  • View Item
  • Home
  • Laboratoire Conception de Produits et Innovation (LCPI)
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.

The effects of speech–gesture cooperation in animated agents’ behavior in multimedia presentations

Article dans une revue avec comité de lecture
Author
BUISINE, Stéphanie
127758 Laboratoire Conception de Produits et Innovation [LCPI]
MARTIN, Jean-Claude

URI
http://hdl.handle.net/10985/6758
DOI
10.1016/j.intcom.2007.04.002
Date
2007
Journal
Interacting with Computers

Abstract

Until now, research on arrangement of verbal and non-verbal information in multimedia presentations has not considered multimodal behavior of animated agents. In this paper, we will present an experiment exploring the effects of different types of speech–gesture cooperation in agents’ behavior: redundancy (gestures duplicate pieces of information conveyed by speech), complementarity (distribution of information across speech and gestures) and a control condition in which gesture does not convey semantic information. Using a Latin-square design, these strategies were attributed to agents of different appearances to present different objects. Fifty-four male and 54 female users attended three short presentations performed by the agents, recalled the content of presentations and evaluated both the presentations and the agents. Although speech–gesture cooperation was not consciously perceived, it proved to influence users’ recall performance and subjective evaluations: redundancy increased verbal information recall, ratings of the quality of explanation, and expressiveness of agents. Redundancy also resulted in higher likeability scores for the agents and a more positive perception of their personality. Users’ gender had no influence on this set of results.

Files in this item

Name:
LCPI_IWC_2007_BUISINE.pdf
Size:
1017.Kb
Format:
PDF
View/Open

Collections

  • Laboratoire Conception de Produits et Innovation (LCPI)

Related items

Showing items related by title, author, creator and subject.

  • Fusion of children’s speech and 2D gestures when conversing with 3D characters 
    Article dans une revue avec comité de lecture
    MARTIN, Jean-Claude; BUISINE, Stéphanie; PITEL, Guillaume; BERNSEN, Niels Ole (Elsevier, 2006)
    Most existing multi-modal prototypes enabling users to combine 2D gestures and speech input are task-oriented. They help adult users solve particular information tasks often in 2D standard Graphical User Interfaces. This ...
  • Impact of Expressive Wrinkles on Perception of a Virtual Character’s Facial Expressions of Emotions 
    Communication avec acte
    COURGEON, Matthieu; BUISINE, Stéphanie; MARTIN, Jean-Claude (Springer, 2009)
    Facial animation has reached a high level of photorealism. Skin is rendered with grain and translucency, wrinkles are accurate and dynamic. These recent visual improvements are not fully tested for their contribution to ...
  • Multimodal complex emotions : gesture expressivity and blended facial expressions 
    Article dans une revue avec comité de lecture
    MARTIN, Jean-Claude; NIEWIADOMSKI, Radoslaw; DEVILLERS, Laurence; BUISINE, Stéphanie; PELACHAUD, Catherine (World Scientific Publishing, 2006)
    One of the challenges of designing virtual humans is the definition of appropriate models of the relation between realistic emotions and the coordination of behaviors in several modalities. In this paper, we present the ...
  • A Proposal for a Methodology of Technical Creativity Mixing TRIZ and Additive Manufacturing 
    Communication avec acte
    LANG, Armand; GAZO, Claude; ccJEAN, Camille; GUEGAN, Jérôme; BUISINE, Stéphanie; ccMANTELET, Fabrice; ccSEGONDS, Frederic (Springer, 2019)
    The industry has quickly realized the importance of bringing creativity into product design. The industrial context requires robust and efficient methods and tools to access untapped sources of ideas. Furthermore, Additive ...
  • Augmented Design with Additive Manufacturing Methodology: Tangible Object-Based Method to Enhance Creativity in Design for Additive Manufacturing 
    Article dans une revue avec comité de lecture
    LANG, Armand; ccSEGONDS, Frederic; ccJEAN, Camille; GAZO, Claude; GUEGAN, Jérôme; BUISINE, Stéphanie; ccMANTELET, Fabrice (Mary Ann Liebert Inc, 2021)
    Additive manufacturing (AM) brings new design potential compared with traditional manufacturing. Nevertheless, traditional manufacturing knowledge remains embedded in the minds of designers and is a real cognitive barrier ...

Browse

All SAMCommunities & CollectionsAuthorsIssue DateCenter / InstitutionThis CollectionAuthorsIssue DateCenter / Institution

Newsletter

Latest newsletterPrevious newsletters

Statistics

Most Popular ItemsStatistics by CountryMost Popular Authors

ÉCOLE NATIONALE SUPERIEURE D'ARTS ET METIERS

  • Contact
  • Mentions légales

ÉCOLE NATIONALE SUPERIEURE D'ARTS ET METIERS

  • Contact
  • Mentions légales