Multimodal complex emotions : gesture expressivity and blended facial expressions
Article dans une revue avec comité de lecture
One of the challenges of designing virtual humans is the definition of appropriate models of the relation between realistic emotions and the coordination of behaviors in several modalities. In this paper, we present the annotation, representation and modeling of multimodal visual behaviors occurring during complex emotions. We illustrate our work using a corpus of TV interviews. This corpus has been annotated at several levels of information: communicative acts, emotion labels, and multimodal signs. We have defined a copy-synthesis approach to drive an Embodied Conversational Agent from these different levels of information. The second part of our paper focuses on a model of complex (superposition and masking of) emotions in facial expressions of the agent. We explain how the complementary aspects of our work on corpus and computational model is used to specify complex emotional behaviors.
Cette publication figure dans le(s) laboratoire(s) suivant(s)
Visualiser des documents liés par titre, auteur, créateur et sujet.
Article dans une revue avec comité de lectureMARTIN, Jean-Claude; BUISINE, Stéphanie; PITEL, Guillaume; BERNSEN, Niels Ole (Elsevier, 2006)Most existing multi-modal prototypes enabling users to combine 2D gestures and speech input are task-oriented. They help adult users solve particular information tasks often in 2D standard Graphical User Interfaces. This ...
Impact of Expressive Wrinkles on Perception of a Virtual Character’s Facial Expressions of Emotions Communication avec acteCOURGEON, Matthieu; BUISINE, Stéphanie; MARTIN, Jean-Claude (Springer, 2009)Facial animation has reached a high level of photorealism. Skin is rendered with grain and translucency, wrinkles are accurate and dynamic. These recent visual improvements are not fully tested for their contribution to ...
The effects of speech–gesture cooperation in animated agents’ behavior in multimedia presentations Article dans une revue avec comité de lectureBUISINE, Stéphanie; MARTIN, Jean-Claude (Oxford University Press (OUP), 2007)Until now, research on arrangement of verbal and non-verbal information in multimedia presentations has not considered multimodal behavior of animated agents. In this paper, we will present an experiment exploring the ...
Article dans une revue avec comité de lectureCINQUIN, Jacques; COLIN, Xavier; FAYOLLE, Bruno; MILLE, Marion; TEREKHINA, Svetlana; CHOCINSKI-ARNAULT, Laurence; GIGLIOTTI, Marco; GRANDIDIER, Jean-Claude; LAFARIE-FRENOT, Marie-Christine; MINERVINO, Matteo; CLUZEL, Christophe; DAGHIA, Federica; LADEVEZE, Pierre; ZHANG, Fangzouh (Techno-Press, 2016)The present paper is a review of the main activities carried out within the context of the COMPTINN‟ program, a joint research project founded by a FUI program (Fonds Unifiés Interministériels) in which four research teams ...
Communication avec acteLANG, Armand; GAZO, Claude; SEGONDS, Frédéric; MANTELET, Fabrice; JEAN, Camille; GUEGAN, Jérôme; BUISINE, Stéphanie (Springer, 2019)The industry has quickly realized the importance of bringing creativity into product design. The industrial context requires robust and efficient methods and tools to access untapped sources of ideas. Furthermore, Additive ...