Expressive Multimodal Conversational Acts for SAIBA Agents

• Main Authors: Rivière, Jérémy, Adam, Carole, Pesty, Sylvie, Pelachaud, Catherine, Guiraud, Nadine, Longin, Dominique, Lorini, Emiliano
• Other Authors: Laboratoire d'Informatique de Grenoble (LIG), Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut National Polytechnique de Grenoble (INPG)-Centre National de la Recherche Scientifique (CNRS), Laboratoire Traitement et Communication de l'Information (LTCI), Télécom ParisTech-Institut Mines-Télécom Paris (IMT)-Centre National de la Recherche Scientifique (CNRS), Centre National de la Recherche Scientifique (CNRS), Logique, Interaction, Langue et Calcul (IRIT-LILaC), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse Capitole (UT Capitole), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université Fédérale Toulouse Midi-Pyrénées-Toulouse Mind & Brain Institut (TMBI), Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse III - Paul Sabatier (UT3), Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse Capitole (UT Capitole), Université Fédérale Toulouse Midi-Pyrénées, Université Toulouse III - Paul Sabatier (UT3), Högni Vilhjálmsson Hannes, Kopp Stefan, Marsella Stacy, R. Thórisson Kristinn, ANR-08-CORD-0005,CECIL,Emotions complexes dans la communication, l'interaction et le langage(2008)
• Format: Conference Object
• Language: English
• Published: HAL CCSD 2011
• Subjects: ECA; Emotions; Interaction; Dialogue; [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]; [INFO.INFO-LO]Computer Science [cs]/Logic in Computer Science [cs.LO]; [INFO.INFO-MA]Computer Science [cs]/Multiagent Systems [cs.MA]; Iceland
• Online Access: https://hal.science/hal-00950872; https://hal.science/hal-00950872/document; https://hal.science/hal-00950872/file/longin_IVA2011.pdf; https://doi.org/10.1007/978-3-642-23974-8_34

International audience We discuss here the need to define what we call an agent con-versational language, a language for Embodied Conversational Agents (ECA) to have conversations with a human. We propose a set of Ex-pressive Multimodal Conversation Acts (EMCA), which is based on the Expressive Speech Acts that we introduced in a previous work, enriched with the multimodal expression of the emotions linked to these acts. We have then implemented these EMCA for SAIBA-compliant ECA, and specifically for Greta. We were able to use Greta in experiments aimed at assessing the benefits of our language in terms of perceived sincerity and believability of an ECA using it to interact with a human user.