AI-Based Interactive Digital Assistants for Virtual Reality in Educational Contexts
Communication avec acte
Auteur
MCKERN, Arelia
150665 Karlsruhe Institute of Technology = Karlsruher Institut für Technologie [KIT]
469668 Institut für Informationsmanagement im Ingenieurwesen [IMI]
150665 Karlsruhe Institute of Technology = Karlsruher Institut für Technologie [KIT]
469668 Institut für Informationsmanagement im Ingenieurwesen [IMI]
MAYER, Anjela
150665 Karlsruhe Institute of Technology = Karlsruher Institut für Technologie [KIT]
469668 Institut für Informationsmanagement im Ingenieurwesen [IMI]
150665 Karlsruhe Institute of Technology = Karlsruher Institut für Technologie [KIT]
469668 Institut für Informationsmanagement im Ingenieurwesen [IMI]
Résumé
This study presents and investigates a novel use of Artificial Intelligence (AI) for the creation of digital assistants in Virtual Reality (VR) environments for training and educational contexts. The concept proposed in this work couples two separate AI systems, the Movement Model (MM) and the Language Model (LM), to generate both conversational and visual responses simultaneously. The LM uses a two channel system to simplify communication with the MM, such that it responds to the user through one channel, and provides input to the MM through the other. This input allows the MM to produce context-relevant movements to assist communication with the user. Additionally, since this process is handled automatically by AI systems, it can provide a uniquely simple method for the creation and customization of digital assistants, with minimal technical knowledge or time investment from the user. A proof-of-concept prototype was implemented and underwent preliminary validation via a comparison to the Avatar Replay System (ARS) from our previous work in a user study. It was found that the AI assistants were able to interact with the users comparably to human recordings captured with the ARS assistants.
Fichier(s) constituant cette publication
- Nom:
- LISPEN_GECON_2024_CHARDONNET.pdf
- Taille:
- 439.6Ko
- Format:
- Fin d'embargo:
- 2025-02-05
Cette publication figure dans le(s) laboratoire(s) suivant(s)
Documents liés
Visualiser des documents liés par titre, auteur, créateur et sujet.
-
Chapitre d'ouvrage scientifiqueMAYER, Anjela; JEAN-RÉMY, CHARDONNET; HÄFNER, Polina; OVTCHAROVA, Jivka (Springer International Publishing, 2023-04-27)Digital transformation facilitates new methods for remote collaboration while shaping a new understanding of working together. In this chapter, we consider global collaboration in the context of digital transformation, ...
-
Communication avec acteMAYER, Anjela; KASTNER, Kevin; REICHWALD, Julian; OVTCHAROVA, Jivka; CHARDONNET, Jean-Rémy (IEEE, 2023-08-02)Virtual education is gaining prominence, providing opportunities for dynamic interactive content, such as Digital Twins, and novel collaboration modalities, including options for remote classrooms. In this work, we present ...
-
Communication avec acteMAYER, Anjela; COMBE, Theo; OVTCHAROVA, Jivka; CHARDONNET, Jean-Rémy (Springer Nature Switzerland, 2022-08-28)Research in Collaborative Virtual Environments (CVEs) is becoming more and more significant with increasing accessibility of Virtual Reality (VR) and Augmented Reality (AR) technology, additionally reinforced by the ...
-
Communication avec acteMAYER, Anjela; RUNGEARD, Augustin; CHARDONNET, Jean-Rémy; HÄFNER, Polina; OVTCHAROVA, Jivka (IEEE, 2023-06)Collaborative Virtual Environments (CVEs) have recently become more prominent in academic research and industrial applications. Physical tasks often rely on sharing spatial information between the collaborators, which are ...
-
Communication avec acteMIGUEL-ALONSO, Ines; MAYER, Anjela; CHARDONNET, Jean-Rémy; BUSTILLO, Andres; OVTCHAROVA, Jivka (Springer Nature Switzerland, 2024-06-01)Immersive Virtual Reality (iVR) has gained popularity in education for its ability to engage students and enhance learning. With the growing use of avatars in collaborative iVR environments, there is a need for structured ...