• français
    • English
    français
  • Login
Help
View Item 
  •   Home
  • Laboratoire d’Ingénierie des Systèmes Physiques Et Numériques (LISPEN)
  • View Item
  • Home
  • Laboratoire d’Ingénierie des Systèmes Physiques Et Numériques (LISPEN)
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.

AI-Based Interactive Digital Assistants for Virtual Reality in Educational Contexts

Communication avec acte
Author
MCKERN, Arelia
150665 Karlsruhe Institute of Technology = Karlsruher Institut für Technologie [KIT]
469668 Institut für Informationsmanagement im Ingenieurwesen [IMI]
MAYER, Anjela
150665 Karlsruhe Institute of Technology = Karlsruher Institut für Technologie [KIT]
469668 Institut für Informationsmanagement im Ingenieurwesen [IMI]
GREIF, Lucas
150665 Karlsruhe Institute of Technology = Karlsruher Institut für Technologie [KIT]
469668 Institut für Informationsmanagement im Ingenieurwesen [IMI]
ccCHARDONNET, Jean-Rémy
543315 Laboratoire d’Ingénierie des Systèmes Physiques et Numériques [LISPEN]
OVTCHAROVA, Jivka
150665 Karlsruhe Institute of Technology = Karlsruher Institut für Technologie [KIT]
469668 Institut für Informationsmanagement im Ingenieurwesen [IMI]

URI
http://hdl.handle.net/10985/25748
DOI
10.1109/gecon62014.2024.10734030
Date
2024-08-05

Abstract

This study presents and investigates a novel use of Artificial Intelligence (AI) for the creation of digital assistants in Virtual Reality (VR) environments for training and educational contexts. The concept proposed in this work couples two separate AI systems, the Movement Model (MM) and the Language Model (LM), to generate both conversational and visual responses simultaneously. The LM uses a two channel system to simplify communication with the MM, such that it responds to the user through one channel, and provides input to the MM through the other. This input allows the MM to produce context-relevant movements to assist communication with the user. Additionally, since this process is handled automatically by AI systems, it can provide a uniquely simple method for the creation and customization of digital assistants, with minimal technical knowledge or time investment from the user. A proof-of-concept prototype was implemented and underwent preliminary validation via a comparison to the Avatar Replay System (ARS) from our previous work in a user study. It was found that the AI assistants were able to interact with the users comparably to human recordings captured with the ARS assistants.

Files in this item

Name:
LISPEN_GECON_2024_CHARDONNET.pdf
Size:
439.6Kb
Format:
PDF
Embargoed until:
2025-02-05
View/Open

Collections

  • Laboratoire d’Ingénierie des Systèmes Physiques Et Numériques (LISPEN)

Related items

Showing items related by title, author, creator and subject.

  • Digital Twins, Extended Reality, and Artificial Intelligence in Manufacturing Reconfiguration: A Systematic Literature Review 
    Article dans une revue avec comité de lecture
    ccMAYER, Anjela; GREIF, Lucas; HÄUSSERMANN, Tim Markus; ccOTTO, Simon; KASTNER, Kevin; EL BOBBOU, Sleiman; ccCHARDONNET, Jean-Rémy; REICHWALD, Julian; ccFLEISCHER, Jürgen; ccOVTCHAROVA, Jivka (MDPI AG, 2025-03-06)
    This review draws on a systematic literature review and bibliometric analysis to examine how Digital Twins (DTs), Extended Reality (XR), and Artificial Intelligence (AI) support the reconfiguration of Cyber–Physical Systems ...
  • Comparing Avatar and Face-to-Face Collaboration in VR Education: Concept and Preliminary Insights 
    Communication avec acte
    MAYER, Anjela; KASTNER, Kevin; REICHWALD, Julian; ccOVTCHAROVA, Jivka; ccCHARDONNET, Jean-Rémy (IEEE, 2023-08-02)
    Virtual education is gaining prominence, providing opportunities for dynamic interactive content, such as Digital Twins, and novel collaboration modalities, including options for remote classrooms. In this work, we present ...
  • Collaborative Work Enabled by Immersive Environments 
    Chapitre d'ouvrage scientifique
    MAYER, Anjela; ccJEAN-RÉMY, CHARDONNET; HÄFNER, Polina; ccOVTCHAROVA, Jivka (Springer International Publishing, 2023-04-27)
    Digital transformation facilitates new methods for remote collaboration while shaping a new understanding of working together. In this chapter, we consider global collaboration in the context of digital transformation, ...
  • Immersive Hand Instructions in AR – Insights for Asynchronous Remote Collaboration on Spatio-Temporal Manual Tasks 
    Communication avec acte
    MAYER, Anjela; RUNGEARD, Augustin; ccCHARDONNET, Jean-Rémy; HÄFNER, Polina; OVTCHAROVA, Jivka (IEEE, 2023-06)
    Collaborative Virtual Environments (CVEs) have recently become more prominent in academic research and industrial applications. Physical tasks often rely on sharing spatial information between the collaborators, which are ...
  • Asynchronous Manual Work in Mixed Reality Remote Collaboration 
    Communication avec acte
    ccMAYER, Anjela; ccCOMBE, Theo; OVTCHAROVA, Jivka; ccCHARDONNET, Jean-Rémy (Springer Nature Switzerland, 2022-08-28)
    Research in Collaborative Virtual Environments (CVEs) is becoming more and more significant with increasing accessibility of Virtual Reality (VR) and Augmented Reality (AR) technology, additionally reinforced by the ...

Browse

All SAMCommunities & CollectionsAuthorsIssue DateCenter / InstitutionThis CollectionAuthorsIssue DateCenter / Institution

Newsletter

Latest newsletterPrevious newsletters

Statistics

Most Popular ItemsStatistics by CountryMost Popular Authors

ÉCOLE NATIONALE SUPERIEURE D'ARTS ET METIERS

  • Contact
  • Mentions légales

ÉCOLE NATIONALE SUPERIEURE D'ARTS ET METIERS

  • Contact
  • Mentions légales