• français
    • English
    français
  • Login
Help
View Item 
  •   Home
  • Laboratoire d’Ingénierie des Systèmes Physiques Et Numériques (LISPEN)
  • View Item
  • Home
  • Laboratoire d’Ingénierie des Systèmes Physiques Et Numériques (LISPEN)
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.

Combining HoloLens and Leap-Motion for Free Hand-Based 3D Interaction in MR Environments

Type
Communications avec actes
Author
ABABSA, Fakhreddine
543315 Laboratoire d’Ingénierie des Systèmes Physiques et Numériques [LISPEN]
HE, Junhui
265277 Ecole Nationale Supérieure de l'Electronique et de ses Applications [ENSEA]
CHARDONNET, Jean-Rémy
543315 Laboratoire d’Ingénierie des Systèmes Physiques et Numériques [LISPEN]

URI
http://hdl.handle.net/10985/19485
DOI
10.1007/978-3-030-58465-8_24
Date
2020

Abstract

The ability to interact with virtual objects using gestures would allow users to improve their experience in Mixed Reality (MR) environments, especially when they use AR headsets. Today, MR head-mounted displays like the HoloLens integrate hand gesture based interaction allowing users to take actions in MR environments. However, the proposed interactions remain limited. In this paper, we propose to combine a Leap Motion Controller (LMC) with a HoloLens in order to improve gesture interaction with virtual objects. Two main issues are presented: an interactive calibration procedure for the coupled HoloLens-LMC device and an intuitive hand-based interaction approach using LMC data in the HoloLens environment. A set of first experiments was carried out to evaluate the accuracy and the usability of the proposed approach.

Files in this item

Name:
LISPEN_2020_AVR_ABABSA.pdf
Size:
1.963Mb
Format:
PDF
View/Open

Collections

  • Laboratoire d’Ingénierie des Systèmes Physiques Et Numériques (LISPEN)

Related items

Showing items related by title, author, creator and subject.

  • Free Hand-Based 3D Interaction in Optical See-Through Augmented Reality Using Leap Motion 
    ABABSA, Fakhreddine; HE, Junhui; CHARDONNET, Jean-Rémy (2018)
    In augmented reality environments, the natural hand interaction between a virtual object and the user is a major issue to manipulate a rendered object in a convenient way. Microsoft’s HoloLens (Microsoft 2018) is an ...
  • Interaction peripheral device capable of controlling an element for touching and grasping multidimensional virtual objects 
    CHARDONNET, Jean-Rémy; LEON, Jean-Claude (2015)
    An interaction peripheral device capable of controlling an element for touching and grasping multidimensional virtual objects, including at least two interaction modules, each interaction module being intended to be actuated ...
  • Dexterous Grasping Tasks Generated With an Add-on End Effector of a Haptic Feedback System 
    LÉON, Jean-Claude; DUPEUX, Thomas; CHARDONNET, Jean-Rémy; PERRET, Jérôme (ASME, 2016)
    The simulation of grasping operations in virtual reality (VR) is required for many applications, especially in the domain of industrial product design, but it is very difficult to achieve without any haptic feedback. Force ...
  • Monitoring a Realistic Virtual Hand using a Passive Haptic Device to Interact with Virtual Worlds 
    CHARDONNET, Jean-Rémy; LEON, Jean-Claude (2012)
    We present a prototype of a hands-on immersive peripheral device for controlling a virtual hand with high dexterity. This prototype is as easy as a mouse to use and allows the control of a high number of degrees of freedom ...
  • Périphérique d'interaction apte à contrôler un élément de toucher et de préhension d'objets virtuels multidimensionnels 
    CHARDONNET, Jean-Rémy; LEON, Jean-Claude (2013)
    L’invention concerne un périphérique d’interaction (1) apte à contrôler un élément de toucher et de préhension d’objets virtuels multidimensionnels, comportant au moins deux modules d’interaction (20), chaque module ...

Browse

All SAMCommunities & CollectionsAuthorsIssue DateCenter / InstitutionThis CollectionAuthorsIssue DateCenter / Institution

Newsletter

Latest newsletterPrevious newsletters

Statistics

Most Popular ItemsStatistics by CountryMost Popular Authors

ÉCOLE NATIONALE SUPERIEURE D'ARTS ET METIERS

  • Contact
  • Mentions légales

ÉCOLE NATIONALE SUPERIEURE D'ARTS ET METIERS

  • Contact
  • Mentions légales