Combining HoloLens and Leap-Motion for Free Hand-Based 3D Interaction in MR Environments
Type
Communications avec actesAbstract
The ability to interact with virtual objects using gestures would allow users to improve their experience in Mixed Reality (MR) environments, especially when they use AR headsets. Today, MR head-mounted displays like the HoloLens integrate hand gesture based interaction allowing users to take actions in MR environments. However, the proposed interactions remain limited. In this paper, we propose to combine a Leap Motion Controller (LMC) with a HoloLens in order to improve gesture interaction with virtual objects. Two main issues are presented: an interactive calibration procedure for the coupled HoloLens-LMC device and an intuitive hand-based interaction approach using LMC data in the HoloLens environment. A set of first experiments was carried out to evaluate the accuracy and the usability of the proposed approach.
Files in this item
Related items
Showing items related by title, author, creator and subject.
-
ABABSA, Fakhreddine; HE, Junhui; CHARDONNET, Jean-Rémy (2018)In augmented reality environments, the natural hand interaction between a virtual object and the user is a major issue to manipulate a rendered object in a convenient way. Microsoft’s HoloLens (Microsoft 2018) is an ...
-
CHARDONNET, Jean-Rémy; LEON, Jean-Claude (2015)An interaction peripheral device capable of controlling an element for touching and grasping multidimensional virtual objects, including at least two interaction modules, each interaction module being intended to be actuated ...
-
LÉON, Jean-Claude; DUPEUX, Thomas; CHARDONNET, Jean-Rémy; PERRET, Jérôme (ASME, 2016)The simulation of grasping operations in virtual reality (VR) is required for many applications, especially in the domain of industrial product design, but it is very difficult to achieve without any haptic feedback. Force ...
-
CHARDONNET, Jean-Rémy; LEON, Jean-Claude (2012)We present a prototype of a hands-on immersive peripheral device for controlling a virtual hand with high dexterity. This prototype is as easy as a mouse to use and allows the control of a high number of degrees of freedom ...
-
CHARDONNET, Jean-Rémy; LEON, Jean-Claude (2013)L’invention concerne un périphérique d’interaction (1) apte à contrôler un élément de toucher et de préhension d’objets virtuels multidimensionnels, comportant au moins deux modules d’interaction (20), chaque module ...