Free Hand-Based 3D Interaction in Optical See-Through Augmented Reality Using Leap Motion
Communication avec acte
Date
2018Abstract
In augmented reality environments, the natural hand interaction between a virtual object and the user is a major issue to manipulate a rendered object in a convenient way. Microsoft’s HoloLens (Microsoft 2018) is an innovative augmented reality (AR) device that has provided an impressive experience for the user. However, the gesture interactions offered to the user are very limited. HoloLens currently recognizes two core component gestures: Air tap and Bloom. To solve this issue, we propose to integrate a Leap Motion Controller (LMC) within the HoloLens device (Figure 1). We thus used 3D hand and finger tracking provided by the LMC to propose new free hand-based interaction more natural and intuitive. We implemented three fully 3D techniques for selection, translation and rotation manipulation. In this work, we first investigated how to combine the two devices to get them working together in real time, and then we evaluated the proposed 3D hand interactions.
Files in this item
Related items
Showing items related by title, author, creator and subject.
-
Communication avec acteThe ability to interact with virtual objects using gestures would allow users to improve their experience in Mixed Reality (MR) environments, especially when they use AR headsets. Today, MR head-mounted displays like the ...
-
BrevetAn interaction peripheral device capable of controlling an element for touching and grasping multidimensional virtual objects, including at least two interaction modules, each interaction module being intended to be actuated ...
-
Article dans une revue avec comité de lectureLÉON, Jean-Claude; DUPEUX, Thomas; PERRET, Jérôme; CHARDONNET, Jean-Rémy (American Society of Mechanical Engineers, 2016)The simulation of grasping operations in virtual reality (VR) is required for many applications, especially in the domain of industrial product design, but it is very difficult to achieve without any haptic feedback. Force ...
-
Communication avec acteWe present a prototype of a hands-on immersive peripheral device for controlling a virtual hand with high dexterity. This prototype is as easy as a mouse to use and allows the control of a high number of degrees of freedom ...
-
BrevetL’invention concerne un périphérique d’interaction (1) apte à contrôler un élément de toucher et de préhension d’objets virtuels multidimensionnels, comportant au moins deux modules d’interaction (20), chaque module ...