Navigation and interaction in a real-scale digital mock-up using natural language and user gesture
Communication avec acte
Date
2014Abstract
This paper tries to demonstrate a very new real-scale 3D system and sum up some firsthand and cutting edge results concerning multi-modal navigation and interaction interfaces. This work is part of the CALLISTO-SARI collaborative project. It aims at constructing an immersive room, developing a set of software tools and some navigation/interaction interfaces. Two sets of interfaces will be introduced here: 1) interaction devices, 2) natural language (speech processing) and user gesture. The survey on this system using subjective observation (Simulator Sickness Questionnaire, SSQ) and objective measurements (Center of Gravity, COG) shows that using natural languages and gesture-based interfaces induced less cyber-sickness comparing to device-based interfaces. Therefore, gesture-based is more efficient than device-based interfaces.
Files in this item
Related items
Showing items related by title, author, creator and subject.
-
Communication sans acte3D systems due to its complicated electronical, mechanical and vision accessories have enormous degree of complexity both in design and evaluation. Navigation system usually plays an important role in most 3D ...
-
Communication avec acteThe paper proposes a method for estimating and predicting visually induced motion sickness (VIMS) occurring in a navigation task in a 3D immersive virtual environment, by extracting features from the body postural sway ...
-
Article dans une revue avec comité de lectureMIRZAEI, Mohammad Ali; OLIVER, James H.;
MERIENNE, Frédéric;
CHARDONNET, Jean-Rémy (Springer Verlag, 2014)
This paper presents a novel speak-to-VR virtual reality peripheral network (VRPN) server based on speech processing. The server uses a microphone array as a speech source and streams the results of the process through a ... -
Communication avec acteMIRZAEI, Mohammad Ali; PRIANTO, Sugeng; PÈRE, Christian;
MERIENNE, Frédéric;
CHARDONNET, Jean-Rémy (IEEE, 2013)
The paper presents a new mother wavelet adapted from a specific pattern. Wavelet multi-resolution analysis uses this wavelet to detect the position of the pattern in an Infra-Red (IR) signal under scale variation and the ... -
Communication avec acteThis paper proposes a navigation technique for traveling inside a real-scale 3D model based on human gesture analysis. In the first step, a simple threshold is used as a criterion to analyze gestures. In the next step, a ...