New wireless connection between user and VE using speech processing
TypeArticles dans des revues avec comité de lecture
This paper presents a novel speak-to-VR virtual reality peripheral network (VRPN) server based on speech processing. The server uses a microphone array as a speech source and streams the results of the process through a Wi-Fi network. The proposed VRPN server provides a handy, portable and wireless human machine interface that can facilitate interaction in a variety interfaces and application domains including HMD- and CAVE-based virtual reality systems, flight and driving simulators and many others. The VRPN server is based on a speech processing software development kits and VRPN library in C++. Speak-to-VR VRPN works well even in the presence of background noise or the voices of other users in the vicinity. The speech processing algorithm is not sensitive to the user’s accent because it is trained while it is operating. Speech recognition parameters are trained by hidden Markov model in real time. The advantages and disadvantages of the speak-to-VR server are studied under different configurations. Then, the efficiency and the precision of the speak-to-VR server for a real application are validated via a formal user study with ten participants. Two experimental test setups are implemented on a CAVE system by using either Kinect Xbox or array microphone as input device. Each participant is asked to navigate in a virtual environment and manipulate an object. The experimental data analysis shows promising results and motivates additional research opportunities.
Cette publication figure dans le(s) laboratoire(s) suivant(s)
Visualiser des documents liés par titre, auteur, créateur et sujet.
HATTAR, Gunjeet; MIRZAEI, Mohammad Ali; GARBAYA, Samir; MERIENNE, Frédéric; CHARDONNET, Jean-Rémy (Association Française de Réalité Virtuelle, 2013)The need for a collaborative approach that can easily manifest the basic ideas into a semantic enriched Virtual Environment is felt. To realize the same, a clear combination of two individual processes is applied. Beginning ...
MIRZAEI, Mohammad Ali; CHARDONNET, Jean-Rémy; MERIENNE, Frédéric (SciTePress, 2018)Virtual reality aims at reproducing reality and simulating actions like object manipulation tasks. Despite abundant past research on designing 3D interaction devices and methods to achieve close-to-real manipulation in ...
Features of the Postural Sway Signal as Indicators to Estimate and Predict Visually Induced Motion Sickness in Virtual Reality CHARDONNET, Jean-Rémy; MIRZAEI, Mohammad Ali; MERIENNE, Frédéric (Taylor & Francis, 2017)Navigation in a 3D immersive virtual environment is known to be prone to visually induced motion sickness (VIMS). Several psychophysiological and behavioral methods have been used to measure the level of sickness of a user, ...
Improvement of the real-time gesture analysis by a new mother wavelet and the application for the navigation inside a scale-one 3D system MIRZAEI, Mohammad Ali; CHARDONNET, Jean-Rémy; MERIENNE, Frédéric; PÈRE, Christian (IEEE, 2013)This paper proposes a navigation technique for traveling inside a real-scale 3D model based on human gesture analysis. In the ﬁrst step, a simple threshold is used as a criterion to analyze gestures. In the next step, a ...
Visually Induced Motion Sickness Estimation and Prediction in Virtual Reality using Frequency Components Analysis of Postural Sway Signal CHARDONNET, Jean-Rémy; MIRZAEI, Mohammad Ali; MERIENNE, Frédéric (2015)The paper proposes a method for estimating and predicting visually induced motion sickness (VIMS) occurring in a navigation task in a 3D immersive virtual environment, by extracting features from the body postural sway ...