• français
    • English
    English
  • Ouvrir une session
Aide
Voir le document 
  •   Accueil de SAM
  • Laboratoire d’Ingénierie des Systèmes Physiques Et Numériques (LISPEN)
  • Voir le document
  • Accueil de SAM
  • Laboratoire d’Ingénierie des Systèmes Physiques Et Numériques (LISPEN)
  • Voir le document
JavaScript is disabled for your browser. Some features of this site may not work without it.

New wireless connection between user and VE using speech processing

Article dans une revue avec comité de lecture
Auteur
MIRZAEI, Mohammad Ali
OLIVER, James H.
ccMERIENNE, Frédéric
22594 Laboratoire Electronique, Informatique et Image [UMR6306] [Le2i]
ccCHARDONNET, Jean-Rémy

URI
http://hdl.handle.net/10985/9469
Date
2014
Journal
Virtual Reality

Résumé

This paper presents a novel speak-to-VR virtual reality peripheral network (VRPN) server based on speech processing. The server uses a microphone array as a speech source and streams the results of the process through a Wi-Fi network. The proposed VRPN server provides a handy, portable and wireless human machine interface that can facilitate interaction in a variety interfaces and application domains including HMD- and CAVE-based virtual reality systems, flight and driving simulators and many others. The VRPN server is based on a speech processing software development kits and VRPN library in C++. Speak-to-VR VRPN works well even in the presence of background noise or the voices of other users in the vicinity. The speech processing algorithm is not sensitive to the user’s accent because it is trained while it is operating. Speech recognition parameters are trained by hidden Markov model in real time. The advantages and disadvantages of the speak-to-VR server are studied under different configurations. Then, the efficiency and the precision of the speak-to-VR server for a real application are validated via a formal user study with ten participants. Two experimental test setups are implemented on a CAVE system by using either Kinect Xbox or array microphone as input device. Each participant is asked to navigate in a virtual environment and manipulate an object. The experimental data analysis shows promising results and motivates additional research opportunities.

Fichier(s) constituant cette publication

Nom:
LE2I_VR_2014_MIRZAEI.pdf
Taille:
1.273Mo
Format:
PDF
Voir/Ouvrir

Cette publication figure dans le(s) laboratoire(s) suivant(s)

  • Laboratoire d’Ingénierie des Systèmes Physiques Et Numériques (LISPEN)

Documents liés

Visualiser des documents liés par titre, auteur, créateur et sujet.

  • Navigation and interaction in a real-scale digital mock-up using natural language and user gesture 
    Communication avec acte
    MIRZAEI, Mohammad Ali; GENTY, Ariane; ccMERIENNE, Frédéric; ccCHARDONNET, Jean-Rémy (2014)
    This paper tries to demonstrate a very new real-scale 3D system and sum up some firsthand and cutting edge results concerning multi-modal navigation and interaction interfaces. This work is part of the CALLISTO-SARI ...
  • Test-bench for evaluating navigation and interaction in large virtual databases 
    Communication sans acte
    MIRZAEI, Mohammad Ali; PÈRE, Christian; ccMERIENNE, Frédéric; ccCHARDONNET, Jean-Rémy (2012)
    3D systems due to its complicated electronical, mechanical and vision accessories have enormous degree of complexity both in design and evaluation. Navigation system usually plays an important role in most 3D ...
  • Visually Induced Motion Sickness Estimation and Prediction in Virtual Reality using Frequency Components Analysis of Postural Sway Signal 
    Communication avec acte
    MIRZAEI, Mohammad Ali; ccMERIENNE, Frédéric; ccCHARDONNET, Jean-Rémy (2015)
    The paper proposes a method for estimating and predicting visually induced motion sickness (VIMS) occurring in a navigation task in a 3D immersive virtual environment, by extracting features from the body postural sway ...
  • New Mother Wavelet for Pattern Detection in IR Image 
    Communication avec acte
    MIRZAEI, Mohammad Ali; PRIANTO, Sugeng; PÈRE, Christian; ccMERIENNE, Frédéric; ccCHARDONNET, Jean-Rémy (IEEE, 2013)
    The paper presents a new mother wavelet adapted from a specific pattern. Wavelet multi-resolution analysis uses this wavelet to detect the position of the pattern in an Infra-Red (IR) signal under scale variation and the ...
  • Improvement of the real-time gesture analysis by a new mother wavelet and the application for the navigation inside a scale-one 3D system 
    Communication avec acte
    MIRZAEI, Mohammad Ali; PÈRE, Christian; ccMERIENNE, Frédéric; ccCHARDONNET, Jean-Rémy (IEEE, 2013)
    This paper proposes a navigation technique for traveling inside a real-scale 3D model based on human gesture analysis. In the first step, a simple threshold is used as a criterion to analyze gestures. In the next step, a ...

Parcourir

Tout SAMLaboratoiresAuteursDates de publicationCampus/InstitutsCe LaboratoireAuteursDates de publicationCampus/Instituts

Lettre Diffuser la Science

Dernière lettreVoir plus

Statistiques de consultation

Publications les plus consultéesStatistiques par paysAuteurs les plus consultés

ÉCOLE NATIONALE SUPERIEURE D'ARTS ET METIERS

  • Contact
  • Mentions légales

ÉCOLE NATIONALE SUPERIEURE D'ARTS ET METIERS

  • Contact
  • Mentions légales