Show simple item record

dc.contributor.authorMIRZAEI, Mohammad Ali
dc.contributor.authorOLIVER, James H.
dc.contributor.author
 hal.structure.identifier
MERIENNE, Frédéric
22594 Laboratoire Electronique, Informatique et Image [UMR6306] [Le2i]
dc.contributor.authorCHARDONNET, Jean-Rémy
dc.date.accessioned2015
dc.date.available2015
dc.date.issued2014
dc.date.submitted2015
dc.identifier.issn1359-4338
dc.identifier.urihttp://hdl.handle.net/10985/9469
dc.descriptionErratum édité en mars 2015 (voir première page)
dc.description.abstractThis paper presents a novel speak-to-VR virtual reality peripheral network (VRPN) server based on speech processing. The server uses a microphone array as a speech source and streams the results of the process through a Wi-Fi network. The proposed VRPN server provides a handy, portable and wireless human machine interface that can facilitate interaction in a variety interfaces and application domains including HMD- and CAVE-based virtual reality systems, flight and driving simulators and many others. The VRPN server is based on a speech processing software development kits and VRPN library in C++. Speak-to-VR VRPN works well even in the presence of background noise or the voices of other users in the vicinity. The speech processing algorithm is not sensitive to the user’s accent because it is trained while it is operating. Speech recognition parameters are trained by hidden Markov model in real time. The advantages and disadvantages of the speak-to-VR server are studied under different configurations. Then, the efficiency and the precision of the speak-to-VR server for a real application are validated via a formal user study with ten participants. Two experimental test setups are implemented on a CAVE system by using either Kinect Xbox or array microphone as input device. Each participant is asked to navigate in a virtual environment and manipulate an object. The experimental data analysis shows promising results and motivates additional research opportunities.
dc.language.isoen
dc.publisherSpringer Verlag
dc.rightsPost-print
dc.subjectSpeak-to-VR
dc.subjectWi-Fi network
dc.subjectSpeech processing
dc.subjectVRPN server
dc.titleNew wireless connection between user and VE using speech processing
dc.typdocArticle dans une revue avec comité de lecture
dc.localisationInstitut de Chalon sur Saône
dc.subject.halInformatique: Interface homme-machine
dc.subject.halInformatique: Synthèse d'image et réalité virtuelle
dc.subject.halInformatique: Traitement du signal et de l'image
ensam.audienceInternationale
ensam.page235-243
ensam.journalVirtual Reality
ensam.volume18
ensam.issue4
hal.identifierhal-01143500
hal.version1
hal.statusaccept
dc.identifier.eissn1434-9957


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record