Sensor fusion for interactive real-scale modeling and simulation systems
Communication avec acte
This paper proposes an accurate sensor fusion scheme for navigation inside a real-scale 3D model by combining audio and video signals. Audio signal of a microphone-array is merged by Minimum Variance Distortion-less Response (MVDR) algorithm and processed instantaneously via Hidden Markov Model (HMM) to generate translation commands by word-to-action module of speech processing system. Then, the output of optical head tracker (four IR cameras) is analyzed by non-linear/non-Gaussian Bayesian algorithm to provide information about the orientation of the user's head. The orientation is used to redirect the user toward a new direction by applying quaternion rotation. The output of these two sensors (video and audio) is combined under the sensor fusion scheme to perform continuous travelling inside the model. The maximum precision for the traveling task is achieved under sensor fusion scheme. Practical experiment shows promising results for the implementation.
Showing items related by title, author, creator and subject.
Communication sans acteMIRZAEI, Mohammad Ali; CHARDONNET, Jean-Rémy; PÈRE, Christian; MERIENNE, Frédéric (2012)3D systems due to its complicated electronical, mechanical and vision accessories have enormous degree of complexity both in design and evaluation. Navigation system usually plays an important role in most 3D ...
Communication sans acteMIRZAEI, Mohammad Ali; CHARDONNET, Jean-Rémy; PÈRE, Christian; MERIENNE, Frédéric (2012)This paper focuses on the measurement and the mathematical definition of cognitive parameters of designing a navigation systembased on these parameters. The nausea level due to different velocities of a 3D scene, the user ...
Improvement of the real-time gesture analysis by a new mother wavelet and the application for the navigation inside a scale-one 3D system Communication avec acteMIRZAEI, Mohammad Ali; CHARDONNET, Jean-Rémy; MERIENNE, Frédéric; PÈRE, Christian (IEEE, 2013)This paper proposes a navigation technique for traveling inside a real-scale 3D model based on human gesture analysis. In the ﬁrst step, a simple threshold is used as a criterion to analyze gestures. In the next step, a ...
Communication avec acteMIRZAEI, Mohammad Ali; PRIANTO, Sugeng; CHARDONNET, Jean-Rémy; PÈRE, Christian; MERIENNE, Frédéric (IEEE, 2013)The paper presents a new mother wavelet adapted from a speciﬁc pattern. Wavelet multi-resolution analysis uses this wavelet to detect the position of the pattern in an Infra-Red (IR) signal under scale variation and the ...
Communication avec acteHATTAR, Gunjeet; MIRZAEI, Mohammad Ali; GARBAYA, Samir; MERIENNE, Frédéric; CHARDONNET, Jean-Rémy (Association Française de Réalité Virtuelle, 2013)The need for a collaborative approach that can easily manifest the basic ideas into a semantic enriched Virtual Environment is felt. To realize the same, a clear combination of two individual processes is applied. Beginning ...