• français
    • English
    français
  • Login
Help
View Item 
  •   Home
  • Laboratoire d’Ingénierie des Systèmes Physiques Et Numériques (LISPEN)
  • View Item
  • Home
  • Laboratoire d’Ingénierie des Systèmes Physiques Et Numériques (LISPEN)
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.

The Usability of Speech and/or Gestures in Multi-Modal Interface Systems

Communication avec acte
Author
ALIBAY, Farzana
300713 Macquarie University
KAVAKLI, Manolya
300713 Macquarie University
BAIG, Muhammad Zeeshan
300713 Macquarie University
ccCHARDONNET, Jean-Rémy
495876 Laboratoire d'Electronique, d'Informatique et d'Image [EA 7508] [Le2i]

URI
http://hdl.handle.net/10985/11682
Date
2017

Abstract

Multi-Modal Interface Systems (MMIS) have proliferated in the last few decades, since they provide a direct interface for both Human Computer Interaction (HCI) and face-to-face communication. Our aim is to provide users without any prior 3D modelling experience, with a multi-modal interface to create a 3D object. The system also incorporates help throughout the drawing process and identifies simple words and gestures to accomplish a range of (simple to complex) modeling tasks. We have developed a multi-modal interface that allows users to design objects in 3D, using AutoCAD commands as well as speech and gesture. We have used a microphone to collect speech input and a Leap Motion sensor to collect gesture input in real time. Two sets of experiments were conducted to investigate the usability of the system and evaluate the system performance using Leap Motion versus keyboard and mouse. Our results indicate that performing a task using speech is perceived exhausting, when there is no shared vocabulary between man and machine, and the usability of traditional input devices supersedes the usability of speech and gestures. Only a small ratio of participants, less than 7% in our experiments were able to carry out the tasks with appropriate precision.

Files in this item

Name:
LE2I_ICCAE_2017_CHARDONNET(1).pdf
Size:
519.4Kb
Format:
PDF
View/Open

Collections

  • Laboratoire d’Ingénierie des Systèmes Physiques Et Numériques (LISPEN)

Related items

Showing items related by title, author, creator and subject.

  • Dexterous Grasping Tasks Generated With an Add-on End Effector of a Haptic Feedback System 
    Article dans une revue avec comité de lecture
    LÉON, Jean-Claude; DUPEUX, Thomas; PERRET, Jérôme; ccCHARDONNET, Jean-Rémy (American Society of Mechanical Engineers, 2016)
    The simulation of grasping operations in virtual reality (VR) is required for many applications, especially in the domain of industrial product design, but it is very difficult to achieve without any haptic feedback. Force ...
  • Périphérique d'interaction apte à contrôler un élément de toucher et de préhension d'objets virtuels multidimensionnels 
    Brevet
    LEON, Jean-Claude; ccCHARDONNET, Jean-Rémy (2013)
    L’invention concerne un périphérique d’interaction (1) apte à contrôler un élément de toucher et de préhension d’objets virtuels multidimensionnels, comportant au moins deux modules d’interaction (20), chaque module ...
  • An add-on device to perform dexterous grasping tasks with a haptic feedback system 
    Communication avec acte
    LEON, Jean-Claude; DUPEUX, Thomas; PERRET, Jérôme; ccCHARDONNET, Jean-Rémy (ASME, 2015)
    Achieving grasping tasks in real time with haptic feedback may require the control of a large number of degrees of freedom (DOFs) to model hand and finger movements. This is mandatory to grasp objects with dexterity. Here, ...
  • Designing Interaction in Virtual Worlds through a Passive Haptic Peripheral 
    Communication avec acte
    LEON, Jean-Claude; ccCHARDONNET, Jean-Rémy (IEEE, 2012)
    This paper presents a prototype of a hands-on immersive peripheral device for controlling a virtual hand with high dexterity. Based on the results of users’ tests on previous versions of our device and on the analysis of ...
  • Interaction peripheral device capable of controlling an element for touching and grasping multidimensional virtual objects 
    Brevet
    LEON, Jean-Claude; ccCHARDONNET, Jean-Rémy (2015)
    An interaction peripheral device capable of controlling an element for touching and grasping multidimensional virtual objects, including at least two interaction modules, each interaction module being intended to be actuated ...

Browse

All SAMCommunities & CollectionsAuthorsIssue DateCenter / InstitutionThis CollectionAuthorsIssue DateCenter / Institution

Newsletter

Latest newsletterPrevious newsletters

Statistics

Most Popular ItemsStatistics by CountryMost Popular Authors

ÉCOLE NATIONALE SUPERIEURE D'ARTS ET METIERS

  • Contact
  • Mentions légales

ÉCOLE NATIONALE SUPERIEURE D'ARTS ET METIERS

  • Contact
  • Mentions légales