Influence of multimodal instructions on learning tool manipulation skills through mentoring in an immersive environment: Influence des instructions multimodales sur l’apprentissage par compagnonnage des compétences de manipulation d’outil dans un environnement immersif - Université d'Évry Accéder directement au contenu
Communication Dans Un Congrès Année : 2024

Influence of multimodal instructions on learning tool manipulation skills through mentoring in an immersive environment: Influence des instructions multimodales sur l’apprentissage par compagnonnage des compétences de manipulation d’outil dans un environnement immersif

Résumé

Mentorship allows novices to acquire skills under the guidance of experts who use various communication modalities. However, reproducing this model in immersive simulators remains challenging, particularly in ensuring effective communication between experts and novices. Our study explores the impact of multimodal expertnovice communication to transmit instructions on the amplitude of movements in a tool manipulation task in an immersive environment. The results reveal that combining visual-haptic modalities improves movements precision, speed, and quality. Additionally, the verbal-visual-haptic combination enhances the sense of presence, co-presence, and learning experience. These results suggest that the visual-haptic combination is optimal for improving novice performance, and integrating the verbal modality enhances the user experience. These findings open new perspectives for improving the acquisition of technical skills through VR mentorship using multimodal communication.
Fichier non déposé

Dates et versions

hal-04606095 , version 1 (09-06-2024)

Identifiants

Citer

Cassandre Simon, Manel Boukli Hacene, Flavien Lebrun, Samir Otmane, Amine Chellali. Influence of multimodal instructions on learning tool manipulation skills through mentoring in an immersive environment: Influence des instructions multimodales sur l’apprentissage par compagnonnage des compétences de manipulation d’outil dans un environnement immersif. 35th International Francophone Conference on Human-Computer Interaction (IHM 2024), Mar 2024, Paris, France. pp.1-13, ⟨10.1145/3649792.3649793⟩. ⟨hal-04606095⟩
51 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More