Influence of multimodal instructions on learning tool manipulation skills through mentoring in an immersive environment: Influence des instructions multimodales sur l’apprentissage par compagnonnage des compétences de manipulation d’outil dans un environnement immersif
Résumé
Mentorship allows novices to acquire skills under the guidance of experts who use various communication modalities. However, reproducing this model in immersive simulators remains challenging, particularly in ensuring effective communication between experts and novices. Our study explores the impact of multimodal expertnovice communication to transmit instructions on the amplitude of movements in a tool manipulation task in an immersive environment. The results reveal that combining visual-haptic modalities improves movements precision, speed, and quality. Additionally, the verbal-visual-haptic combination enhances the sense of presence, co-presence, and learning experience. These results suggest that the visual-haptic combination is optimal for improving novice performance, and integrating the verbal modality enhances the user experience. These findings open new perspectives for improving the acquisition of technical skills through VR mentorship using multimodal communication.