Autonomous gesture recognition using multi-layer LSTM networks and laban movement analysis - Université d'Évry Access content directly
Journal Articles International Journal of Knowledge-Based and Intelligent Engineering Systems Year : 2023

Autonomous gesture recognition using multi-layer LSTM networks and laban movement analysis

Abstract

In recent years, due to the reasonable price of RGB-D devices, the use of skeletal-based data in the field of human-computer interaction has attracted a lot of attention. Being free from problems such as complex backgrounds as well as changes in light is another reason for the popularity of this type of data. In the existing methods, the use of joint and bone information has had significant results in improving the recognition of human movements and even emotions. However, how to combine these two types of information in the best possible way to define the relationship between joints and bones is a problem that has not yet been solved. In this article, we used the Laban Movement Analysis (LMA) to build a robust descriptor and present a precise description of the connection of the different parts of the body to itself and its surrounding environment while performing a gesture. To do this, in addition to the distances between the hip center and other joints of the body and the changes of the quaternion angles in time, we define the triangles formed by the different parts of the body and calculate their area. We also calculate the area of the single conforming 3-D boundary around all the joints of the body. We use a long short-term memory (LSTM) network to evaluate this descriptor. The proposed algorithm is implemented on five public datasets: NTU RGB+D 120, SYSU 3D HOI, FLORENCE 3D ACTIONS, MSR Action3D and UTKinect-Action3D datasets, and the results are compared with those available in the literature.
Fichier principal
Vignette du fichier
KES2023_ZR_MM_FD-Autonomous_Gesture_Recognition_using_Multilayer_LSTM_Networks_and_Laban_Movement_Analysis.pdf (1.52 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04049134 , version 1 (31-03-2023)

Identifiers

Cite

Zahra Ramezanpanah, Malik Mallem, Frédéric Davesne. Autonomous gesture recognition using multi-layer LSTM networks and laban movement analysis. International Journal of Knowledge-Based and Intelligent Engineering Systems, 2023, 26 (4), pp.289--297. ⟨10.3233/KES-208195⟩. ⟨hal-04049134⟩
44 View
11 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More