| 1 |
Decomposing spontaneous sign language into elementary movements: A principal component analysis-based approach
|
|
|
|
In: ISSN: 1932-6203 ; EISSN: 1932-6203 ; PLoS ONE ; https://hal.archives-ouvertes.fr/hal-03411455 ; PLoS ONE, Public Library of Science, 2021, 16 (10), pp.e0259464. ⟨10.1371/journal.pone.0259464⟩ (2021)
|
|
Abstract:
International audience ; Sign Language (SL) is a continuous and complex stream of multiple body movement features. That raises the challenging issue of providing efficient computational models for the description and analysis of these movements. In the present paper, we used Principal Component Analysis (PCA) to decompose SL motion into elementary movements called principal movements (PMs). PCA was applied to the upper-body motion capture data of six different signers freely producing discourses in French Sign Language. Common PMs were extracted from the whole dataset containing all signers, while individual PMs were extracted separately from the data of individual signers. This study provides three main findings: (1) although the data were not synchronized in time across signers and discourses, the first eight common PMs contained 94.6% of the variance of the movements; (2) the number of PMs that represented 94.6% of the variance was nearly the same for individual as for common PMs; (3) the PM subspaces were highly similar across signers. These results suggest that upper-body motion in unconstrained continuous SL discourses can be described through the dynamic combination of a reduced number of elementary movements. This opens up promising perspectives toward providing efficient automatic SL processing tools based on heavy mocap datasets, in particular for automatic recognition and generation.
|
|
Keyword:
[INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing
|
|
URL: https://hal.archives-ouvertes.fr/hal-03411455/document
https://hal.archives-ouvertes.fr/hal-03411455/file/journal.pone.0259464.pdf
https://hal.archives-ouvertes.fr/hal-03411455
https://doi.org/10.1371/journal.pone.0259464
|
|
BASE
|
|
Hide details
|
|
|
| 2 |
How Fast Is Sign Language? A Reevaluation of the Kinematic Bandwidth Using Motion Capture
|
|
|
|
In: 29th European Signal Processing Conference (EUSIPCO 2021) ; https://hal.archives-ouvertes.fr/hal-03351256 ; 29th European Signal Processing Conference (EUSIPCO 2021), 2021, Online streaming, France (2021)
|
|
BASE
|
|
Show details
|
|
|
| 3 |
Quelles informations visuelles sont essentielles à la compréhension de la langue des signes ?
|
|
|
|
In: Journée FéDeV 2016 ; https://hal.archives-ouvertes.fr/hal-03425438 ; Journée FéDeV 2016, 2016, Evry, France (2016)
|
|
BASE
|
|
Show details
|
|
|
|
|
