DE eng

Search in the Catalogues and Directories

Hits 1 – 1 of 1

1
Automatic Annotation and Segmentation of Sign Language Videos: Base-level Features and Lexical Signs Classification
In: 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) ; https://hal.archives-ouvertes.fr/hal-03375858 ; 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021), Feb 2021, Online streaming, France. pp.484-491, ⟨10.5220/0010247104840491⟩ (2021)
Abstract: International audience ; The automatic recognition of Sign Languages is the main focus of most of the works in the field, which explains the progressing demand on the annotated data to train the dedicated models. In this paper, we present a semi automatic annotation system for Sign Languages. Such automation will not only help to create training data but it will reduce as well the processing time and the subjectivity of manual annotations done by linguists in order to study the sign language. The system analyses hand shapes, hands speed variations, and face landmarks to annotate base level features and to separate the different signs. In a second stage, signs are classified into two types, whether they are lexical (i.e. present in a dictionary) or iconic (illustrative), using a probabilistic model. The results show that our system is partially capable of annotating automatically the video sequence with a F1 score = 0.68 for lexical sign annotation and an error of 3.8 frames for sign segmentation. An expert validation of the annotations is still needed.
Keyword: [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]; [INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV]; Annotations; Lexical Signs; LSF Videos; Sign Segmentation
URL: https://hal.archives-ouvertes.fr/hal-03375858/file/102471.pdf
https://hal.archives-ouvertes.fr/hal-03375858
https://hal.archives-ouvertes.fr/hal-03375858/document
https://doi.org/10.5220/0010247104840491
BASE
Hide details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
1
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern