1 |
Automatic Annotation and Segmentation of Sign Language Videos: Base-level Features and Lexical Signs Classification
|
|
|
|
In: 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) ; https://hal.archives-ouvertes.fr/hal-03375858 ; 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021), Feb 2021, Online streaming, France. pp.484-491, ⟨10.5220/0010247104840491⟩ (2021)
|
|
Abstract:
International audience ; The automatic recognition of Sign Languages is the main focus of most of the works in the field, which explains the progressing demand on the annotated data to train the dedicated models. In this paper, we present a semi automatic annotation system for Sign Languages. Such automation will not only help to create training data but it will reduce as well the processing time and the subjectivity of manual annotations done by linguists in order to study the sign language. The system analyses hand shapes, hands speed variations, and face landmarks to annotate base level features and to separate the different signs. In a second stage, signs are classified into two types, whether they are lexical (i.e. present in a dictionary) or iconic (illustrative), using a probabilistic model. The results show that our system is partially capable of annotating automatically the video sequence with a F1 score = 0.68 for lexical sign annotation and an error of 3.8 frames for sign segmentation. An expert validation of the annotations is still needed.
|
|
Keyword:
[INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]; [INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV]; Annotations; Lexical Signs; LSF Videos; Sign Segmentation
|
|
URL: https://hal.archives-ouvertes.fr/hal-03375858/file/102471.pdf https://hal.archives-ouvertes.fr/hal-03375858 https://hal.archives-ouvertes.fr/hal-03375858/document https://doi.org/10.5220/0010247104840491
|
|
BASE
|
|
Hide details
|
|
2 |
Machine Translation ; Machine Translation: Special Issue: Sign Language Translation and Avatar Technology
|
|
|
|
In: https://hal.archives-ouvertes.fr/hal-03375911 ; 35 (3), Springer, 2021, Special Issue: Sign Language Translation and Avatar Technology (2021)
|
|
BASE
|
|
Show details
|
|
3 |
Dicta-Sign–LSF–v2 : étendre le traitement automatique des langues des signes grâce à un corpus de dialogue en Langue des Signes
|
|
|
|
In: Minority languages spoken or signed and inclusive spaces ; https://hal.archives-ouvertes.fr/hal-03450108 ; Minority languages spoken or signed and inclusive spaces, 2021, Asynchronous online event, France (2021)
|
|
BASE
|
|
Show details
|
|
4 |
Automatic Segmentation of Sign Language into Subtitle-Units
|
|
|
|
In: Computer Vision – ECCV 2020 Workshops ; Sign Language Recognition, Translation & Production workshop ; https://hal.archives-ouvertes.fr/hal-03098684 ; Sign Language Recognition, Translation & Production workshop, Aug 2020, Glasgow ( virtual ), United Kingdom. ⟨10.1007/978-3-030-66096-3_14⟩ (2020)
|
|
BASE
|
|
Show details
|
|
5 |
Automatic recognition of Sign Language structures in RGB videos: the detection of pointing and lexical signs
|
|
|
|
In: https://hal.archives-ouvertes.fr/hal-02146368 ; 2019 (2019)
|
|
BASE
|
|
Show details
|
|
6 |
Optimization of a gesture representation network for Sign Language analysis
|
|
|
|
In: https://hal.archives-ouvertes.fr/hal-02146369 ; 2019 (2019)
|
|
BASE
|
|
Show details
|
|
7 |
Interaction gestuelle : de la capture à la production
|
|
|
|
In: 1ère Ecole de printemps sur les IHM et la RVA (IVAR 2017) ; https://hal.archives-ouvertes.fr/hal-03425273 ; 1ère Ecole de printemps sur les IHM et la RVA (IVAR 2017), Apr 2017, Alger, France (2017)
|
|
BASE
|
|
Show details
|
|
8 |
Traitement automatique des Langues des Signes, Applications potentielles dans le cadre des TICE
|
|
|
|
In: Les outils techniques et numériques au service de l’enseignement spécialisé - Colloque INJS/INSHEA ; https://hal.archives-ouvertes.fr/hal-03425443 ; Les outils techniques et numériques au service de l’enseignement spécialisé - Colloque INJS/INSHEA, 2016, Paris, France (2016)
|
|
BASE
|
|
Show details
|
|
9 |
La Langue des Signes Française (LSF) - modélisations, ressources et applications
|
|
|
|
In: https://hal.archives-ouvertes.fr/hal-03375980 ; ISTE éditions, 2016, 9781784050504 (2016)
|
|
BASE
|
|
Show details
|
|
10 |
Traitement Automatique des Langues des Signes - État des lieux et projets en cours
|
|
|
|
In: Colloque « innovation et handicap » de la Fédération Française des Télécoms ; https://hal.archives-ouvertes.fr/hal-03425470 ; Colloque « innovation et handicap » de la Fédération Française des Télécoms, 2016, Paris, France (2016)
|
|
BASE
|
|
Show details
|
|
11 |
Quelles informations visuelles sont essentielles à la compréhension de la langue des signes ?
|
|
|
|
In: Journée FéDeV 2016 ; https://hal.archives-ouvertes.fr/hal-03425438 ; Journée FéDeV 2016, 2016, Evry, France (2016)
|
|
BASE
|
|
Show details
|
|
12 |
AVATAR : La LSF tout en numérique
|
|
|
|
In: Conférence visuel-LSF « La Langue des Signes Française, point central de notre positionnement qualité », ; https://hal.archives-ouvertes.fr/hal-03425468 ; Conférence visuel-LSF « La Langue des Signes Française, point central de notre positionnement qualité »,, 2016, Paris, France (2016)
|
|
BASE
|
|
Show details
|
|
13 |
Sign Language technologies and resources of the Dicta-Sign project
|
|
|
|
In: Workshop Proceedings 5th Workshop on the Representation and Processing of Sign Languages: Interactions between Corpus and Lexicon ; 5th Workshop on the Representation and Processing of Sign Languages: Interactions between Corpus and Lexicon. Satellite Workshop to the eighth International Conference on Language Resources and Evaluation (LREC-2012) ; https://hal.archives-ouvertes.fr/hal-03404004 ; 5th Workshop on the Representation and Processing of Sign Languages: Interactions between Corpus and Lexicon. Satellite Workshop to the eighth International Conference on Language Resources and Evaluation (LREC-2012), May 2012, Istanbul, Turkey (2012)
|
|
BASE
|
|
Show details
|
|
14 |
Accessibilité du cyberespace: langues des signes
|
|
|
|
In: NET.LANG - Réussir le cyberespace multilingue ; https://hal.archives-ouvertes.fr/hal-03376015 ; NET.LANG - Réussir le cyberespace multilingue, C&F éditions, 2012, 978-2-915825-08-4 (2012)
|
|
BASE
|
|
Show details
|
|
15 |
Accessibility in cyberspace: Sign Languages
|
|
|
|
In: NET.LANG - Toward the multilingual cyberspace ; https://hal.archives-ouvertes.fr/hal-03376025 ; Laurent Vannini; Hervé Le Crosnier. NET.LANG - Toward the multilingual cyberspace, C&F éditions, Caen, 2012, 978-2-915825-09-1 (2012)
|
|
BASE
|
|
Show details
|
|
16 |
Annotation for Sign Language Processing
|
|
|
|
In: Sign Language Corpora Network, 3rd workshop on annotation ; https://hal.archives-ouvertes.fr/hal-03424240 ; Sign Language Corpora Network, 3rd workshop on annotation, Jun 2010, Stockholm, Sweden (2010)
|
|
BASE
|
|
Show details
|
|
17 |
Dicta-Sign - Use of a Multilingual Corpus to Improve Sign Language Technology
|
|
|
|
In: 4th Workshop of the Sign Language Corpus Network: Exploitation (SLCN 4 2010) ; https://hal.archives-ouvertes.fr/hal-03419837 ; 4th Workshop of the Sign Language Corpus Network: Exploitation (SLCN 4 2010), Dec 2010, Berlin, Germany ; https://www.ru.nl/cls/our-research/research-groups/sign-language-linguistics/completed-projects/completed-projects/sign-linguistics-corpora-network/ (2010)
|
|
BASE
|
|
Show details
|
|
18 |
Sign Language Recognition, Generation, and Modelling: A Research Effort with Applications in Deaf Communication
|
|
|
|
In: Universal Access in Human-Computer Interaction. Addressing Diversity ; https://hal.archives-ouvertes.fr/hal-03404091 ; Universal Access in Human-Computer Interaction. Addressing Diversity, Jul 2009, San Diego, United States. ⟨10.1007/978-3-642-02707-9_3⟩ (2009)
|
|
BASE
|
|
Show details
|
|
19 |
LSF resources (French Sign Language)
|
|
|
|
In: Sign Language Corpora Network, 1st workshop on annotation ; https://hal.archives-ouvertes.fr/hal-03424244 ; Sign Language Corpora Network, 1st workshop on annotation, Jul 2009, London, United Kingdom (2009)
|
|
BASE
|
|
Show details
|
|
20 |
A web-based framework for interactive deictic and sign language agents
|
|
|
|
In: 3ème Workshop sur les Agents Conversationnels Animés (WACA 2008) ; https://hal.archives-ouvertes.fr/hal-03425414 ; 3ème Workshop sur les Agents Conversationnels Animés (WACA 2008), Nov 2008, Paris, France (2008)
|
|
BASE
|
|
Show details
|
|
|
|