| 1 |
Automatic Annotation and Segmentation of Sign Language Videos: Base-level Features and Lexical Signs Classification
|
|
|
|
In: 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) ; https://hal.archives-ouvertes.fr/hal-03375858 ; 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021), Feb 2021, Online streaming, France. pp.484-491, ⟨10.5220/0010247104840491⟩ (2021)
|
|
Abstract:
International audience ; The automatic recognition of Sign Languages is the main focus of most of the works in the field, which explains the progressing demand on the annotated data to train the dedicated models. In this paper, we present a semi automatic annotation system for Sign Languages. Such automation will not only help to create training data but it will reduce as well the processing time and the subjectivity of manual annotations done by linguists in order to study the sign language. The system analyses hand shapes, hands speed variations, and face landmarks to annotate base level features and to separate the different signs. In a second stage, signs are classified into two types, whether they are lexical (i.e. present in a dictionary) or iconic (illustrative), using a probabilistic model. The results show that our system is partially capable of annotating automatically the video sequence with a F1 score = 0.68 for lexical sign annotation and an error of 3.8 frames for sign segmentation. An expert validation of the annotations is still needed.
|
|
Keyword:
[INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]; [INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV]; Annotations; Lexical Signs; LSF Videos; Sign Segmentation
|
|
URL: https://hal.archives-ouvertes.fr/hal-03375858/file/102471.pdf
https://hal.archives-ouvertes.fr/hal-03375858
https://hal.archives-ouvertes.fr/hal-03375858/document
https://doi.org/10.5220/0010247104840491
|
|
BASE
|
|
Hide details
|
|
|
| 2 |
Machine Translation ; Machine Translation: Special Issue: Sign Language Translation and Avatar Technology
|
|
|
|
In: https://hal.archives-ouvertes.fr/hal-03375911 ; 35 (3), Springer, 2021, Special Issue: Sign Language Translation and Avatar Technology (2021)
|
|
BASE
|
|
Show details
|
|
|
| 3 |
The myth of signing avatars
|
|
|
|
In: Proceedings of the 18th Biennial Machine Translation Summit ; 1st International Workshop on Automatic Translation for Signed and Spoken Languages ; https://hal.archives-ouvertes.fr/hal-03375968 ; 1st International Workshop on Automatic Translation for Signed and Spoken Languages, Aug 2021, Online streaming, France (2021)
|
|
BASE
|
|
Show details
|
|
|
| 4 |
Dicta-Sign–LSF–v2 : étendre le traitement automatique des langues des signes grâce à un corpus de dialogue en Langue des Signes
|
|
|
|
In: Minority languages spoken or signed and inclusive spaces ; https://hal.archives-ouvertes.fr/hal-03450108 ; Minority languages spoken or signed and inclusive spaces, 2021, Asynchronous online event, France (2021)
|
|
BASE
|
|
Show details
|
|
|
| 5 |
Interaction gestuelle : de la capture à la production
|
|
|
|
In: 1ère Ecole de printemps sur les IHM et la RVA (IVAR 2017) ; https://hal.archives-ouvertes.fr/hal-03425273 ; 1ère Ecole de printemps sur les IHM et la RVA (IVAR 2017), Apr 2017, Alger, France (2017)
|
|
BASE
|
|
Show details
|
|
|
| 6 |
Traitement automatique des Langues des Signes, Applications potentielles dans le cadre des TICE
|
|
|
|
In: Les outils techniques et numériques au service de l’enseignement spécialisé - Colloque INJS/INSHEA ; https://hal.archives-ouvertes.fr/hal-03425443 ; Les outils techniques et numériques au service de l’enseignement spécialisé - Colloque INJS/INSHEA, 2016, Paris, France (2016)
|
|
BASE
|
|
Show details
|
|
|
| 7 |
La Langue des Signes Française (LSF) - modélisations, ressources et applications
|
|
|
|
In: https://hal.archives-ouvertes.fr/hal-03375980 ; ISTE éditions, 2016, 9781784050504 (2016)
|
|
BASE
|
|
Show details
|
|
|
| 8 |
Traitement Automatique des Langues des Signes - État des lieux et projets en cours
|
|
|
|
In: Colloque « innovation et handicap » de la Fédération Française des Télécoms ; https://hal.archives-ouvertes.fr/hal-03425470 ; Colloque « innovation et handicap » de la Fédération Française des Télécoms, 2016, Paris, France (2016)
|
|
BASE
|
|
Show details
|
|
|
| 9 |
Quelles informations visuelles sont essentielles à la compréhension de la langue des signes ?
|
|
|
|
In: Journée FéDeV 2016 ; https://hal.archives-ouvertes.fr/hal-03425438 ; Journée FéDeV 2016, 2016, Evry, France (2016)
|
|
BASE
|
|
Show details
|
|
|
| 10 |
AVATAR : La LSF tout en numérique
|
|
|
|
In: Conférence visuel-LSF « La Langue des Signes Française, point central de notre positionnement qualité », ; https://hal.archives-ouvertes.fr/hal-03425468 ; Conférence visuel-LSF « La Langue des Signes Française, point central de notre positionnement qualité »,, 2016, Paris, France (2016)
|
|
BASE
|
|
Show details
|
|
|
| 11 |
Sign Language technologies and resources of the Dicta-Sign project
|
|
|
|
In: Workshop Proceedings 5th Workshop on the Representation and Processing of Sign Languages: Interactions between Corpus and Lexicon ; 5th Workshop on the Representation and Processing of Sign Languages: Interactions between Corpus and Lexicon. Satellite Workshop to the eighth International Conference on Language Resources and Evaluation (LREC-2012) ; https://hal.archives-ouvertes.fr/hal-03404004 ; 5th Workshop on the Representation and Processing of Sign Languages: Interactions between Corpus and Lexicon. Satellite Workshop to the eighth International Conference on Language Resources and Evaluation (LREC-2012), May 2012, Istanbul, Turkey (2012)
|
|
BASE
|
|
Show details
|
|
|
| 12 |
Annotation for Sign Language Processing
|
|
|
|
In: Sign Language Corpora Network, 3rd workshop on annotation ; https://hal.archives-ouvertes.fr/hal-03424240 ; Sign Language Corpora Network, 3rd workshop on annotation, Jun 2010, Stockholm, Sweden (2010)
|
|
BASE
|
|
Show details
|
|
|
| 13 |
LSF resources (French Sign Language)
|
|
|
|
In: Sign Language Corpora Network, 1st workshop on annotation ; https://hal.archives-ouvertes.fr/hal-03424244 ; Sign Language Corpora Network, 1st workshop on annotation, Jul 2009, London, United Kingdom (2009)
|
|
BASE
|
|
Show details
|
|
|
| 14 |
A web-based framework for interactive deictic and sign language agents
|
|
|
|
In: 3ème Workshop sur les Agents Conversationnels Animés (WACA 2008) ; https://hal.archives-ouvertes.fr/hal-03425414 ; 3ème Workshop sur les Agents Conversationnels Animés (WACA 2008), Nov 2008, Paris, France (2008)
|
|
BASE
|
|
Show details
|
|
|
| 15 |
Sign Language Processing: Modelling of spatio-temporal constraints
|
|
|
|
In: CSLP@Context07: 4th International Workshop on Constraints and Language Processing ; https://hal.archives-ouvertes.fr/hal-03424249 ; CSLP@Context07: 4th International Workshop on Constraints and Language Processing, Aug 2007, Roskilde, Denmark (2007)
|
|
BASE
|
|
Show details
|
|
|
| 16 |
Mise en place d'une méthodologie pour l'annotation des Gestes Non Manuels
|
|
|
|
In: Traitement Automatique des Langues des Signes (TALS 2007), atelier de Traitement Automatique des Langues Naturelles 2007 (TALS 2007) ; https://hal.archives-ouvertes.fr/hal-03425376 ; Traitement Automatique des Langues des Signes (TALS 2007), atelier de Traitement Automatique des Langues Naturelles 2007 (TALS 2007), 2007, Toulouse, France (2007)
|
|
BASE
|
|
Show details
|
|
|
| 17 |
La langue des signes et avatars signants
|
|
|
|
In: Journée de travail du Groupe de Travail sur les Agents Conversationnels Animés (GT ACA) sur le thèse « ACA et Geste » ; https://hal.archives-ouvertes.fr/hal-03425338 ; Journée de travail du Groupe de Travail sur les Agents Conversationnels Animés (GT ACA) sur le thèse « ACA et Geste », 2007, Paris, France (2007)
|
|
BASE
|
|
Show details
|
|
|
| 18 |
Articulatory Analysis of the Manual Parameters of the French Sign Language Conventional Signs
|
|
|
|
In: LREC proceedings ; Workshop on the Representation and Processing of Sign Languages: lexicographic matters and didactic scenarios. International Conference on Language Resources and Evaluation (LREC 2006) ; https://hal.archives-ouvertes.fr/hal-03404117 ; Workshop on the Representation and Processing of Sign Languages: lexicographic matters and didactic scenarios. International Conference on Language Resources and Evaluation (LREC 2006), May 2006, Gênes, Italy (2006)
|
|
BASE
|
|
Show details
|
|
|
| 19 |
Sign Language corpus analysis: Synchronisation of linguistic annotation and numerical data
|
|
|
|
In: Proceedings of LREC 2006 ; International Conference on Language Resources and Evaluation (LREC 2006) ; https://hal.archives-ouvertes.fr/hal-03404143 ; International Conference on Language Resources and Evaluation (LREC 2006), May 2006, Gênes, Italy (2006)
|
|
BASE
|
|
Show details
|
|
|
| 20 |
Spatialised Semantic Relations in French Sign Language: Toward a Computational Modelling
|
|
|
|
In: Gesture in Human-Computer Interaction and Simulation ; Gesture in Human-Computer Interaction ans Simulation ; https://hal.archives-ouvertes.fr/hal-03384043 ; Sylvie Gibet, Nicolas Courty, Jean-François Kamp. Gesture in Human-Computer Interaction ans Simulation, 3881, Springer, pp.37-48, 2006, Lecture Notes in Computer Science / Lecture Notes in Artificial Intelligence, 978-3-540-32625-0. ⟨10.1007/11678816_4⟩ (2006)
|
|
BASE
|
|
Show details
|
|
|
|
|
