1 |
Automatic Speech Recognition and Query By Example for Creole Languages Documentation
|
|
|
|
In: Findings of the Association for Computational Linguistics: ACL 2022 ; https://hal.archives-ouvertes.fr/hal-03625303 ; Findings of the Association for Computational Linguistics: ACL 2022, May 2022, Dublin, Ireland (2022)
|
|
BASE
|
|
Show details
|
|
2 |
Deceptive Opinions Detection Using New Proposed Arabic Semantic Features
|
|
|
|
In: ISSN: 1877-0509 ; EISSN: 1877-0509 ; Procedia Computer Science ; https://hal.archives-ouvertes.fr/hal-03299022 ; Procedia Computer Science, Elsevier, 2021, 189, pp.29 - 36. ⟨10.1016/j.procs.2021.05.067⟩ (2021)
|
|
BASE
|
|
Show details
|
|
3 |
LeBenchmark: A Reproducible Framework for Assessing Self-Supervised Representation Learning from Speech
|
|
Evain, Solène; Nguyen, Ha; Le, Hang; Zanon Boito, Marcely; Mdhaffar, Salima; Alisamir, Sina; Tong, Ziyi; Tomashenko, Natalia; Dinarelli, Marco; Parcollet, Titouan; Allauzen, Alexandre; Estève, Yannick; Lecouteux, Benjamin; Portet, François; Rossato, Solange; Ringeval, Fabien; Schwab, Didier; Besacier, Laurent
|
|
In: INTERSPEECH 2021: Conference of the International Speech Communication Association ; https://hal.archives-ouvertes.fr/hal-03317730 ; INTERSPEECH 2021: Conference of the International Speech Communication Association, Aug 2021, Brno, Czech Republic (2021)
|
|
Abstract:
International audience ; Self-Supervised Learning (SSL) using huge unlabeled data has been successfully explored for image and natural language processing. Recent works also investigated SSL from speech. They were notably successful to improve performance on downstream tasks such as automatic speech recognition (ASR). While these works suggest it is possible to reduce dependence on labeled data for building efficient speech systems, their evaluation was mostly made on ASR and using multiple and heterogeneous experimental settings (most of them for English). This questions the objective comparison of SSL approaches and the evaluation of their impact on building speech systems. In this paper, we propose LeBenchmark: a reproducible framework for assessing SSL from speech. It not only includes ASR (high and low resource) tasks but also spoken language understanding, speech translation and emotion recognition. We also focus on speech technologies in a language different than English: French. SSL models of different sizes are trained from carefully sourced and documented datasets. Experiments show that SSL is beneficial for most but not all tasks which confirms the need for exhaustive and reliable benchmarks to evaluate its real impact. LeBenchmark is shared with the scientific community for reproducible research in SSL from speech.
|
|
Keyword:
[INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]; ASR; Automatic Emotion Recognition; Self-Supervised Representation Learning; SLU; Speech Translation
|
|
URL: https://hal.archives-ouvertes.fr/hal-03317730/file/FLOWBERT_IS2021.pdf https://hal.archives-ouvertes.fr/hal-03317730/document https://hal.archives-ouvertes.fr/hal-03317730
|
|
BASE
|
|
Hide details
|
|
4 |
LeBenchmark: A Reproducible Framework for Assessing Self-Supervised Representation Learning from Speech
|
|
|
|
In: INTERSPEECH 2021: ; INTERSPEECH 2021: Conference of the International Speech Communication Association ; https://hal.archives-ouvertes.fr/hal-03317730 ; INTERSPEECH 2021: Conference of the International Speech Communication Association, Aug 2021, Brno, Czech Republic (2021)
|
|
BASE
|
|
Show details
|
|
5 |
LeBenchmark: A Reproducible Framework for Assessing Self-Supervised Representation Learning from Speech
|
|
|
|
In: INTERSPEECH 2021: ; INTERSPEECH 2021: Conference of the International Speech Communication Association ; https://hal.archives-ouvertes.fr/hal-03317730 ; INTERSPEECH 2021: Conference of the International Speech Communication Association, Aug 2021, Brno, Czech Republic (2021)
|
|
BASE
|
|
Show details
|
|
6 |
Lightweight Adapter Tuning for Multilingual Speech Translation
|
|
|
|
In: The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021) ; https://hal.archives-ouvertes.fr/hal-03294912 ; The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021), Aug 2021, Bangkok (Virtual), Thailand (2021)
|
|
BASE
|
|
Show details
|
|
7 |
Visualizing Cross-Lingual Discourse Relations in Multilingual TED Corpora
|
|
|
|
In: Proceedings of the 2nd Workshop on Computational Approaches to Discourse ; CODI 2021: 2nd Workshop on Computational Approaches to Discourse ; https://hal.archives-ouvertes.fr/hal-03642341 ; CODI 2021: 2nd Workshop on Computational Approaches to Discourse, Nov 2021, Punta Cana, Dominican Republic. ⟨10.18653/v1/2021.codi-main.16⟩ (2021)
|
|
BASE
|
|
Show details
|
|
8 |
Do Multilingual Neural Machine Translation Models Contain Language Pair Specific Attention Heads?
|
|
|
|
In: Findings of ACL 2021 ; https://hal.archives-ouvertes.fr/hal-03299010 ; Findings of ACL 2021, Aug 2021, Bangkok (virtual), Thailand (2021)
|
|
BASE
|
|
Show details
|
|
9 |
ON-TRAC' systems for the IWSLT 2021 low-resource speech translation and multilingual speech translation shared tasks
|
|
|
|
In: Proceedings of the 18th International Conference on Spoken Language Translation, ; International Conference on Spoken Language Translation (IWSLT) ; https://hal.archives-ouvertes.fr/hal-03298854 ; International Conference on Spoken Language Translation (IWSLT), Aug 2021, Bangkok (virtual), Thailand. ⟨10.18653/v1/2021.iwslt-1.20⟩ (2021)
|
|
BASE
|
|
Show details
|
|
10 |
Do Multilingual Neural Machine Translation Models Contain Language Pair Specific Attention Heads? ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
Lightweight Adapter Tuning for Multilingual Speech Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Lightweight Adapter Tuning for Multilingual Speech Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
13 |
Do Multilingual Neural Machine Translation Models Contain Language Pair Specific Attention Heads? ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
FlauBERT: Unsupervised Language Model Pre-training for French
|
|
|
|
In: Proceedings of the 12th Language Resources and Evaluation Conference ; LREC ; https://hal.archives-ouvertes.fr/hal-02890258 ; LREC, 2020, Marseille, France (2020)
|
|
BASE
|
|
Show details
|
|
15 |
FlauBERT : Unsupervised Language Model Pre-training for French ; FlauBERT : des modèles de langue contextualisés pré-entraînés pour le français
|
|
|
|
In: Actes de la 6e conférence conjointe Journées d'Études sur la Parole (JEP, 33e édition), Traitement Automatique des Langues Naturelles (TALN, 27e édition), Rencontre des Étudiants Chercheurs en Informatique pour le Traitement Automatique des Langues (RÉCITAL, 22e édition). Volume 2 : Traitement Automatique des Langues Naturelles ; 6e conférence conjointe Journées d'Études sur la Parole (JEP, 33e édition), Traitement Automatique des Langues Naturelles (TALN, 27e édition), Rencontre des Étudiants Chercheurs en Informatique pour le Traitement Automatique des Langues (RÉCITAL, 22e édition). Volume 2 : Traitement Automatique des Langues Naturelles ; https://hal.archives-ouvertes.fr/hal-02784776 ; 6e conférence conjointe Journées d'Études sur la Parole (JEP, 33e édition), Traitement Automatique des Langues Naturelles (TALN, 27e édition), Rencontre des Étudiants Chercheurs en Informatique pour le Traitement Automatique des Langues (RÉCITAL, 22e édition). Volume 2 : Traitement Automatique des Langues Naturelles, Jun 2020, Nancy, France. pp.268-278 (2020)
|
|
BASE
|
|
Show details
|
|
16 |
Dual-decoder Transformer for Joint Automatic Speech Recognition and Multilingual Speech Translation
|
|
|
|
In: COLING 2020 (long paper) ; https://hal.archives-ouvertes.fr/hal-02991564 ; COLING 2020 (long paper), Dec 2020, Virtual, Spain (2020)
|
|
BASE
|
|
Show details
|
|
17 |
Dual-decoder Transformer for Joint Automatic Speech Recognition and Multilingual Speech Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
18 |
Dual-decoder Transformer for Joint Automatic Speech Recognition and Multilingual Speech Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
19 |
Dual-decoder Transformer for Joint Automatic Speech Recognition and Multilingual Speech Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
20 |
Dual-decoder Transformer for Joint Automatic Speech Recognition and Multilingual Speech Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|