1 |
Multilingual Language Model Adaptive Fine-Tuning: A Study on African Languages ...
|
|
|
|
BASE
|
|
Show details
|
|
2 |
Pre-Trained Multilingual Sequence-to-Sequence Models: A Hope for Low-Resource Language Translation? ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
MasakhaNER: Named entity recognition for African languages
|
|
|
|
In: EISSN: 2307-387X ; Transactions of the Association for Computational Linguistics ; https://hal.inria.fr/hal-03350962 ; Transactions of the Association for Computational Linguistics, The MIT Press, 2021, ⟨10.1162/tacl⟩ (2021)
|
|
BASE
|
|
Show details
|
|
5 |
The effect of domain and diacritics in Yorùbá-English neural machine translation
|
|
|
|
In: 18th Biennial Machine Translation Summit ; https://hal.inria.fr/hal-03350967 ; 18th Biennial Machine Translation Summit, Aug 2021, Orlando, United States (2021)
|
|
BASE
|
|
Show details
|
|
6 |
Preventing author profiling through zero-shot multilingual back-translation
|
|
|
|
In: 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP) ; https://hal.inria.fr/hal-03350906 ; 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), Nov 2021, Punta Cana, Dominica (2021)
|
|
BASE
|
|
Show details
|
|
7 |
On the effect of normalization layers on Differentially Private training of deep Neural networks
|
|
|
|
In: https://hal.inria.fr/hal-03475600 ; 2021 (2021)
|
|
BASE
|
|
Show details
|
|
8 |
The Effect of Domain and Diacritics in Yorùbá-English Neural Machine Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
Preventing Author Profiling through Zero-Shot Multilingual Back-Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
10 |
MasakhaNER: Named Entity Recognition for African Languages ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
Preventing Author Profiling through Zero-Shot Multilingual Back-Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Transfer learning and distant supervision for multilingual Transformer models: A study on African languages
|
|
|
|
In: 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) ; https://hal.inria.fr/hal-03350901 ; 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Nov 2020, Punta Cana, Dominica (2020)
|
|
BASE
|
|
Show details
|
|
13 |
Distant supervision and noisy label learning for low resource named entity recognition: A study on Hausa and Yorùbá
|
|
|
|
In: ICLR Workshops (AfricaNLP & PML4DC 2020) ; https://hal.archives-ouvertes.fr/hal-03359111 ; ICLR Workshops (AfricaNLP & PML4DC 2020), Apr 2020, Addis Ababa, Ethiopia (2020)
|
|
BASE
|
|
Show details
|
|
14 |
Transfer Learning and Distant Supervision for Multilingual Transformer Models: A Study on African Languages ...
|
|
|
|
Abstract:
Multilingual transformer models like mBERT and XLM-RoBERTa have obtained great improvements for many NLP tasks on a variety of languages. However, recent works also showed that results from high-resource languages could not be easily transferred to realistic, low-resource scenarios. In this work, we study trends in performance for different amounts of available resources for the three African languages Hausa, isiXhosa and Yorùbá on both NER and topic classification. We show that in combination with transfer learning or distant supervision, these models can achieve with as little as 10 or 100 labeled sentences the same performance as baselines with much more supervised training data. However, we also find settings where this does not hold. Our discussions and additional experiments on assumptions such as time and hardware restrictions highlight challenges and opportunities in low-resource learning. ... : Accepted at EMNLP'20 ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences; Machine Learning cs.LG
|
|
URL: https://arxiv.org/abs/2010.03179 https://dx.doi.org/10.48550/arxiv.2010.03179
|
|
BASE
|
|
Hide details
|
|
16 |
Massive vs. Curated Word Embeddings for Low-Resourced Languages. The Case of Yorùbá and Twi ...
|
|
|
|
BASE
|
|
Show details
|
|
17 |
Demographic Inference and Representative Population Estimates from Multilingual Social Media Data ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|