1 |
The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
Larger-Scale Transformers for Multilingual Masked Language Modeling ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
Adapting High-resource NMT Models to Translate Low-resource Related Languages without Parallel Data ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Multilingual Translation with Extensible Multilingual Pretraining and Finetuning ...
|
|
|
|
Abstract:
Recent work demonstrates the potential of multilingual pretraining of creating one model that can be used for various tasks in different languages. Previous work in multilingual pretraining has demonstrated that machine translation systems can be created by finetuning on bitext. In this work, we show that multilingual translation models can be created through multilingual finetuning. Instead of finetuning on one direction, a pretrained model is finetuned on many directions at the same time. Compared to multilingual models trained from scratch, starting from pretrained models incorporates the benefits of large quantities of unlabeled monolingual data, which is particularly important for low resource languages where bitext is not available. We demonstrate that pretrained models can be extended to incorporate additional languages without loss of performance. We double the number of languages in mBART to support multilingual machine translation models of 50 languages. Finally, we create the ML50 benchmark, ... : 10 pages (main) + 5 pages (appendices). 9 tables and 2 figures ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://arxiv.org/abs/2008.00401 https://dx.doi.org/10.48550/arxiv.2008.00401
|
|
BASE
|
|
Hide details
|
|
9 |
Multilingual Denoising Pre-training for Neural Machine Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
10 |
Beyond English-Centric Multilingual Machine Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
Unsupervised Cross-lingual Representation Learning at Scale ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
The Social Dynamics of Language Change in Online Networks ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|