DE eng

Search in the Catalogues and Directories

Hits 1 – 6 of 6

1
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
In: Proceedings of the 1st Workshop on Natural Language Generation, Evaluation, and Metrics (GEM 2021) ; https://hal.archives-ouvertes.fr/hal-03466171 ; Proceedings of the 1st Workshop on Natural Language Generation, Evaluation, and Metrics (GEM 2021), Aug 2021, Online, France. pp.96-120, ⟨10.18653/v1/2021.gem-1.10⟩ (2021)
BASE
Show details
2
Learning Compact Metrics for MT ...
BASE
Show details
3
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics ...
BASE
Show details
4
Learning Compact Metrics for MT ...
Abstract: Anthology paper link: https://aclanthology.org/2021.emnlp-main.58/ Abstract: Recent developments in machine translation and multilingual text generation have led researchers to adopt trained metrics such as COMET or BLEURT, which treat evaluation as a regression problem and use representations from multilingual pre trained models such as XLM-RoBERTa or mBERT. Yet studies on related tasks suggest that these models are most efficient when they are large, which is costly and impractical for evaluation. We investigate the trade-off between multilinguality and model capacity with RemBERT, a stateof-the-art multilingual language model, using data from the WMT Metrics Shared Task. We present a series of experiments which show that model size is indeed a bottleneck for crosslingual transfer, then demonstrate how distillation can help addressing this bottleneck, by leveraging synthetic data generation and transferring knowledge from one teacher to multiple students trained on related languages. Our method yields up ...
Keyword: Computational Linguistics; Language Models; Machine Learning; Machine Learning and Data Mining; Machine translation; Natural Language Processing; Text Generation
URL: https://underline.io/lecture/38036-learning-compact-metrics-for-mt
https://dx.doi.org/10.48448/fsd0-fd28
BASE
Hide details
5
Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models ...
BASE
Show details
6
LSTM Networks Can Perform Dynamic Counting
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
6
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern