1 |
NMTScore: A Multilingual Analysis of Translation-based Text Similarity Measures ...
|
|
|
|
Abstract:
Being able to rank the similarity of short text segments is an interesting bonus feature of neural machine translation. Translation-based similarity measures include direct and pivot translation probability, as well as translation cross-likelihood, which has not been studied so far. We analyze these measures in the common framework of multilingual NMT, releasing the NMTScore library (available at https://github.com/ZurichNLP/nmtscore). Compared to baselines such as sentence embeddings, translation-based measures prove competitive in paraphrase identification and are more robust against adversarial or multilingual input, especially if proper normalization is applied. When used for reference-based evaluation of data-to-text generation in 2 tasks and 17 languages, translation-based measures show a relatively high correlation to human judgments. ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://dx.doi.org/10.48550/arxiv.2204.13692 https://arxiv.org/abs/2204.13692
|
|
BASE
|
|
Hide details
|
|
2 |
Improving Zero-shot Cross-lingual Transfer between Closely Related Languages by injecting Character-level Noise ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
Wino-X: Multilingual Winograd Schemas for Commonsense Reasoning and Coreference Resolution ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
Share or Not? Learning to Schedule Language-Specific Capacity for Multilingual Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Edinburgh’s End-to-End Multilingual Speech Translation System for IWSLT 2021 ...
|
|
|
|
BASE
|
|
Show details
|
|
10 |
Understanding the Properties of Minimum Bayes Risk Decoding in Neural Machine Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
Analyzing the Source and Target Contributions to Predictions in Neural Machine Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models ...
|
|
|
|
BASE
|
|
Show details
|
|
13 |
Wino-X: Multilingual Winograd Schemas for Commonsense Reasoning and Coreference Resolution ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
Language Modeling, Lexical Translation, Reordering: The Training Process of NMT through the Lens of Classical SMT ...
|
|
|
|
BASE
|
|
Show details
|
|
15 |
Language Modeling, Lexical Translation, Reordering: The Training Process of NMT through the Lens of Classical SMT ...
|
|
|
|
BASE
|
|
Show details
|
|
16 |
Contrastive Conditioning for Assessing Disambiguation in MT: A Case Study of Distilled Bias ...
|
|
|
|
BASE
|
|
Show details
|
|
17 |
Language Modeling, Lexical Translation, Reordering: The Training Process of NMT through the Lens of Classical SMT ...
|
|
|
|
BASE
|
|
Show details
|
|
20 |
Share or Not? Learning to Schedule Language-Specific Capacity for Multilingual Translation
|
|
|
|
In: Zhang, Biao; Bapna, Ankur; Sennrich, Rico; Firat, Orhan (2021). Share or Not? Learning to Schedule Language-Specific Capacity for Multilingual Translation. In: International Conference on Learning Representations, Virtual, 3 May 2021 - 7 May 2021, ICLR. (2021)
|
|
BASE
|
|
Show details
|
|
|
|