2 |
Improving Word Translation via Two-Stage Contrastive Learning ...
|
|
|
|
Abstract:
Word translation or bilingual lexicon induction (BLI) is a key cross-lingual task, aiming to bridge the lexical gap between different languages. In this work, we propose a robust and effective two-stage contrastive learning framework for the BLI task. At Stage C1, we propose to refine standard cross-lingual linear maps between static word embeddings (WEs) via a contrastive learning objective; we also show how to integrate it into the self-learning procedure for even more refined cross-lingual maps. In Stage C2, we conduct BLI-oriented contrastive fine-tuning of mBERT, unlocking its word translation capability. We also show that static WEs induced from the `C2-tuned' mBERT complement static WEs from Stage C1. Comprehensive experiments on standard BLI datasets for diverse languages and different experimental setups demonstrate substantial gains achieved by our framework. While the BLI method from Stage C1 already yields substantial gains over all state-of-the-art BLI methods in our comparison, even stronger ... : ACL 2022 Main ...
|
|
Keyword:
Artificial Intelligence cs.AI; Computation and Language cs.CL; FOS Computer and information sciences; Information Retrieval cs.IR; Machine Learning cs.LG
|
|
URL: https://arxiv.org/abs/2203.08307 https://dx.doi.org/10.48550/arxiv.2203.08307
|
|
BASE
|
|
Hide details
|
|
4 |
The MultimorbiditY COllaborative Medication Review And DEcision Making (MyComrade) study: a protocol for a cross-border pilot cluster randomised controlled trial
|
|
|
|
In: Pilot Feasibility Stud (2022)
|
|
BASE
|
|
Show details
|
|
5 |
"Non-linguistic" Browning : meter and music in "Pietro of Abano"
|
|
|
|
BASE
|
|
Show details
|
|
6 |
“Non-linguistic” Browning: Meter and music in “Pietro of Abano”
|
|
|
|
In: Proceedings of the Linguistic Society of America; Vol 7, No 1 (2022): Proceedings of the Linguistic Society of America; 5240 ; 2473-8689 (2022)
|
|
BASE
|
|
Show details
|
|
7 |
Observation of new excited ${B} ^0_{s} $ states
|
|
|
|
In: Eur.Phys.J.C ; https://hal.archives-ouvertes.fr/hal-03010999 ; Eur.Phys.J.C, 2021, 81 (7), pp.601. ⟨10.1140/epjc/s10052-021-09305-3⟩ (2021)
|
|
BASE
|
|
Show details
|
|
8 |
Infective Endocarditis in Patients on Chronic Hemodialysis
|
|
|
|
In: ISSN: 0735-1097 ; Journal of the American College of Cardiology ; https://hal.archives-ouvertes.fr/hal-03369871 ; Journal of the American College of Cardiology, Elsevier, 2021, 77 (13), pp.1629-1640. ⟨10.1016/j.jacc.2021.02.014⟩ (2021)
|
|
BASE
|
|
Show details
|
|
9 |
Plan-then-Generate: Controlled Data-to-Text Generation via Planning ...
|
|
|
|
BASE
|
|
Show details
|
|
10 |
Plan-then-Generate: Controlled Data-to-Text Generation via Planning ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
Prix-LM: Pretraining for Multilingual Knowledge Base Construction ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Learning Domain-Specialised Representations for Cross-Lingual Biomedical Entity Linking ...
|
|
|
|
BASE
|
|
Show details
|
|
13 |
MirrorWiC: On Eliciting Word-in-Context Representations from Pretrained Language Models ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
Language and ethnobiological skills decline precipitously in Papua New Guinea, the world's most linguistically diverse nation
|
|
|
|
BASE
|
|
Show details
|
|
15 |
MirrorWiC: On Eliciting Word-in-Context Representations from Pretrained Language Models ...
|
|
|
|
BASE
|
|
Show details
|
|
16 |
Visually Grounded Reasoning across Languages and Cultures ...
|
|
|
|
BASE
|
|
Show details
|
|
17 |
Learning Domain-Specialised Representations for Cross-Lingual Biomedical Entity Linking ...
|
|
|
|
BASE
|
|
Show details
|
|
18 |
MirrorWiC: On Eliciting Word-in-Context Representations from Pretrained Language Models ...
|
|
|
|
BASE
|
|
Show details
|
|
19 |
Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders ...
|
|
|
|
BASE
|
|
Show details
|
|
20 |
Visually Grounded Reasoning across Languages and Cultures ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|