DE eng

Search in the Catalogues and Directories

Hits 1 – 4 of 4

1
It's not Greek to mBERT: Inducing Word-Level Translations from Multilingual BERT ...
Abstract: Recent works have demonstrated that multilingual BERT (mBERT) learns rich cross-lingual representations, that allow for transfer across languages. We study the word-level translation information embedded in mBERT and present two simple methods that expose remarkable translation capabilities with no fine-tuning. The results suggest that most of this information is encoded in a non-linear way, while some of it can also be recovered with purely linear tools. As part of our analysis, we test the hypothesis that mBERT learns representations which contain both a language-encoding component and an abstract, cross-lingual component, and explicitly identify an empirical language-identity subspace within mBERT representations. ... : BlackboxNLP 2020 ...
Keyword: Computation and Language cs.CL; FOS Computer and information sciences
URL: https://dx.doi.org/10.48550/arxiv.2010.08275
https://arxiv.org/abs/2010.08275
BASE
Hide details
2
The Extraordinary Failure of Complement Coercion Crowdsourcing ...
BASE
Show details
3
Amnesic Probing: Behavioral Explanation with Amnesic Counterfactuals ...
BASE
Show details
4
Unsupervised Distillation of Syntactic Information from Contextualized Word Representations ...
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
4
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern