DE eng

Search in the Catalogues and Directories

Page: 1 2 3 4 5 6 7...18
Hits 41 – 60 of 360

41
A Graph Auto-encoder Model of Derivational Morphology
Schütze, Hinrich; Pierrehumbert, Janet; Hofmann, Valentin. - : Ludwig-Maximilians-Universität München, 2020
BASE
Show details
42
Relational and Fine-Grained Argument Mining
In: Datenbank-Spektrum (2020)
BASE
Show details
43
Identifying Elements Essential for BERT’s Multilinguality
BASE
Show details
44
SimAlign: High Quality Word Alignments without Parallel Training Data using Static and Contextualized Embeddings
In: Findings of ACL: EMNLP 2020 (2020)
BASE
Show details
45
Monolingual and Multilingual Reduction of Gender Bias in Contextualized Representations
BASE
Show details
46
Increasing Learning Efficiency of Self-Attention Networks through Direct Position Interactions, Learnable Temperature, and Convoluted Attention
BASE
Show details
47
SimAlign: High Quality Word Alignments without Parallel Training Data using Static and Contextualized Embeddings ...
BASE
Show details
48
Identifying Necessary Elements for BERT's Multilinguality ...
Abstract: It has been shown that multilingual BERT (mBERT) yields high quality multilingual representations and enables effective zero-shot transfer. This is surprising given that mBERT does not use any crosslingual signal during training. While recent literature has studied this phenomenon, the reasons for the multilinguality are still somewhat obscure. We aim to identify architectural properties of BERT and linguistic properties of languages that are necessary for BERT to become multilingual. To allow for fast experimentation we propose an efficient setup with small BERT models trained on a mix of synthetic and natural data. Overall, we identify four architectural and two linguistic elements that influence multilinguality. Based on our insights, we experiment with a multilingual pretraining setup that modifies the masking strategy using VecMap, i.e., unsupervised embedding alignment. Experiments on XNLI with three languages indicate that our findings transfer from our small setup to larger scale settings. ... : EMNLP2020 CRV ...
Keyword: Computation and Language cs.CL; FOS Computer and information sciences
URL: https://dx.doi.org/10.48550/arxiv.2005.00396
https://arxiv.org/abs/2005.00396
BASE
Hide details
49
Identifying Elements Essential for BERT’s Multilinguality ...
Dufter, Philipp; Schütze, Hinrich. - : Universitätsbibliothek der Ludwig-Maximilians-Universität München, 2020
BASE
Show details
50
Identifying Necessary Elements for BERT’s Multilinguality ...
Dufter, Philipp; Schütze, Hinrich. - : Universitätsbibliothek der Ludwig-Maximilians-Universität München, 2020
BASE
Show details
51
Monolingual and Multilingual Reduction of Gender Bias in Contextualized Representations ...
Liang, Sheng; Dufter, Philipp; Schütze, Hinrich. - : Universitätsbibliothek der Ludwig-Maximilians-Universität München, 2020
BASE
Show details
52
SimAlign: High Quality Word Alignments without Parallel Training Data using Static and Contextualized Embeddings ...
Sabet, Masoud Jalili; Dufter, Philipp; Schütze, Hinrich. - : Universitätsbibliothek der Ludwig-Maximilians-Universität München, 2020
BASE
Show details
53
Dynamic Contextualized Word Embeddings ...
BASE
Show details
54
Predicting the Growth of Morphological Families from Social and Linguistic Factors ...
Hofmann, Valentin; Pierrehumbert, Janet; Schütze, Hinrich. - : Association for Computational Linguistics, 2020
BASE
Show details
55
Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot Fly ...
Kassner, Nora; Schütze, Hinrich. - : Association for Computational Linguistics, 2020
BASE
Show details
56
Quantifying the Contextualization of Word Representations with Semantic Class Probing ...
Zhao, Mengjie; Dufter, Philipp; Yaghoobzadeh, Yadollah. - : Association for Computational Linguistics, 2020
BASE
Show details
57
Sentence Meta-Embeddings for Unsupervised Semantic Textual Similarity ...
Poerner, Nina; Waltinger, Ulli; Schütze, Hinrich. - : Association for Computational Linguistics, 2020
BASE
Show details
58
Monolingual and Multilingual Reduction of Gender Bias in Contextualized Representations ...
BASE
Show details
59
A Closer Look at Few-Shot Crosslingual Transfer: The Choice of Shots Matters ...
BASE
Show details
60
Unsupervised Embedding-based Detection of Lexical Semantic Changes ...
BASE
Show details

Page: 1 2 3 4 5 6 7...18

Catalogues
19
21
23
0
25
1
6
Bibliographies
55
2
3
2
1
0
0
0
9
Linked Open Data catalogues
0
Online resources
1
0
0
0
Open access documents
218
0
1
2
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern