• Refine your search:
  • 
    Keyword
  • 
    Creator / Publisher:
    
    • Glavaš, Goran (5)
    • Lauscher, Anne (5)
    • Vulić, Ivan (5)
    • Korhonen, Anna (2)
    • Ravishankar, Vinit (2)
    • Agirre, Eneko (1)
    • Apidianaki, Marianna (1)
    • Bel, Nuria (1)
    • Cohn, Trevor (1)
    • Gurevych, Iryna (1)
    •   more
  • 
    Year:
    
    • 2020 (5)
  • 
    Medium
  • 
    Type:
    
    • Article (4)
    • Miscellaneous (1)
  • 
    BLLDB-Access

Search in the Catalogues and Directories

All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year Sort by creator [A → Z]' creator [Z → A]' publishing year ↑ (asc)' publishing year ↓ (desc)' title [A → Z]' title [Z → A]' Simple Search Hits 1 – 5 of 5 1 From Zero to Hero: On the Limitations of Zero-Shot Cross-Lingual Transfer with Multilingual Transformers ... Lauscher, Anne; Ravishankar, Vinit; Vulić, Ivan; Glavaš, Goran. - : arXiv, 2020 Abstract: Massively multilingual transformers pretrained with language modeling objectives (e.g., mBERT, XLM-R) have become a de facto default transfer paradigm for zero-shot cross-lingual transfer in NLP, offering unmatched transfer performance. Current downstream evaluations, however, verify their efficacy predominantly in transfer settings involving languages with sufficient amounts of pretraining data, and with lexically and typologically close languages. In this work, we analyze their limitations and show that cross-lingual transfer via massively multilingual transformers, much like transfer via cross-lingual word embeddings, is substantially less effective in resource-lean scenarios and for distant languages. Our experiments, encompassing three lower-level tasks (POS tagging, dependency parsing, NER), as well as two high-level semantic tasks (NLI, QA), empirically correlate transfer performance with linguistic similarity between the source and target languages, but also with the size of pretraining corpora of ... Keyword: Computation and Language cs.CL; FOS Computer and information sciences URL: https://arxiv.org/abs/2005.00633 https://dx.doi.org/10.48550/arxiv.2005.00633 BASE Hide details 2 Specializing Unsupervised Pretraining Models for Word-Level Semantic Similarity ... The 28th International Conference on Computational Linguistics 2020; Glavaš, Goran; Korhonen, Anna. - : Underline Science Inc., 2020 BASE Show details 3 Specializing unsupervised pretraining models for word-level semantic similarity Ponti, Edoardo Maria; Korhonen, Anna; Vulić, Ivan. - : Association for Computational Linguistics, ACL, 2020 BASE Show details 4 Common sense or world knowledge? Investigating adapter-based knowledge injection into pretrained transformers Lauscher, Anne; Majewska, Olga; Ribeiro, Leonardo F. R.. - : Association for Computational Linguistics, 2020 BASE Show details 5 From zero to hero: On the limitations of zero-shot language transfer with multilingual transformers Ravishankar, Vinit; Glavaš, Goran; Lauscher, Anne. - : Association for Computational Linguistics, 2020 BASE Show details

Mobile view All Catalogues UB Frankfurt Linguistik 0 IDS Mannheim 0 OLC Linguistik 0 UB Frankfurt Retrokatalog 0 DNB Subject Category Language 0 Institut für Empirische Sprachwissenschaft 0 Leibniz-Centre General Linguistics (ZAS) 0 Bibliographies BLLDB 0 BDSL 0 IDS Bibliografie zur deutschen Grammatik 0 IDS Bibliografie zur Gesprächsforschung 0 IDS Konnektoren im Deutschen 0 IDS Präpositionen im Deutschen 0 IDS OBELEX meta 0 MPI-SHH Linguistics Collection 0 MPI for Psycholinguistics 0 Linked Open Data catalogues Annohub 0 Online resources Link directory 0 Journal directory 0 Database directory 0 Dictionary directory 0 Open access documents BASE 5 Linguistik-Repository 0 IDS Publikationsserver 0 Online dissertations 0 Language Description Heritage 0