DE eng

Search in the Catalogues and Directories

Page: 1 2 3 4 5 6...10
Hits 21 – 40 of 191

21
Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders ...
Abstract: Anthology paper link: https://aclanthology.org/2021.emnlp-main.109/ Abstract: Pretrained Masked Language Models (MLMs) have revolutionised NLP in recent years. However, previous work has indicated that off-the-shelf MLMs are not effective as universal lexical or sentence encoders without further task-specific fine-tuning on NLI, sentence similarity, or paraphrasing tasks using annotated task data. In this work, we demonstrate that it is possible to turn MLMs into effective universal lexical and sentence encoders even without any additional data and without any supervision. We propose an extremely simple, fast and effective contrastive learning technique, termed Mirror-BERT, which converts MLMs (e.g., BERT and RoBERTa) into such encoders in 20-30 seconds without any additional external knowledge. Mirror-BERT relies on fully identical or slightly modified string pairs as positive (i.e., synonymous) fine-tuning examples, and aims to maximise their similarity during identity fine-tuning. We report huge gains ...
Keyword: Language Models; Natural Language Processing; Semantic Evaluation; Sociolinguistics
URL: https://dx.doi.org/10.48448/vrhm-zd20
https://underline.io/lecture/37527-fast,-effective,-and-self-supervised-transforming-masked-language-models-into-universal-lexical-and-sentence-encoders
BASE
Hide details
22
Improving Machine Translation of Rare and Unseen Word Senses ...
BASE
Show details
23
LexFit: Lexical Fine-Tuning of Pretrained Language Models ...
BASE
Show details
24
Verb Knowledge Injection for Multilingual Event Processing ...
BASE
Show details
25
A Closer Look at Few-Shot Crosslingual Transfer: The Choice of Shots Matters ...
BASE
Show details
26
BioVerbNet: a large semantic-syntactic classification of verbs in biomedicine. ...
Majewska, Olga; Collins, Charlotte; Baker, Simon. - : Apollo - University of Cambridge Repository, 2021
BASE
Show details
27
BioVerbNet: a large semantic-syntactic classification of verbs in biomedicine. ...
Majewska, Olga; Collins, Charlotte; Baker, Simon. - : Apollo - University of Cambridge Repository, 2021
BASE
Show details
28
BioVerbNet: a large semantic-syntactic classification of verbs in biomedicine ...
Majewska, Olga; Collins, Charlotte; Baker, Simon. - : Apollo - University of Cambridge Repository, 2021
BASE
Show details
29
BioVerbNet: a large semantic-syntactic classification of verbs in biomedicine.
In: nlmid: 101531992 ; essn: 2041-1480 (2021)
BASE
Show details
30
BioVerbNet: a large semantic-syntactic classification of verbs in biomedicine.
Majewska, Olga; Collins, Charlotte; Baker, Simon. - : Springer Science and Business Media LLC, 2021. : J Biomed Semantics, 2021
BASE
Show details
31
BioVerbNet: a large semantic-syntactic classification of verbs in biomedicine
Majewska, Olga; Collins, Charlotte; Baker, Simon. - : BioMed Central, 2021. : Journal of Biomedical Semantics, 2021
BASE
Show details
32
Multi-SimLex: A Large-Scale Evaluation of Multilingual and Cross-Lingual Lexical Semantic Similarity
In: ISSN: 0891-2017 ; EISSN: 1530-9312 ; Computational Linguistics ; https://hal.archives-ouvertes.fr/hal-02975786 ; Computational Linguistics, Massachusetts Institute of Technology Press (MIT Press), 2020, 46 (4), pp.847-897 ; https://direct.mit.edu/coli/article/46/4/847/97326/Multi-SimLex-A-Large-Scale-Evaluation-of (2020)
BASE
Show details
33
Towards zero-shot language modeling ...
Ponti, Edoardo; Vulić, I; Cotterell, R. - : Apollo - University of Cambridge Repository, 2020
BASE
Show details
34
Multidirectional Associative Optimization of Function-Specific Word Representations ...
Gerz, Daniela; Vulic, Ivan; Rei, Marek. - : Apollo - University of Cambridge Repository, 2020
BASE
Show details
35
XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning ...
BASE
Show details
36
Emergent Communication Pretraining for Few-Shot Machine Translation ...
BASE
Show details
37
Manual Clustering and Spatial Arrangement of Verbs for Multilingual Evaluation and Typology Analysis ...
Majewska, Olga; Vulic, Ivan; McCarthy, Diana. - : Apollo - University of Cambridge Repository, 2020
BASE
Show details
38
Emergent Communication Pretraining for Few-Shot Machine Translation ...
Li, Yaoyiran; Ponti, Edoardo; Vulic, Ivan. - : Apollo - University of Cambridge Repository, 2020
BASE
Show details
39
XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning ...
Ponti, Edoardo; Glavaš, Goran; Majewska, Olga. - : Apollo - University of Cambridge Repository, 2020
BASE
Show details
40
Emergent Communication Pretraining for Few-Shot Machine Translation ...
BASE
Show details

Page: 1 2 3 4 5 6...10

Catalogues
1
0
2
0
5
0
0
Bibliographies
3
0
0
0
0
0
1
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
180
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern