DE eng

Search in the Catalogues and Directories

Page: 1 2
Hits 1 – 20 of 25

1
Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders ...
Liu, Fangyu; Vulić, I; Korhonen, Anna-Leena; Collier, Nigel. - : Apollo - University of Cambridge Repository, 2021
Abstract: Pretrained Masked Language Models (MLMs) have revolutionised NLP in recent years. However, previous work has indicated that off-the-shelf MLMs are not effective as universal lexical or sentence encoders without further task-specific fine-tuning on NLI, sentence similarity, or paraphrasing tasks using annotated task data. In this work, we demonstrate that it is possible to turn MLMs into effective universal lexical and sentence encoders even without any additional data and without any supervision. We propose an extremely simple, fast and effective contrastive learning technique, termed Mirror-BERT, which converts MLMs (e.g., BERT and RoBERTa) into such encoders in 20-30 seconds without any additional external knowledge. Mirror-BERT relies on fully identical or slightly modified string pairs as positive (i.e., synonymous) fine-tuning examples, and aims to maximise their similarity during identity fine-tuning. We report huge gains over off-the-shelf MLMs with Mirror-BERT in both lexical-level and sentence-level ...
Keyword: cs.AI; cs.CL; cs.LG
URL: https://www.repository.cam.ac.uk/handle/1810/327954
https://dx.doi.org/10.17863/cam.75407
BASE
Hide details
2
Towards zero-shot language modeling ...
Ponti, Edoardo; Vulić, I; Cotterell, R. - : Apollo - University of Cambridge Repository, 2020
BASE
Show details
3
Cross-lingual semantic specialization via lexical relation induction ...
Ponti, Edoardo; Vulić, I; Glavaš, G. - : Apollo - University of Cambridge Repository, 2020
BASE
Show details
4
Adversarial propagation and zero-shot cross-lingual transfer of word vector specialization ...
Ponti, Edoardo; Vulić, I; Glavaš, G. - : Apollo - University of Cambridge Repository, 2020
BASE
Show details
5
Do we really need fully unsupervised cross-lingual embeddings? ...
Vulić, I; Glavaš, G; Reichart, R. - : Apollo - University of Cambridge Repository, 2020
BASE
Show details
6
On the relation between linguistic typology and (limitations of) multilingual language modeling ...
Gerz, Daniela; Vulić, I; Ponti, Edoardo. - : Apollo - University of Cambridge Repository, 2020
BASE
Show details
7
Cross-lingual semantic specialization via lexical relation induction
Ponti, Edoardo; Vulić, I; Glavaš, G. - : EMNLP-IJCNLP 2019 - 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing, Proceedings of the Conference, 2020
BASE
Show details
8
On the relation between linguistic typology and (limitations of) multilingual language modeling
Gerz, Daniela; Vulić, I; Ponti, Edoardo. - : Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, EMNLP 2018, 2020
BASE
Show details
9
Adversarial propagation and zero-shot cross-lingual transfer of word vector specialization
Ponti, Edoardo; Vulić, I; Glavaš, G. - : Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, EMNLP 2018, 2020
BASE
Show details
10
Do we really need fully unsupervised cross-lingual embeddings?
Vulić, I; Glavaš, G; Reichart, R. - : EMNLP-IJCNLP 2019 - 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing, Proceedings of the Conference, 2020
BASE
Show details
11
Towards zero-shot language modeling
Ponti, Edoardo; Vulić, I; Cotterell, R. - : EMNLP-IJCNLP 2019 - 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing, Proceedings of the Conference, 2020
BASE
Show details
12
Investigating cross-lingual alignment methods for contextualized embeddings with Token-level evaluation ...
Liu, Qianchu; McCarthy, D; Vulić, I. - : Apollo - University of Cambridge Repository, 2019
BASE
Show details
13
Investigating cross-lingual alignment methods for contextualized embeddings with Token-level evaluation
Liu, Qianchu; McCarthy, D; Vulić, I. - : CoNLL 2019 - 23rd Conference on Computational Natural Language Learning, Proceedings of the Conference, 2019
BASE
Show details
14
A systematic study of leveraging subword information for learning word representations
Zhu, Y; Korhonen, Anna-Leena; Vulić, I. - : NAACL HLT 2019 - 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies - Proceedings of the Conference, 2019
BASE
Show details
15
Acquiring verb classes through bottom-up semantic verb clustering ...
Majewska, Olga; McCarthy, D; Vulić, I. - : Apollo - University of Cambridge Repository, 2018
BASE
Show details
16
Acquiring verb classes through bottom-up semantic verb clustering
Majewska, Olga; McCarthy, D; Vulić, I. - : LREC 2018 - 11th International Conference on Language Resources and Evaluation, 2018
BASE
Show details
17
Decoding sentiment from distributed representations of sentences ...
Ponti, Edoardo; Vulić, I; Korhonen, Anna-Leena. - : Apollo - University of Cambridge Repository, 2017
BASE
Show details
18
HyperLex: A Large-Scale Evaluation of Graded Lexical Entailment ...
Vulić, I; Gerz, D; Kiela, D. - : Apollo - University of Cambridge Repository, 2017
BASE
Show details
19
Decoding sentiment from distributed representations of sentences
Ponti, Edoardo; Vulić, I; Korhonen, Anna-Leena. - : Association for Computational Linguistics, 2017. : *SEM 2017 - 6th Joint Conference on Lexical and Computational Semantics, Proceedings, 2017
BASE
Show details
20
HyperLex: A Large-Scale Evaluation of Graded Lexical Entailment
Vulić, I; Gerz, D; Kiela, D. - : MIT Press, 2017. : Computational Linguistics, 2017
BASE
Show details

Page: 1 2

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
25
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern