DE eng

Search in the Catalogues and Directories

Hits 1 – 2 of 2

1
Investigating cross-lingual alignment methods for contextualized embeddings with Token-level evaluation ...
Liu, Qianchu; McCarthy, D; Vulić, I; Korhonen, Anna-Leena. - : Apollo - University of Cambridge Repository, 2019
Abstract: In this paper, we present a thorough investigation on methods that align pre-trained contextualized embeddings into shared cross-lingual context-aware embedding space, providing strong reference benchmarks for future context-aware crosslingual models. We propose a novel and challenging task, Bilingual Token-level Sense Retrieval (BTSR). It specifically evaluates the accurate alignment of words with the same meaning in cross-lingual non-parallel contexts, currently not evaluated by existing tasks such as Bilingual Contextual Word Similarity and Sentence Retrieval. We show how the proposed BTSR task highlights the merits of different alignment methods. In particular, we find that using context average type-level alignment is effective in transferring monolingual contextualized embeddings cross-lingually especially in non-parallel contexts, and at the same time improves the monolingual space. Furthermore, aligning independently trained models yields better performance than aligning multilingual embeddings with ... : Peterhouse College Studentship; ERC Consolidator Grant LEXICAL ...
URL: https://dx.doi.org/10.17863/cam.44042
https://www.repository.cam.ac.uk/handle/1810/297000
BASE
Hide details
2
Investigating cross-lingual alignment methods for contextualized embeddings with Token-level evaluation
Liu, Qianchu; McCarthy, D; Vulić, I. - : CoNLL 2019 - 23rd Conference on Computational Natural Language Learning, Proceedings of the Conference, 2019
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
2
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern