DE eng

Search in the Catalogues and Directories

Hits 1 – 18 of 18

1
Inducing Language-Agnostic Multilingual Representations ...
Abstract: Cross-lingual representations have the potential to make NLP techniques available to the vast majority of languages in the world. However, they currently require large pretraining corpora or access to typologically similar languages. In this work, we address these obstacles by removing language identity signals from multilingual embeddings. We examine three approaches for this: (i) re-aligning the vector spaces of target languages (all together) to a pivot source language; (ii) removing language-specific means and variances, which yields better discriminativeness of embeddings as a by-product; and (iii) increasing input similarity across languages by removing morphological contractions and sentence reordering. We evaluate on XNLI and reference-free MT across 19 typologically diverse languages. Our findings expose the limitations of these approaches -- unlike vector normalization, vector space re-alignment and text normalization do not achieve consistent gains across encoders and languages. Due to the ... : *SEM2021 Camera Ready ...
Keyword: Computation and Language cs.CL; FOS Computer and information sciences
URL: https://dx.doi.org/10.48550/arxiv.2008.09112
https://arxiv.org/abs/2008.09112
BASE
Hide details
2
Zero-Shot Cross-Lingual Transfer with Meta Learning ...
BASE
Show details
3
SIGTYP 2020 Shared Task: Prediction of Typological Features ...
BASE
Show details
4
Uncovering Probabilistic Implications in Typological Knowledge Bases ...
BASE
Show details
5
Back to the Future -- Sequential Alignment of Text Representations ...
BASE
Show details
6
What do Language Representations Really Represent? ...
BASE
Show details
7
What Do Language Representations Really Represent?
In: Bjerva, Johannes; Östling, Robert; Veiga, Maria Han; Tiedemann, Jörg; Augenstein, Isabelle (2019). What Do Language Representations Really Represent? Computational Linguistics, 45(2):381-389. (2019)
BASE
Show details
8
Copenhagen at CoNLL--SIGMORPHON 2018: Multilingual Inflection in Context with Explicit Morphosyntactic Decoding ...
BASE
Show details
9
Parameter sharing between dependency parsers for related languages ...
BASE
Show details
10
Multitask and Multilingual Modelling for Lexical Analysis ...
Bjerva, Johannes. - : arXiv, 2018
BASE
Show details
11
From Phonology to Syntax: Unsupervised Linguistic Typology at Different Levels with Language Embeddings ...
BASE
Show details
12
The Parallel Meaning Bank: Towards a Multilingual Corpus of Translations Annotated with Compositional Meaning Representations
In: 15th Conference of the European Chapter of the Association for Computational Linguistics ; https://hal.archives-ouvertes.fr/hal-01630960 ; 15th Conference of the European Chapter of the Association for Computational Linguistics, Apr 2017, Valencia, Spain. pp.242 - 247 (2017)
BASE
Show details
13
Tracking Typological Traits of Uralic Languages in Distributed Language Representations ...
BASE
Show details
14
Articulation rate in Swedish child-directed speech increases as a function of the age of the child even when surprisal is controlled for ...
BASE
Show details
15
One Model to Rule them all: Multitask and Multilingual Modelling for Lexical Analysis ...
Bjerva, Johannes. - : arXiv, 2017
BASE
Show details
16
The Parallel Meaning Bank: Towards a Multilingual Corpus of Translations Annotated with Compositional Meaning Representations ...
BASE
Show details
17
Rethinking intertextuality through a word-space and social network approach – the case of Cassiodorus
In: https://hal.archives-ouvertes.fr/hal-01279833 ; 2016 (2016)
BASE
Show details
18
Semantic Tagging with Deep Residual Networks ...
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
18
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern