DE eng

Search in the Catalogues and Directories

Hits 1 – 11 of 11

1
IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages ...
BASE
Show details
2
Cross-Lingual Dialogue Dataset Creation via Outline-Based Generation ...
BASE
Show details
3
Towards Zero-shot Language Modeling ...
BASE
Show details
4
Modelling Latent Translations for Cross-Lingual Transfer ...
BASE
Show details
5
XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning ...
BASE
Show details
6
Multi-SimLex: A Large-Scale Evaluation of Multilingual and Cross-Lingual Lexical Semantic Similarity ...
BASE
Show details
7
Probing Pretrained Language Models for Lexical Semantics ...
BASE
Show details
8
Specializing Unsupervised Pretraining Models for Word-Level Semantic Similarity ...
Abstract: Unsupervised pretraining models have been shown to facilitate a wide range of downstream NLP applications. These models, however, retain some of the limitations of traditional static word embeddings. In particular, they encode only the distributional knowledge available in raw text corpora, incorporated through language modeling objectives. In this work, we complement such distributional knowledge with external lexical knowledge, that is, we integrate the discrete knowledge on word-level semantic similarity into pretraining. To this end, we generalize the standard BERT model to a multi-task learning setting where we couple BERT's masked language modeling and next sentence prediction objectives with an auxiliary task of binary word relation classification. Our experiments suggest that our "Lexically Informed" BERT (LIBERT), specialized for the word-level semantic similarity, yields better performance than the lexically blind "vanilla" BERT on several language understanding tasks. Concretely, LIBERT ...
Keyword: Computation and Language cs.CL; FOS Computer and information sciences
URL: https://arxiv.org/abs/1909.02339
https://dx.doi.org/10.48550/arxiv.1909.02339
BASE
Hide details
9
Modeling Language Variation and Universals: A Survey on Typological Linguistics for Natural Language Processing ...
BASE
Show details
10
Adversarial Propagation and Zero-Shot Cross-Lingual Transfer of Word Vector Specialization ...
BASE
Show details
11
Decoding Sentiment from Distributed Representations of Sentences ...
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
11
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern