DE eng

Search in the Catalogues and Directories

Hits 1 – 12 of 12

1
Cross-Lingual Dialogue Dataset Creation via Outline-Based Generation ...
BASE
Show details
2
Towards Zero-shot Language Modeling ...
BASE
Show details
3
Differentiable Generative Phonology ...
BASE
Show details
4
Modelling Latent Translations for Cross-Lingual Transfer ...
BASE
Show details
5
Visually Grounded Reasoning across Languages and Cultures ...
BASE
Show details
6
XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning ...
BASE
Show details
7
Multi-SimLex: A Large-Scale Evaluation of Multilingual and Cross-Lingual Lexical Semantic Similarity ...
BASE
Show details
8
Probing Pretrained Language Models for Lexical Semantics ...
BASE
Show details
9
Specializing Unsupervised Pretraining Models for Word-Level Semantic Similarity ...
BASE
Show details
10
Informing unsupervised pretraining with external linguistic knowledge
Abstract: Unsupervised pretraining models have been shown to facilitate a wide range of downstream applications. These models, however, still encode only the distributional knowledge, incorporated through language modeling objectives. In this work, we complement the encoded distributional knowledge with external lexical knowledge. We generalize the recently proposed (state-of-the-art) unsupervised pretraining model BERT to a multi-task learning setting: we couple BERT's masked language modeling and next sentence prediction objectives with the auxiliary binary word relation classification, through which we inject clean linguistic knowledge into the model. Our initial experiments suggest that our "linguistically-informed" BERT (LIBERT) yields performance gains over the linguistically-blind "vanilla" BERT on several language understanding tasks.
Keyword: 004 Informatik
URL: https://madoc.bib.uni-mannheim.de/51956/
https://arxiv.org/pdf/1909.02339.pdf
BASE
Hide details
11
Modeling Language Variation and Universals: A Survey on Typological Linguistics for Natural Language Processing ...
BASE
Show details
12
Distributed Representations of Lexical Sets and Prototypes in Causal Alternation Verbs ...
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
12
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern