5 |
Parsing with Pretrained Language Models, Multiple Datasets, and Dataset Embeddings ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
On the Effectiveness of Dataset Embeddings in Mono-lingual,Multi-lingual and Zero-shot Conditions ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Genre as Weak Supervision for Cross-lingual Dependency Parsing ...
|
|
|
|
Abstract:
Recent work has shown that monolingual masked language models learn to represent data-driven notions of language variation which can be used for domain-targeted training data selection. Dataset genre labels are already frequently available, yet remain largely unexplored in cross-lingual setups. We harness this genre metadata as a weak supervision signal for targeted data selection in zero-shot dependency parsing. Specifically, we project treebank-level genre information to the finer-grained sentence level, with the goal to amplify information implicitly stored in unsupervised contextualized representations. We demonstrate that genre is recoverable from multilingual contextual embeddings and that it provides an effective signal for training data selection in cross-lingual, zero-shot scenarios. For 12 low-resource language treebanks, six of which are test-only, our genre-specific methods significantly outperform competitive baselines as well as recent embedding-based methods for data selection. Moreover, ... : Accepted to EMNLP 2021 (Main Conference) ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://arxiv.org/abs/2109.04733 https://dx.doi.org/10.48550/arxiv.2109.04733
|
|
BASE
|
|
Hide details
|
|
9 |
Genre as Weak Supervision for Cross-lingual Dependency Parsing ...
|
|
|
|
BASE
|
|
Show details
|
|
10 |
DaN+: Danish Nested Named Entities and Lexical Normalization ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understanding ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
From Masked-Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understanding ...
|
|
|
|
BASE
|
|
Show details
|
|
13 |
Lexical Normalization for Code-switched Data and its Effect on POS-tagging ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
Fair Is Better than Sensational: Man Is to Doctor as Woman Is to Doctor
|
|
|
|
In: Computational Linguistics, Vol 46, Iss 2, Pp 487-497 (2020) (2020)
|
|
BASE
|
|
Show details
|
|
15 |
Bleaching Text: Abstract Features for Cross-lingual Gender Prediction ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|