1 |
Enhancing Cross-lingual Prompting with Mask Token Augmentation ...
|
|
|
|
BASE
|
|
Show details
|
|
2 |
P-hydroxy benzaldehyde facilitates reprogramming of reactive astrocytes into neurons via endogenous transcriptional regulation ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
P-hydroxy benzaldehyde facilitates reprogramming of reactive astrocytes into neurons via endogenous transcriptional regulation ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
p-hydroxy benzaldehyde facilitates reprogramming of reactive astrocytes into neurons via endogenous transcriptional regulation ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
Knowledge Based Multilingual Language Model ...
|
|
|
|
Abstract:
Knowledge enriched language representation learning has shown promising performance across various knowledge-intensive NLP tasks. However, existing knowledge based language models are all trained with monolingual knowledge graph data, which limits their application to more languages. In this work, we present a novel framework to pretrain knowledge based multilingual language models (KMLMs). We first generate a large amount of code-switched synthetic sentences and reasoning-based multilingual training data using the Wikidata knowledge graphs. Then based on the intra- and inter-sentence structures of the generated data, we design pretraining tasks to facilitate knowledge learning, which allows the language models to not only memorize the factual knowledge but also learn useful logical patterns. Our pretrained KMLMs demonstrate significant performance improvements on a wide range of knowledge-intensive cross-lingual NLP tasks, including named entity recognition, factual knowledge retrieval, relation ...
|
|
Keyword:
Artificial Intelligence cs.AI; Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://dx.doi.org/10.48550/arxiv.2111.10962 https://arxiv.org/abs/2111.10962
|
|
BASE
|
|
Hide details
|
|
7 |
MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NER ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Multilingual AMR Parsing with Noisy Knowledge Distillation ...
|
|
|
|
BASE
|
|
Show details
|
|
18 |
Encoding of facial features by single neurons in the human amygdala and hippocampus
|
|
|
|
In: Commun Biol (2021)
|
|
BASE
|
|
Show details
|
|
19 |
The Bilingual Home Language Boost Through the Lens of the COVID-19 Pandemic
|
|
|
|
In: Front Psychol (2021)
|
|
BASE
|
|
Show details
|
|
20 |
Unsupervised Cross-lingual Adaptation for Sequence Tagging and Beyond ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|