1 |
Towards a Cleaner Document-Oriented Multilingual Crawled Corpus ...
|
|
|
|
BASE
|
|
Show details
|
|
2 |
A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languages ...
|
|
|
|
Abstract:
We use the multilingual OSCAR corpus, extracted from Common Crawl via language classification, filtering and cleaning, to train monolingual contextualized word embeddings (ELMo) for five mid-resource languages. We then compare the performance of OSCAR-based and Wikipedia-based ELMo embeddings for these languages on the part-of-speech tagging and parsing tasks. We show that, despite the noise in the Common-Crawl-based OSCAR data, embeddings trained on OSCAR perform much better than monolingual embeddings trained on Wikipedia. They actually equal or improve the current state of the art in tagging and parsing for all five languages. In particular, they also improve over multilingual Wikipedia-based contextual embeddings (multilingual BERT), which almost always constitutes the previous state of the art, thereby showing that the benefit of a larger, more diverse corpus surpasses the cross-lingual benefit of multilingual embedding architectures. ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://arxiv.org/abs/2006.06202 https://dx.doi.org/10.48550/arxiv.2006.06202
|
|
BASE
|
|
Hide details
|
|
5 |
Méthodes pour la représentation informatisée de données lexicales / Methoden der Speicherung lexikalischer Daten ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
A prototype for projecting HPSG syntactic lexica towards LMF ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
Stabilizing knowledge through standards - A perspective for the humanities ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Standardization of the formal representation of lexical information for NLP ...
|
|
|
|
BASE
|
|
Show details
|
|
15 |
International Standard for a Linguistic Annotation Framework ...
|
|
|
|
BASE
|
|
Show details
|
|
16 |
Multimodal Meaning Representation for Generic Dialogue Systems Architectures ...
|
|
|
|
BASE
|
|
Show details
|
|
18 |
Unification of multi-lingual scientific terminological resources using the ISO 16642 standard. The TermSciences initiative ...
|
|
|
|
BASE
|
|
Show details
|
|
19 |
Un modèle générique d'organisation de corpus en ligne: application à la FReeBank ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|