| 1 |
A Resource for Evaluating Graded Word Similarity in Context: CoSimLex
|
|
|
|
BASE
|
|
Show details
|
|
|
| 4 |
Multilingual Culture-Independent Word Analogy Datasets
|
|
|
|
Abstract:
Word analogy task evaluates word embeddings, based on analagous word pairs (eg. "Paris - France" should be equivalent to "Rome - Italy", "son - daughter" should be equivalent to "brother - sister"). The dataset has been inspired by Mikolov's analogy test set in English (http://download.tensorflow.org/data/questions-words.txt). It was first written for Slovenian and then partially translated and partially done from scratch for the other languages (Croatian, Finnish, Estonian, Swedish, Latvian, Lithuanian, Russian and English). The analogy dataset is composed of fifteen categories, five semantical and ten syntactical. Each dataset has about 19,000 entries. In addition to nine monolingual datasets (one for each language), we also composed 72 cross-lingual datasets (one for each language pair), where one half of the entry (one analogy, eg. "mother-father") is in one language and the other half of the entry (eg. "sister-brother") is in another language.
|
|
Keyword:
analogy; Croatian language; cross-lingual; English language; Estonian language; Finnish language; Latvian language; Lithuanian language; multilingual; Russian language; Slovenian language; Swedish language; word analogies
|
|
URL: http://hdl.handle.net/11356/1261
|
|
BASE
|
|
Hide details
|
|
|
|
|
