1 |
Learning New Vocabulary Implicitly During Sleep Transfers With Cross-Modal Generalization Into Wakefulness
|
|
|
|
In: ISSN: 1662-4548 ; EISSN: 1662-453X ; Frontiers in Neuroscience ; https://hal.sorbonne-universite.fr/hal-03640595 ; Frontiers in Neuroscience, Frontiers, 2022, 16, pp.801666. ⟨10.3389/fnins.2022.801666⟩ (2022)
|
|
BASE
|
|
Show details
|
|
2 |
Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost
|
|
|
|
In: ACL 2022 - 60th Annual Meeting of the Association for Computational Linguistics ; https://hal.archives-ouvertes.fr/hal-03613101 ; ACL 2022 - 60th Annual Meeting of the Association for Computational Linguistics, May 2022, Dublin, Ireland (2022)
|
|
Abstract:
International audience ; State-of-the-art NLP systems represent inputs with word embeddings, but these are brittle when faced with Out-of-Vocabulary (OOV) words. To address this issue, we follow the principle of mimick-like models to generate vectors for unseen words, by learning the behavior of pre-trained embeddings using only the surface form of words. We present a simple contrastive learning framework, LOVE, which extends the word representation of an existing pre-trained language model (such as BERT), and makes it robust to OOV with few additional parameters. Extensive evaluations demonstrate that our lightweight model achieves similar or even better performances than prior competitors, both on original datasets and on corrupted variants. Moreover, it can be used in a plug-and-play fashion with FastText and BERT, where it significantly improves their robustness.
|
|
Keyword:
[INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]; Language models; Out-of-vocabulary OOV words; Word embeddings
|
|
URL: https://hal.archives-ouvertes.fr/hal-03613101/file/OOV_Problem.pdf https://hal.archives-ouvertes.fr/hal-03613101 https://hal.archives-ouvertes.fr/hal-03613101/document
|
|
BASE
|
|
Hide details
|
|
3 |
Imputing out-of-vocabulary embeddings with LOVE makes language models robust with little cost
|
|
|
|
In: ACL 2022 - 60th Annual Meeting of the Association for Computational Linguistics ; https://hal.archives-ouvertes.fr/hal-03613101 ; ACL 2022 - 60th Annual Meeting of the Association for Computational Linguistics, May 2022, Dublin, Ireland (2022)
|
|
BASE
|
|
Show details
|
|
4 |
К ВОПРОСУ ОБ ОРГАНИЗАЦИИ РОЛЕВЫХ ИГР НА СЕМИНАРАХ ПО ИЗУЧЕНИЮ ИНОСТРАННОГО ЯЗЫКА ФИНАНСОВО-ЭКОНОМИЧЕСКОГО ПРОФИЛЯ ... : ON THE ISSUE OF ROLE PLAYING AT SEMINARS ON BUSINESS AND FINANCIAL ENGLISH ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
COVID-19 first lockdown as a window into language acquisition: associations between caregiver-child activities and vocabulary gains ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
THE EFFECT OF DIGITAL GAMES IN TEACHING VOCABULARY IN EFL CLASSES ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
THE ROLE OF INTEGRATED ACTIVITIES TO DEVELOP WRITING COMPETENCE ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
THE EFFECT OF DIGITAL GAMES IN TEACHING VOCABULARY IN EFL CLASSES ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
THE ROLE OF INTEGRATED ACTIVITIES TO DEVELOP WRITING COMPETENCE ...
|
|
|
|
BASE
|
|
Show details
|
|
10 |
The Classification of Professional Vocabulary in the Languages ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
英語繪本融入國小五年級英語學習扶助成效之行動研究 ; An Action Research on Effectiveness of Using Picture Books in 5th Grader’s English Remedial Instruction
|
|
|
|
BASE
|
|
Show details
|
|
12 |
КОВИД-ЛЕКСИКА КАК ЭКСПЛИКАТОР АВТОРСКОЙ МОДАЛЬНОСТИ В ТЕКСТАХ РУССКОЯЗЫЧНЫХ СМИ ... : COVID VOCABULARY AS AN EXPLICATOR OF AUTHOR’S MODALITY IN THE TEXTS OF RUSSIAN MASS MEDIA ...
|
|
|
|
BASE
|
|
Show details
|
|
13 |
ЛЕКСИКА СВАДЕБНОГО ОБРЯДА В КАЛМЫЦКОМ ЯЗЫКЕ: ЭТНОЛИНГВИСТИЧЕСКИЙ АСПЕКТ ... : THE VOCABULARY OF A WEDDING CEREMONY IN THE KALMYK LANGUAGE: AN ETHNOLINGUISTIC ASPECT ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
ИННОВАЦИИ В ЯЗЫКЕ СОВРЕМЕННЫХ РОССИЙСКИХ ИНТЕРНЕТ-МЕДИА ... : INNOVATIONS IN THE LANGUAGE OF TODAY'S RUSSIAN ONLINE MEDIA ...
|
|
|
|
BASE
|
|
Show details
|
|
15 |
СЕМАНТИЧЕСКИЕ ЗАИМСТВОВАНИЯ (ИССЛЕДОВАНИЕ КИТАЙСКИХ ЗАИМСТВОВАНИЙ СЕНСОРНО-ПЕРЦЕПТИВНОЙ КАТЕГОРИИ) ... : SEMANTIC BORROWINGS (A STUDY OF CHINESE BORROWINGS OF THE SENSORY-PERCEPTUAL CATEGORY) ...
|
|
|
|
BASE
|
|
Show details
|
|
16 |
ЗООМЕТАФОРЫ-ИНВЕКТИВЫ ВО ФРАЗЕОЛОГИЗМАХ ЧАМАЛИНСКОГО ЯЗЫКА ... : ZOOMETAPHORS-INVECTIVES IN THE PHRASEOLOGICAL UNITS OF THE CHAMALAL LANGUAGE ...
|
|
|
|
BASE
|
|
Show details
|
|
17 |
ТЕРМИНЫ ПИЩЕВОЙ МОЛОЧНОЙ ПРОДУКЦИИ (ЭТНО-КУЛЬТУРНЫЙ АСПЕКТ) ... : TERMS OF FOOD DAIRY PRODUCTS (ETHNO-CULTURAL ASPECT) ...
|
|
|
|
BASE
|
|
Show details
|
|
18 |
ЛИНГВОСТИЛИСТИЧЕСКИЕ ОСОБЕННОСТИ ПЕРЕВОДА ЭМОЦИОНАЛЬНО-ОЦЕНОЧНОЙ ЛЕКСИКИ ... : LINGUISTIC AND STYLISTIC FEATURES OF TRANSLATION OF EMOTIONAL AND EVALUATIVE VOCABULARY ...
|
|
|
|
BASE
|
|
Show details
|
|
19 |
ЛЕКСИКА НА ПОЗНАЧЕННЯ НАЗВ ТВАРИН ВЕРХНЬОГО ЦАРСТВА У ТЕКСТАХ УКРАЇНСЬКИХ ЗАМОВЛЯНЬ ... : VOCABULARY FOR THE NAMES OF ANIMALS OF THE UPPER KINGDOM IN THE TEXTS OF UKRAINIAN SPELLS ...
|
|
|
|
BASE
|
|
Show details
|
|
20 |
ИССЛЕДОВАНИЕ ПОТЕНЦИАЛА ЦИФРОВЫХ ДИДАКТИЧЕСКИХ КАРТОЧЕК ДЛЯ ИЗУЧЕНИЯ ЛЕКСИКИ ... : EXAMINING THE POTENTIAL OF DIGITAL FLASHCARDS FOR VOCABULARY LEARNING ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|