• Refine your search:
  • 
    Keyword
  • 
    Creator / Publisher
  • 
    Year
  • 
    Medium:
    
    • Online (13)
    • Print (1)
  • 
    Type
  • 
    BLLDB-Access

Search in the Catalogues and Directories

All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year Sort by creator [A → Z]' creator [Z → A]' publishing year ↑ (asc)' publishing year ↓ (desc)' title [A → Z]' title [Z → A]' Simple Search Hits 1 – 14 of 14 1 NB-MLM: Efficient Domain Adaptation of Masked Language Models for Sentiment Analysis ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Arefyev, Nikolay; Kharchev, Dmitrii; Shelmanov, Artem. - : Underline Science Inc., 2021 Abstract: Anthology paper link: https://aclanthology.org/2021.emnlp-main.717/ Abstract: While Masked Language Models (MLM) are pre-trained on massive datasets, the additional training with the MLM objective on domain or task-specific data before fine-tuning for the final task is known to improve the final performance. This is usually referred to as the domain or task adaptation step. However, unlike the initial pre-training, this step is performed for each domain or task individually and is still rather slow, requiring several GPU days compared to several GPU hours required for the final task fine-tuning. We argue that the standard MLM objective leads to inefficiency when it is used for the adaptation step because it mostly learns to predict the most frequent words, which are not necessarily related to a final task. We propose a technique for more efficient adaptation that focuses on predicting words with large weights of the Naive Bayes classifier trained for the task at hand, which are likely more relevant than the ... Keyword: Computational Linguistics; Language Models; Machine Learning; Machine Learning and Data Mining; Natural Language Processing URL: https://dx.doi.org/10.48448/bg4j-x794 https://underline.io/lecture/37952-nb-mlm-efficient-domain-adaptation-of-masked-language-models-for-sentiment-analysis BASE Hide details 2 A Comparative Study of Lexical Substitution Approaches based on Neural Language Models ... Arefyev, Nikolay; Sheludko, Boris; Podolskiy, Alexander. - : arXiv, 2020 BASE Show details 3 HHMM at SemEval-2019 Task 2: Unsupervised frame induction using contextualized word embeddings Arefyev, Nikolay; Panchenko, Alexander; Anwar, Saba. - : Association for Computational Linguistics, ACL, 2019 BASE Show details 4 RUSSE'2018 : a shared task on word sense induction for the Russian language Panchenko, Alexander [Verfasser]; Lopukhina, Anastasiya [Verfasser]; Ustalov, Dmitry [Verfasser]. - Mannheim : Universitätsbibliothek Mannheim, 2018 DNB Subject Category Language Show details 5 RUSSE'2018: A Shared Task on Word Sense Induction for the Russian Language ... Panchenko, Alexander; Lopukhina, Anastasiya; Ustalov, Dmitry. - : arXiv, 2018 BASE Show details 6 How much does a word weigh? Weighting word embeddings for word sense induction ... Arefyev, Nikolay; Ermolaev, Pavel; Panchenko, Alexander. - : arXiv, 2018 BASE Show details 7 RUSSE'2018 : a shared task on word sense induction for the Russian language Panchenko, Alexander; Lopukhina, Anastasiya; Ustalov, Dmitry. - : RSUH, 2018 BASE Show details 8 Negative Sampling Improves Hypernymy Extraction Based on Projection Learning ... Ustalov, Dmitry; Arefyev, Nikolay; Panchenko, Alexander. - : Zenodo, 2017 BASE Show details 9 Negative Sampling Improves Hypernymy Extraction Based on Projection Learning ... Ustalov, Dmitry; Arefyev, Nikolay; Biemann, Chris. - : arXiv, 2017 BASE Show details 10 Making Sense of Word Embeddings ... Pelevina, Maria; Arefyev, Nikolay; Biemann, Chris. - : arXiv, 2017 BASE Show details 11 Human and Machine Judgements for Russian Semantic Relatedness ... Panchenko, Alexander; Ustalov, Dmitry; Arefyev, Nikolay. - : arXiv, 2017 BASE Show details 12 Negative sampling improves hypernymy extraction based on projection learning Panchenko, Alexander; Arefyev, Nikolay; Ustalov, Dmitry. - : Association for Computational Linguistics, 2017 BASE Show details 13 Human and machine judgements for Russian semantic relatedness Panchenko, Alexander; Ustalov, Dmitry; Arefyev, Nikolay. - : Springer, 2017 BASE Show details 14 Human And Machine Judgements For Russian Semantic Relatedness ... Panchenko, Alexander; Ustalov, Dmitry; Arefyev, Nikolay. - : Zenodo, 2016 BASE Show details

Mobile view All Catalogues UB Frankfurt Linguistik 0 IDS Mannheim 0 OLC Linguistik 0 UB Frankfurt Retrokatalog 0 DNB Subject Category Language 1 Institut für Empirische Sprachwissenschaft 0 Leibniz-Centre General Linguistics (ZAS) 0 Bibliographies BLLDB 0 BDSL 0 IDS Bibliografie zur deutschen Grammatik 0 IDS Bibliografie zur Gesprächsforschung 0 IDS Konnektoren im Deutschen 0 IDS Präpositionen im Deutschen 0 IDS OBELEX meta 0 MPI-SHH Linguistics Collection 0 MPI for Psycholinguistics 0 Linked Open Data catalogues Annohub 0 Online resources Link directory 0 Journal directory 0 Database directory 0 Dictionary directory 0 Open access documents BASE 13 Linguistik-Repository 0 IDS Publikationsserver 0 Online dissertations 0 Language Description Heritage 0