• Refine your search:
  • 
    Keyword:
    
    • Computational Linguistics (246)
    • Language Models (246)
    • Machine Learning (246)
    • Natural Language Processing (246)
    • Machine Learning and Data Mining (243)
    • Machine translation (28)
    • Neural Network (24)
    • Bilingual Lexicon Induction (12)
    • Sentiment Analysis (12)
    • Text Summarization (12)
    •   more
  • 
    Creator / Publisher
  • 
    Year:
    
    • 2021 (246)
  • 
    Medium
  • 
    Type:
    
    • Article (246)
  • 
    BLLDB-Access

Search in the Catalogues and Directories

All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year Sort by creator [A → Z]' creator [Z → A]' publishing year ↑ (asc)' publishing year ↓ (desc)' title [A → Z]' title [Z → A]' Simple Search Page: 1 2 3 4 5...13 Hits 1 – 20 of 246 1 Automatic Error Type Annotation for Arabic ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Belkebir, Riadh; Habash, Nizar. - : Underline Science Inc., 2021 BASE Show details 2 Navigating the Kaleidoscope of COVID-19 Misinformation Using Deep Learning ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Chen, Yuanzhi; Hasan, Mohammad. - : Underline Science Inc., 2021 BASE Show details 3 HittER: Hierarchical Transformers for Knowledge Graph Embeddings ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Chen, Sanxing; Gao, Jianfeng. - : Underline Science Inc., 2021 BASE Show details 4 Detecting Gender Bias using Explainability ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; ., Krithika; Gupta, Gauri. - : Underline Science Inc., 2021 BASE Show details 5 HETFORMER: Heterogeneous Transformer with Sparse Attention for Long-Text Extractive Summarization ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; He, Lifang; LIU, YE. - : Underline Science Inc., 2021 BASE Show details 6 Not All Negatives are Equal: Label-Aware Contrastive Loss for Fine-grained Text Classification ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Ong, Desmond; Suresh, Varsha. - : Underline Science Inc., 2021 BASE Show details 7 Contrastive Code Representation Learning ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Jain, Ajay; Jain, Paras. - : Underline Science Inc., 2021 BASE Show details 8 Unsupervised Multi-View Post-OCR Error Correction With Language Models ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Brenner, Eliot; Broscheit, Samuel. - : Underline Science Inc., 2021 BASE Show details 9 AttentionRank: Unsupervised Keyphrase Extraction using Self and Cross Attentions ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Ding, Haoran; Luo, Xiao. - : Underline Science Inc., 2021 BASE Show details 10 Automatic Fact-Checking with Document-level Annotations using BERT and Multiple Instance Learning ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Park, Joonsuk; Sathe, Aalok. - : Underline Science Inc., 2021 BASE Show details 11 Towards the Early Detection of Child Predators in Chat Rooms: A BERT-based Approach ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Kumbale, Sinchana; Singh, Smriti. - : Underline Science Inc., 2021 BASE Show details 12 Semantic Categorization of Social Knowledge for Commonsense Question Answering ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Wang, Gengyu. - : Underline Science Inc., 2021 BASE Show details 13 Pre-train or Annotate? Domain Adaptation with a Constrained Budget ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Bai, Fan; Ritter, Alan. - : Underline Science Inc., 2021 BASE Show details 14 Stepmothers are mean and academics are pretentious: What do pretrained language models learn about you? ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Choenni, Rochelle; Shutova, Ekaterina. - : Underline Science Inc., 2021 BASE Show details 15 CLIFF: Contrastive Learning for Improving Faithfulness and Factuality in Abstractive Summarization ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Cao, Shuyang; Wang, Lu. - : Underline Science Inc., 2021 BASE Show details 16 Automatic Text Evaluation through the Lens of Wasserstein Barycenters ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Clavel, Chloe; Colombo, Pierre. - : Underline Science Inc., 2021 BASE Show details 17 Combining sentence and table evidence to predict veracity of factual claims using TaPaS and RoBERTa ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Funkquist, Martin. - : Underline Science Inc., 2021 BASE Show details 18 Meta Distant Transfer Learning for Pre-trained Language Models ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Wang, Chengyu. - : Underline Science Inc., 2021 BASE Show details 19 How to Train BERT with an Academic Budget ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Berchansky, Moshe; Izsak, Peter. - : Underline Science Inc., 2021 BASE Show details 20 Temporal Adaptation of BERT and Performance on Downstream Document Classification: Insights from Social Media ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021. - : Underline Science Inc., 2021 Abstract: Language use differs between domains and even within a domain, language use changes over time. For pre-trained language models like BERT, domain adaptation through continued pre-training has been shown to improve performance on in-domain downstream tasks. In this article, we investigate whether temporal adaptation can bring additional benefits. For this purpose, we introduce a corpus of social media comments sampled over three years. It contains unlabelled data for adaptation and evaluation on an upstream masked language modelling task as well as labelled data for fine-tuning and evaluation on a downstream document classification task. We find that temporality matters for both tasks: temporal adaptation improves upstream and temporal fine-tuning downstream task performance. Time-specific models generally perform better on past than on future test sets, which matches evidence on the bursty usage of topical words. However, adapting BERT to time and domain does not improve performance on the downstream task ... Keyword: Computational Linguistics; Language Models; Machine Learning; Machine Learning and Data Mining; Natural Language Processing URL: https://dx.doi.org/10.48448/xfn5-0714 https://underline.io/lecture/40586-temporal-adaptation-of-bert-and-performance-on-downstream-document-classification-insights-from-social-media BASE Hide details Page: 1 2 3 4 5...13

Mobile view All Catalogues UB Frankfurt Linguistik 0 IDS Mannheim 0 OLC Linguistik 0 UB Frankfurt Retrokatalog 0 DNB Subject Category Language 0 Institut für Empirische Sprachwissenschaft 0 Leibniz-Centre General Linguistics (ZAS) 0 Bibliographies BLLDB 0 BDSL 0 IDS Bibliografie zur deutschen Grammatik 0 IDS Bibliografie zur Gesprächsforschung 0 IDS Konnektoren im Deutschen 0 IDS Präpositionen im Deutschen 0 IDS OBELEX meta 0 MPI-SHH Linguistics Collection 0 MPI for Psycholinguistics 0 Linked Open Data catalogues Annohub 0 Online resources Link directory 0 Journal directory 0 Database directory 0 Dictionary directory 0 Open access documents BASE 246 Linguistik-Repository 0 IDS Publikationsserver 0 Online dissertations 0 Language Description Heritage 0