• Refine your search:
  • 
    Keyword
  • 
    Creator / Publisher:
    
    • Aletras, Nikolaos (28)
    • Fomicheva, Marina (6)
    • Specia, Lucia (6)
    • Jin, Mali (5)
    • The 2021 Conference on Empirical Methods in Natural Language Processing 2021 (5)
    • Alva-Manchego, Fernando (4)
    • Blain, Frédéric (4)
    • Chrysostomou, George (4)
    • Gajbhiye, Amit (4)
    • Obamuyide, Abiola (4)
    •   more
  • 
    Year
  • 
    Medium
  • 
    Type
  • 
    BLLDB-Access:
    • free (28)
    • subject to license (0)

Search in the Catalogues and Directories

All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year Sort by creator [A → Z]' creator [Z → A]' publishing year ↑ (asc)' publishing year ↓ (desc)' title [A → Z]' title [Z → A]' Simple Search Page: 1 2 Hits 1 – 20 of 28 1 How does the pre-training objective affect what large language models learn about linguistic properties? ... Alajrami, Ahmed; Aletras, Nikolaos. - : arXiv, 2022 BASE Show details 2 Automatic Identification and Classification of Bragging in Social Media ... Jin, Mali; Preoţiuc-Pietro, Daniel; Doğruöz, A. Seza. - : arXiv, 2022 BASE Show details 3 Analyzing Online Political Advertisements ... Villegas, Danae Sánchez; Mokaram, Saeid; Aletras, Nikolaos. - : arXiv, 2021 BASE Show details 4 Modeling the Severity of Complaints in Social Media ... Jin, Mali; Aletras, Nikolaos. - : arXiv, 2021 BASE Show details 5 Translation Error Detection as Rationale Extraction ... Fomicheva, Marina; Specia, Lucia; Aletras, Nikolaos. - : arXiv, 2021 BASE Show details 6 Knowledge Distillation for Quality Estimation ... Gajbhiye, Amit; Fomicheva, Marina; Alva-Manchego, Fernando. - : arXiv, 2021 BASE Show details 7 Frustratingly Simple Pretraining Alternatives to Masked Language Modeling ... Yamaguchi, Atsuki; Chrysostomou, George; Margatina, Katerina; Aletras, Nikolaos. - : arXiv, 2021 Abstract: Masked language modeling (MLM), a self-supervised pretraining objective, is widely used in natural language processing for learning text representations. MLM trains a model to predict a random sample of input tokens that have been replaced by a [MASK] placeholder in a multi-class setting over the entire vocabulary. When pretraining, it is common to use alongside MLM other auxiliary objectives on the token or sequence level to improve downstream performance (e.g. next sentence prediction). However, no previous work so far has attempted in examining whether other simpler linguistically intuitive or not objectives can be used standalone as main pretraining objectives. In this paper, we explore five simple pretraining objectives based on token-level classification tasks as replacements of MLM. Empirical results on GLUE and SQuAD show that our proposed methods achieve comparable or better performance to MLM using a BERT-BASE architecture. We further validate our methods using smaller models, showing that ... : Accepted at EMNLP 2021 ... Keyword: Artificial Intelligence cs.AI; Computation and Language cs.CL; FOS Computer and information sciences; Machine Learning cs.LG URL: https://arxiv.org/abs/2109.01819 https://dx.doi.org/10.48550/arxiv.2109.01819 BASE Hide details 8 Analyzing Online Political Advertisements ... The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing 2021; Aletras, Nikolaos; Mokaram, Saeid. - : Underline Science Inc., 2021 BASE Show details 9 Improving the Faithfulness of Attention-based Explanations with Task-specific Information for Text Classification ... The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing 2021; Aletras, Nikolaos; Chrysostomou, George. - : Underline Science Inc., 2021 BASE Show details 10 Enjoy the Salience: Towards Better Transformer-based Faithful Explanations with Word Salience ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Aletras, Nikolaos; Chrysostomou, George. - : Underline Science Inc., 2021 BASE Show details 11 Modeling the Severity of Complaints in Social Media ... NAACL 2021 2021; Aletras, Nikolaos; Jin, Mali. - : Underline Science Inc., 2021 BASE Show details 12 Active Learning by Acquiring Contrastive Examples ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Aletras, Nikolaos; Barrault, Loïc. - : Underline Science Inc., 2021 BASE Show details 13 In Factuality: Efficient Integration of Relevant Facts for Visual Question Answering ... The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing 2021; Aletras, Nikolaos; Barrault, Loïc. - : Underline Science Inc., 2021 BASE Show details 14 Frustratingly Simple Pretraining Alternatives to Masked Language Modeling ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Aletras, Nikolaos; Chrysostomou, George. - : Underline Science Inc., 2021 BASE Show details 15 Knowledge Distillation for Quality Estimation ... The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing 2021; Aletras, Nikolaos; Alva-Manchego, Fernando. - : Underline Science Inc., 2021 BASE Show details 16 Machine Extraction of Tax Laws from Legislative Texts Han, Luyang; Guillot, Malka; Ash, Elliott In: Proceedings of the Natural Legal Language Processing Workshop 2021 (2021) BASE Show details 17 Point-of-Interest Type Prediction using Text and Images ... Villegas, Danae Sánchez; Aletras, Nikolaos. - : arXiv, 2021 BASE Show details 18 Point-of-Interest Type Prediction using Text and Images ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Aletras, Nikolaos; Sanchez Villegas, Danae. - : Underline Science Inc., 2021 BASE Show details 19 An Empirical Study on Leveraging Position Embeddings for Target-oriented Opinion Words Extraction ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Aletras, Nikolaos; Mensah, Samuel. - : Underline Science Inc., 2021 BASE Show details 20 Knowledge distillation for quality estimation Gajbhiye, Amit; Fomicheva, Marina; Alva-Manchego, Fernando. - : Association for Computational Linguistics, 2021 BASE Show details Page: 1 2

Mobile view All Catalogues UB Frankfurt Linguistik 0 IDS Mannheim 0 OLC Linguistik 0 UB Frankfurt Retrokatalog 0 DNB Subject Category Language 0 Institut für Empirische Sprachwissenschaft 0 Leibniz-Centre General Linguistics (ZAS) 0 Bibliographies BLLDB 0 BDSL 0 IDS Bibliografie zur deutschen Grammatik 0 IDS Bibliografie zur Gesprächsforschung 0 IDS Konnektoren im Deutschen 0 IDS Präpositionen im Deutschen 0 IDS OBELEX meta 0 MPI-SHH Linguistics Collection 0 MPI for Psycholinguistics 0 Linked Open Data catalogues Annohub 0 Online resources Link directory 0 Journal directory 0 Database directory 0 Dictionary directory 0 Open access documents BASE 28 Linguistik-Repository 0 IDS Publikationsserver 0 Online dissertations 0 Language Description Heritage 0