• Refine your search:
  • 
    Keyword:
    
    • FOS Computer and information sciences (89)
    • 89999 Information and Computing Sciences not elsewhere classified (59)
    • Computation and Language cs.CL (30)
    • Linguistics (12)
    • Computational Linguistics (9)
    • Natural Language Processing (7)
    • 170203 Knowledge Representation and Machine Learning (6)
    • Artificial intelligence (6)
    • FOS Psychology (6)
    • Neural Network (6)
    •   more
  • 
    Creator / Publisher
  • 
    Year
  • 
    Medium
  • 
    Type
  • 
    BLLDB-Access:
    • free (143)
    • subject to license (0)

Search in the Catalogues and Directories

All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year Sort by creator [A → Z]' creator [Z → A]' publishing year ↑ (asc)' publishing year ↓ (desc)' title [A → Z]' title [Z → A]' Simple Search Page: 1 2 3 4 5...8 Hits 1 – 20 of 143 1 WANLI: Worker and AI Collaboration for Natural Language Inference Dataset Creation ... Liu, Alisa; Swayamdipta, Swabha; Smith, Noah A.. - : arXiv, 2022 BASE Show details 2 Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detection ... Sap, Maarten; Swayamdipta, Swabha; Vianna, Laura. - : arXiv, 2021 BASE Show details 3 Probing Across Time: What Does RoBERTa Know and When? ... Liu, Leo Z.; Wang, Yizhong; Kasai, Jungo. - : arXiv, 2021 BASE Show details 4 Specializing Multilingual Language Models: An Empirical Study ... Chau, Ethan C.; Smith, Noah A.. - : arXiv, 2021 BASE Show details 5 Provable Limitations of Acquiring Meaning from Ungrounded Form: What will Future Language Models Understand? ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Goldberg, Yoav; Merrill, William. - : Underline Science Inc., 2021 BASE Show details 6 Finetuning Pretrained Transformers into RNNs ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Chen, Weizhu; Ilharco, Gabriel. - : Underline Science Inc., 2021 BASE Show details 7 Green NLP panel ... The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing 2021; ., Iryna; Arase, Yuki. - : Underline Science Inc., 2021 BASE Show details 8 Sentence Bottleneck Autoencoders from Transformer Language Models ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Montero, Ivan; Pappas, Nikolaos. - : Underline Science Inc., 2021 BASE Show details 9 All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text ... The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing 2021; August, Tal; Clark, Elizabeth. - : Underline Science Inc., 2021 BASE Show details 10 Measuring Association Between Labels and Free-Text Rationales ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Marasovic, Ana; Smith, Noah A.. - : Underline Science Inc., 2021 BASE Show details 11 Promoting Graph Awareness in Linearized Graph-to-Text Generation ... The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing 2021; Hoyle, Alexander; Marasovic, Ana. - : Underline Science Inc., 2021 BASE Show details 12 Shortformer: Better Language Modeling using Shorter Inputs ... The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing 2021; Lewis, Mike; Press, Ofir. - : Underline Science Inc., 2021 BASE Show details 13 DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts ... The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing 2021; Bhagavatula, Chandra; Choi, Yejin. - : Underline Science Inc., 2021 BASE Show details 14 Specializing Multilingual Language Models: An Empirical Study ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Chau, Ethan; Smith, Noah. - : Underline Science Inc., 2021 BASE Show details 15 Challenges in Automated Debiasing for Toxic Language Detection ... Zhou, Xuhui; Sap, Maarten; Swayamdipta, Swabha. - : arXiv, 2021 BASE Show details 16 NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristics ... Lu, Ximing; Welleck, Sean; West, Peter. - : arXiv, 2021 BASE Show details 17 Effects of Parameter Norm Growth During Transformer Training: Inductive Bias from Gradient Descent ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Goldberg, Yoav; Merrill, William; Ramanujan, Vivek; Schwartz, Roy; Smith, Noah A.. - : Underline Science Inc., 2021 Abstract: Anthology paper link: https://aclanthology.org/2021.emnlp-main.133/ Abstract: The capacity of neural networks like the widely adopted transformer is known to be very high. Evidence is emerging that they learn successfully due to inductive bias in the training routine, typically a variant of gradient descent (GD). To better understand this bias, we study the tendency for transformer parameters to grow in magnitude ($\ell_2$ norm) during training, and its implications for the emergent representations within self attention layers. Empirically, we document norm growth in the training of transformer language models, including T5 during its pretraining. As the parameters grow in magnitude, we prove that the network approximates a discretized network with saturated activation functions. Such "saturated" networks are known to have a reduced capacity compared to the full network family that can be described in terms of formal languages and automata. Our results suggest saturation is a new characterization of an ... Keyword: Language Models; Natural Language Processing; Semantic Evaluation; Sociolinguistics URL: https://underline.io/lecture/37533-effects-of-parameter-norm-growth-during-transformer-training-inductive-bias-from-gradient-descent https://dx.doi.org/10.48448/2yr8-q466 BASE Hide details 18 Competency Problems: On Finding and Removing Artifacts in Language Data ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Dodge, Jesse; Gardner, Matt. - : Underline Science Inc., 2021 BASE Show details 19 Infusing Finetuning with Semantic Dependencies ... The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing 2021; Peng, Hao; Smith, Noah. - : Underline Science Inc., 2021 BASE Show details 20 Extracting and Inferring Personal Attributes from Dialogue Wang, Zhilin. - 2021 BASE Show details Page: 1 2 3 4 5...8

Mobile view All Catalogues UB Frankfurt Linguistik 0 IDS Mannheim 0 OLC Linguistik 4 UB Frankfurt Retrokatalog 0 DNB Subject Category Language 0 Institut für Empirische Sprachwissenschaft 0 Leibniz-Centre General Linguistics (ZAS) 0 Bibliographies BLLDB 7 BDSL 0 IDS Bibliografie zur deutschen Grammatik 0 IDS Bibliografie zur Gesprächsforschung 0 IDS Konnektoren im Deutschen 0 IDS Präpositionen im Deutschen 0 IDS OBELEX meta 0 MPI-SHH Linguistics Collection 0 MPI for Psycholinguistics 0 Linked Open Data catalogues Annohub 0 Online resources Link directory 0 Journal directory 0 Database directory 0 Dictionary directory 0 Open access documents BASE 135 Linguistik-Repository 0 IDS Publikationsserver 0 Online dissertations 0 Language Description Heritage 0