DE eng

Search in the Catalogues and Directories

Hits 1 – 12 of 12

1
Towards Interactive Language Modeling ...
BASE
Show details
2
Language Models Use Monotonicity to Assess NPI Licensing ...
BASE
Show details
3
Language Modelling as a Multi-Task Problem ...
BASE
Show details
4
How BPE Affects Memorization in Transformers ...
BASE
Show details
5
Causal Transformers Perform Below Chance on Recursive Nested Constructions, Unlike Humans ...
BASE
Show details
6
Sparse Interventions in Language Models with Differentiable Masking ...
BASE
Show details
7
Mechanisms for Handling Nested Dependencies in Neural-Network Language Models and Humans ...
Abstract: Recursive processing in sentence comprehension is considered a hallmark of human linguistic abilities. However, its underlying neural mechanisms remain largely unknown. We studied whether a modern artificial neural network trained with "deep learning" methods mimics a central aspect of human sentence processing, namely the storing of grammatical number and gender information in working memory and its use in long-distance agreement (e.g., capturing the correct number agreement between subject and verb when they are separated by other phrases). Although the network, a recurrent architecture with Long Short-Term Memory units, was solely trained to predict the next word in a large corpus, analysis showed the emergence of a very sparse set of specialized units that successfully handled local and long-distance syntactic agreement for grammatical number. However, the simulations also showed that this mechanism does not support full recursion and fails with some long-range embedded dependencies. We tested the ...
Keyword: Computation and Language cs.CL; FOS Computer and information sciences
URL: https://arxiv.org/abs/2006.11098
https://dx.doi.org/10.48550/arxiv.2006.11098
BASE
Hide details
8
Assessing incrementality in sequence-to-sequence models ...
BASE
Show details
9
Compositionality decomposed: how do neural networks generalise? ...
BASE
Show details
10
Formal models of structure building in music, language, and animal song
In: The origins of musicality (Cambridge, 2018), p. 253-286
MPI für Psycholinguistik
Show details
11
Under the Hood: Using Diagnostic Classifiers to Investigate and Improve how Language Models Track Agreement Information ...
BASE
Show details
12
Do Language Models Understand Anything? On the Ability of LSTMs to Understand Negative Polarity Items ...
Jumelet, Jaap; Hupkes, Dieuwke. - : arXiv, 2018
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
1
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
11
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern