DE eng

Search in the Catalogues and Directories

Page: 1 2
Hits 1 – 20 of 21

1
Towards Interactive Language Modeling ...
BASE
Show details
2
Language Models Use Monotonicity to Assess NPI Licensing ...
BASE
Show details
3
Language Modelling as a Multi-Task Problem ...
BASE
Show details
4
How BPE Affects Memorization in Transformers ...
BASE
Show details
5
Causal Transformers Perform Below Chance on Recursive Nested Constructions, Unlike Humans ...
BASE
Show details
6
Sparse Interventions in Language Models with Differentiable Masking ...
Abstract: There has been a lot of interest in understanding what information is captured by hidden representations of language models (LMs). Typically, interpretation methods i) do not guarantee that the model actually uses the encoded information, and ii) do not discover small subsets of neurons responsible for a considered phenomenon. Inspired by causal mediation analysis, we propose a method that discovers within a neural LM a small subset of neurons responsible for a particular linguistic phenomenon, i.e., subsets causing a change in the corresponding token emission probabilities. We use a differentiable relaxation to approximately search through the combinatorial space. An $L_0$ regularization term ensures that the search converges to discrete and sparse solutions. We apply our method to analyze subject-verb number agreement and gender bias detection in LSTMs. We observe that it is fast and finds better solutions than the alternative (REINFORCE). Our experiments confirm that each of these phenomenons is mediated ... : 12 pages, 4 figures, 6 tables ...
Keyword: Computation and Language cs.CL; FOS Computer and information sciences; Machine Learning cs.LG
URL: https://arxiv.org/abs/2112.06837
https://dx.doi.org/10.48550/arxiv.2112.06837
BASE
Hide details
7
Language Models Use Monotonicity to Assess NPI Licensing ...
BASE
Show details
8
Generalising to German Plural Noun Classes, from the Perspective of a Recurrent Neural Network ...
BASE
Show details
9
Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little ...
BASE
Show details
10
Mechanisms for Handling Nested Dependencies in Neural-Network Language Models and Humans ...
BASE
Show details
11
Assessing incrementality in sequence-to-sequence models ...
BASE
Show details
12
Compositionality decomposed: how do neural networks generalise? ...
BASE
Show details
13
Formal models of structure building in music, language, and animal song
In: The origins of musicality (Cambridge, 2018), p. 253-286
MPI für Psycholinguistik
Show details
14
Under the Hood: Using Diagnostic Classifiers to Investigate and Improve how Language Models Track Agreement Information ...
BASE
Show details
15
Do Language Models Understand Anything? On the Ability of LSTMs to Understand Negative Polarity Items ...
Jumelet, Jaap; Hupkes, Dieuwke. - : arXiv, 2018
BASE
Show details
16
The time course of verb processing in Dutch sentences
In: Journal of psycholinguistic research. - New York, NY ; London [u.a.] : Springer 38 (2009) 3, 181-199
BLLDB
OLC Linguistik
Show details
17
Auditory Sentence Processing an Introduction
In: Journal of psycholinguistic research. - New York, NY ; London [u.a.] : Springer 38 (2009) 3, 177-180
OLC Linguistik
Show details
18
The Time Course of Verb Processing in Dutch Sentences
BASE
Show details
19
Verbs in spoken sentence processing : unraveling the activation pattern of the matrix verb
Goede, Dieuwke de. - Groningen : Rijksuniversiteit Groningen, 2006
MPI für Psycholinguistik
Show details
20
The time course of verb processing in Dutch sentences
In: http://www.cogsci.northwestern.edu/cogsci2004/papers/paper389.pdf (2004)
BASE
Show details

Page: 1 2

Catalogues
0
0
3
0
0
0
0
Bibliographies
1
0
0
0
0
0
0
0
2
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
16
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern