Home
Catalogue search
Refine your search:
Keyword:
Computational Linguistics (1)
Language Models (1)
Machine Learning (1)
Machine Learning and Data Mining (1)
Natural Language Processing (1)
Creator / Publisher:
Goldberg, Yoav (1)
Linzen, Tal (1)
Prasad, Grusha (1)
Ravfogel, Shauli (1)
The 2021 Conference on Empirical Methods in Natural Language Processing 2021 (1)
Year
Medium
Type
BLLDB-Access:
free (1)
subject to license (0)
Search in the Catalogues and Directories
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
Sort by
creator [A → Z]
'
creator [Z → A]
'
publishing year ↑ (asc)
'
publishing year ↓ (desc)
'
title [A → Z]
'
title [Z → A]
'
Simple Search
Hits 1 – 1 of 1
1
Counterfactual Interventions Reveal the Causal Effect of Relative Clause Representations on Agreement Prediction ...
The 2021 Conference on Empirical Methods in Natural Language Processing 2021
;
Goldberg, Yoav
;
Linzen, Tal
;
Prasad, Grusha
;
Ravfogel, Shauli
. - : Underline Science Inc., 2021
Abstract:
When language models process syntactically complex sentences, do they use their representations of syntax in a manner that is consistent with the grammar of the language? We propose AlterRep, an intervention-based method to address this question. For any linguistic feature of a given sentence, AlterRep generates counterfactual representations by altering how the feature is encoded, while leaving intact all other aspects of the original representation. By measuring the change in a model's word prediction behavior when these counterfactual representations are substituted for the original ones, we can draw conclusions about the causal effect of the linguistic feature in question on the model's behavior. We apply this method to study how BERT models of different sizes process relative clauses (RCs). We find that BERT variants use RC boundary information during word prediction in a manner that is consistent with the rules of English grammar; this RC boundary information generalizes to a considerable extent across ...
Keyword:
Computational Linguistics
;
Language Models
;
Machine Learning
;
Machine Learning and Data Mining
;
Natural Language Processing
URL:
https://dx.doi.org/10.48448/jtvc-kx57
https://underline.io/lecture/39875-counterfactual-interventions-reveal-the-causal-effect-of-relative-clause-representations-on-agreement-prediction
BASE
Hide details
Mobile view
All
Catalogues
UB Frankfurt Linguistik
0
IDS Mannheim
0
OLC Linguistik
0
UB Frankfurt Retrokatalog
0
DNB Subject Category Language
0
Institut für Empirische Sprachwissenschaft
0
Leibniz-Centre General Linguistics (ZAS)
0
Bibliographies
BLLDB
0
BDSL
0
IDS Bibliografie zur deutschen Grammatik
0
IDS Bibliografie zur Gesprächsforschung
0
IDS Konnektoren im Deutschen
0
IDS Präpositionen im Deutschen
0
IDS OBELEX meta
0
MPI-SHH Linguistics Collection
0
MPI for Psycholinguistics
0
Linked Open Data catalogues
Annohub
0
Online resources
Link directory
0
Journal directory
0
Database directory
0
Dictionary directory
0
Open access documents
BASE
1
Linguistik-Repository
0
IDS Publikationsserver
0
Online dissertations
0
Language Description Heritage
0
© 2013 - 2024 Lin|gu|is|tik
|
Imprint
|
Privacy Policy
|
Datenschutzeinstellungen ändern