DE eng

Search in the Catalogues and Directories

Hits 1 – 3 of 3

1
Contrastive Explanations for Model Interpretability ...
BASE
Show details
2
Amnesic Probing: Behavioral Explanation With Amnesic Counterfactuals ...
BASE
Show details
3
Amnesic Probing: Behavioral Explanation with Amnesic Counterfactuals ...
Abstract: A growing body of work makes use of probing to investigate the working of neural models, often considered black boxes. Recently, an ongoing debate emerged surrounding the limitations of the probing paradigm. In this work, we point out the inability to infer behavioral conclusions from probing results and offer an alternative method that focuses on how the information is being used, rather than on what information is encoded. Our method, Amnesic Probing, follows the intuition that the utility of a property for a given task can be assessed by measuring the influence of a causal intervention that removes it from the representation. Equipped with this new analysis tool, we can ask questions that were not possible before, e.g. is part-of-speech information important for word prediction? We perform a series of analyses on BERT to answer these types of questions. Our findings demonstrate that conventional probing performance is not correlated to task importance, and we call for increased scrutiny of claims that ... : TACL journal. Initial title was: "When Bert Forgets How To POS: Amnesic Probing of Linguistic Properties and MLM Predictions" ...
Keyword: Computation and Language cs.CL; FOS Computer and information sciences
URL: https://arxiv.org/abs/2006.00995
https://dx.doi.org/10.48550/arxiv.2006.00995
BASE
Hide details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
3
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern