1 |
Slangvolution: A Causal Analysis of Semantic Change and Frequency Dynamics in Slang ...
|
|
|
|
BASE
|
|
Show details
|
|
2 |
Bird’s Eye: Probing for Linguistic Graph Structures with a Simple Information-Theoretic Approach ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
Bird's Eye: Probing for Linguistic Graph Structures with a Simple Information-Theoretic Approach ...
|
|
|
|
Abstract:
NLP has a rich history of representing our prior understanding of language in the form of graphs. Recent work on analyzing contextualized text representations has focused on hand-designed probe models to understand how and to what extent do these representations encode a particular linguistic phenomenon. However, due to the inter-dependence of various phenomena and randomness of training probe models, detecting how these representations encode the rich information in these linguistic graphs remains a challenging problem. In this paper, we propose a new information-theoretic probe, Bird's Eye, which is a fairly simple probe method for detecting if and how these representations encode the information in these linguistic graphs. Instead of using classifier performance, our probe takes an information-theoretic view of probing and estimates the mutual information between the linguistic graph embedded in a continuous space and the contextualized word representations. Furthermore, we also propose an approach to use ... : Accepted for publication at ACL 2021. This is the camera ready version. Our implementation is available in https://github.com/yifan-h/Graph_Probe-Birds_Eye ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://arxiv.org/abs/2105.02629 https://dx.doi.org/10.48550/arxiv.2105.02629
|
|
BASE
|
|
Hide details
|
|
5 |
Bird’s Eye: Probing for Linguistic Graph Structures with a Simple Information-Theoretic Approach ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
Bird’s Eye: Probing for Linguistic Graph Structures with a Simple Information-Theoretic Approach ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
How Good Is NLP? A Sober Look at NLP Tasks through the Lens of Social Impact ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
How Good Is NLP?A Sober Look at NLP Tasks through the Lens of Social Impact ...
|
|
|
|
BASE
|
|
Show details
|
|
10 |
“Let Your Characters Tell Their Story”: A Dataset for Character-Centric Narrative Understanding ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Efficient Text-based Reinforcement Learning by Jointly Leveraging State and Commonsense Graph Representations ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
Efficient Text-based Reinforcement Learning by Jointly Leveraging State and Commonsense Graph Representations ...
|
|
|
|
BASE
|
|
Show details
|
|
15 |
Causal Direction of Data Collection Matters: Implications of Causal and Anticausal Learning for NLP
|
|
|
|
In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (2021)
|
|
BASE
|
|
Show details
|
|
16 |
How Good Is NLP?A Sober Look at NLP Tasks through the Lens of Social Impact
|
|
|
|
In: Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 (2021)
|
|
BASE
|
|
Show details
|
|
17 |
Differentiable subset pruning of transformer heads
|
|
|
|
In: Transactions of the Association for Computational Linguistics, 9 (2021)
|
|
BASE
|
|
Show details
|
|
18 |
Scaling Within Document Coreference to Long Texts
|
|
|
|
In: Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 (2021)
|
|
BASE
|
|
Show details
|
|
19 |
“Let Your Characters Tell Their Story”: A Dataset for Character-Centric Narrative Understanding
|
|
|
|
In: Findings of the Association for Computational Linguistics: EMNLP 2021 (2021)
|
|
BASE
|
|
Show details
|
|
20 |
Efficient Text-based Reinforcement Learning by Jointly Leveraging State and Commonsense Graph Representations
|
|
|
|
In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (2021)
|
|
BASE
|
|
Show details
|
|
|
|