DE eng

Search in the Catalogues and Directories

Hits 1 – 14 of 14

1
Probing for the Usage of Grammatical Number ...
BASE
Show details
2
On Homophony and Rényi Entropy ...
BASE
Show details
3
Finding Concept-specific Biases in Form--Meaning Associations ...
BASE
Show details
4
Quantifying Gender Bias Towards Politicians in Cross-Lingual Language Models ...
BASE
Show details
5
Revisiting the Uniform Information Density Hypothesis ...
BASE
Show details
6
How (Non-)Optimal is the Lexicon? ...
BASE
Show details
7
Disambiguatory Signals are Stronger in Word-initial Positions ...
BASE
Show details
8
SIGMORPHON 2020 Shared Task 0: Typologically Diverse Morphological Inflection ...
BASE
Show details
9
Information-Theoretic Probing for Linguistic Structure ...
BASE
Show details
10
A Corpus for Large-Scale Phonetic Typology ...
BASE
Show details
11
Phonotactic Complexity and its Trade-offs ...
BASE
Show details
12
Predicting Declension Class from Form and Meaning ...
BASE
Show details
13
Pareto Probing: Trading Off Accuracy for Complexity ...
BASE
Show details
14
A Tale of a Probe and a Parser ...
Abstract: Measuring what linguistic information is encoded in neural models of language has become popular in NLP. Researchers approach this enterprise by training "probes" - supervised models designed to extract linguistic structure from another model's output. One such probe is the structural probe (Hewitt and Manning, 2019), designed to quantify the extent to which syntactic information is encoded in contextualised word representations. The structural probe has a novel design, unattested in the parsing literature, the precise benefit of which is not immediately obvious. To explore whether syntactic probes would do better to make use of existing techniques, we compare the structural probe to a more traditional parser with an identical lightweight parameterisation. The parser outperforms structural probe on UUAS in seven of nine analysed languages, often by a substantial amount (e.g. by 11.1 points in English). Under a second less common metric, however, there is the opposite trend - the structural probe outperforms ...
Keyword: Computation and Language cs.CL; FOS Computer and information sciences
URL: https://arxiv.org/abs/2005.01641
https://dx.doi.org/10.48550/arxiv.2005.01641
BASE
Hide details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
14
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern