DE eng

Search in the Catalogues and Directories

Page: 1 2 3 4
Hits 1 – 20 of 75

1
On Homophony and Rényi Entropy ...
BASE
Show details
2
On Homophony and Rényi Entropy ...
BASE
Show details
3
On Homophony and Rényi Entropy ...
BASE
Show details
4
Towards Zero-shot Language Modeling ...
BASE
Show details
5
Differentiable Generative Phonology ...
BASE
Show details
6
Finding Concept-specific Biases in Form--Meaning Associations ...
BASE
Show details
7
Searching for Search Errors in Neural Morphological Inflection ...
BASE
Show details
8
Applying the Transformer to Character-level Transduction ...
Wu, Shijie; Cotterell, Ryan; Hulden, Mans. - : ETH Zurich, 2021
BASE
Show details
9
Quantifying Gender Bias Towards Politicians in Cross-Lingual Language Models ...
BASE
Show details
10
Probing as Quantifying Inductive Bias ...
BASE
Show details
11
Revisiting the Uniform Information Density Hypothesis ...
BASE
Show details
12
Revisiting the Uniform Information Density Hypothesis ...
BASE
Show details
13
Conditional Poisson Stochastic Beams ...
BASE
Show details
14
Examining the Inductive Bias of Neural Language Models with Artificial Languages ...
BASE
Show details
15
Modeling the Unigram Distribution ...
BASE
Show details
16
Language Model Evaluation Beyond Perplexity ...
Abstract: Read paper: https://www.aclanthology.org/2021.acl-long.414 Abstract: We propose an alternate approach to quantifying how well language models learn natural language: we ask how well they match the statistical tendencies of natural language. To answer this question, we analyze whether text generated from language models exhibits the statistical tendencies present in the human-generated text on which they were trained. We provide a framework--paired with significance tests--for evaluating the fit of language models to these trends. We find that neural language models appear to learn only a subset of the tendencies considered, but align much more closely with empirical trends than proposed theoretical distributions (when present). Further, the fit to different distributions is highly-dependent on both model architecture and generation strategy. As concrete examples, text generated under the nucleus sampling scheme adheres more closely to the type--token relationship of natural language than text produced using ...
Keyword: Computational Linguistics; Condensed Matter Physics; Deep Learning; Electromagnetism; FOS Physical sciences; Information and Knowledge Engineering; Neural Network; Semantics
URL: https://underline.io/lecture/25838-language-model-evaluation-beyond-perplexity
https://dx.doi.org/10.48448/jr48-6p89
BASE
Hide details
17
Differentiable Subset Pruning of Transformer Heads ...
BASE
Show details
18
A Bayesian Framework for Information-Theoretic Probing ...
BASE
Show details
19
Classifying Dyads for Militarized Conflict Analysis ...
BASE
Show details
20
Higher-order Derivatives of Weighted Finite-state Machines ...
BASE
Show details

Page: 1 2 3 4

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
75
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern