Home
Catalogue search
Refine your search:
Keyword
Creator / Publisher:
Saphra, Naomi (10)
Cotterell, Ryan (4)
Pimentel, Tiago (4)
, Martijn (2)
Balazs Scheidler (2)
Beka, Amit (2)
Fischer, Stefan (2)
Gompel, Maarten Van (2)
Lopez, Adam (2)
Sloot, Ko Van Der (2)
more
Year
Medium
Type:
Article (7)
Miscellaneous (2)
Book (1)
BLLDB-Access
Search in the Catalogues and Directories
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
Sort by
creator [A → Z]
'
creator [Z → A]
'
publishing year ↑ (asc)
'
publishing year ↓ (desc)
'
title [A → Z]
'
title [Z → A]
'
Simple Search
Hits 1 – 10 of 10
1
Training dynamics of neural language models ...
Saphra, Naomi
. - : The University of Edinburgh, 2021
Abstract:
Why do artificial neural networks model language so well? We claim that in order to answer this question and understand the biases that lead to such high performing language models---and all models that handle language---we must analyze the training process. For decades, linguists have used the tools of developmental linguistics to study human bias towards linguistic structure. Similarly, we wish to consider a neural network's training dynamics, i.e., the analysis of training in practice and the study of why our optimization methods work when applied. This framing shows us how structural patterns and linguistic properties are gradually built up, revealing more about why LSTM models learn so effectively on language data. To explore these questions, we might be tempted to appropriate methods from developmental linguistics, but we do not wish to make cognitive claims, so we avoid analogizing between human and artificial language learners. We instead use mathematical tools designed for investigating language ...
Keyword:
interpretability
;
NLP
;
training dynamics
URL:
https://dx.doi.org/10.7488/era/1421
https://era.ed.ac.uk/handle/1842/38154
BASE
Hide details
2
A Non-Linear Structural Probe
Pimentel, Tiago
;
Cotterell, Ryan
;
Saphra, Naomi
...
In: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (2021)
BASE
Show details
3
A Non-Linear Structural Probe ...
White, Jennifer C.
;
Pimentel, Tiago
;
Saphra, Naomi
. - : ETH Zurich, 2021
BASE
Show details
4
Training dynamics of neural language models
Saphra, Naomi
. - : The University of Edinburgh, 2021
BASE
Show details
5
Pareto Probing: Trading Off Accuracy for Complexity
Saphra, Naomi
;
Cotterell, Ryan
;
Pimentel, Tiago
...
In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) (2020)
BASE
Show details
6
Pareto Probing: Trading Off Accuracy for Complexity ...
Pimentel, Tiago
;
Saphra, Naomi
;
Williams, Adina
. - : arXiv, 2020
BASE
Show details
7
Understanding Learning Dynamics Of Language Models with SVCCA ...
Saphra, Naomi
;
Lopez, Adam
. - : arXiv, 2018
BASE
Show details
8
Pynlpl: V0.7.7.1 ...
Gompel, Maarten Van
;
Sloot, Ko Van Der
;
Fischer, Stefan
. - : Zenodo, 2016
BASE
Show details
9
Pynlpl: V0.7.7 ...
Gompel, Maarten Van
;
Sloot, Ko Van Der
;
Fischer, Stefan
. - : Zenodo, 2016
BASE
Show details
10
A framework for (under)specifying dependency syntax without overloading annotators ...
Schneider, Nathan
;
O'Connor, Brendan
;
Saphra, Naomi
. - : arXiv, 2013
BASE
Show details
Mobile view
All
Catalogues
UB Frankfurt Linguistik
0
IDS Mannheim
0
OLC Linguistik
0
UB Frankfurt Retrokatalog
0
DNB Subject Category Language
0
Institut für Empirische Sprachwissenschaft
0
Leibniz-Centre General Linguistics (ZAS)
0
Bibliographies
BLLDB
0
BDSL
0
IDS Bibliografie zur deutschen Grammatik
0
IDS Bibliografie zur Gesprächsforschung
0
IDS Konnektoren im Deutschen
0
IDS Präpositionen im Deutschen
0
IDS OBELEX meta
0
MPI-SHH Linguistics Collection
0
MPI for Psycholinguistics
0
Linked Open Data catalogues
Annohub
0
Online resources
Link directory
0
Journal directory
0
Database directory
0
Dictionary directory
0
Open access documents
BASE
10
Linguistik-Repository
0
IDS Publikationsserver
0
Online dissertations
0
Language Description Heritage
0
© 2013 - 2024 Lin|gu|is|tik
|
Imprint
|
Privacy Policy
|
Datenschutzeinstellungen ändern