| 1 |
Analyzing Easy Data Augmentation Techniques for Text Classification
|
|
|
|
BASE
|
|
Show details
|
|
|
| 2 |
Causal Mediation Analysis Reveals Syntactic Agreement Mechanisms in Neural Language Models
|
|
|
|
Abstract:
Targeted syntactic evaluations have demonstrated the ability of language models to perform subject-verb agreement given difficult contexts. Although this is well established, the mechanisms by which neural language models achieve syntactic agreement are still not well understood. As a remedy, this thesis applies causal mediation analysis to pre-trained neural language models to locate model components and discover mechanisms responsible for predicting correctly inflected verbs. In particular, we investigate the magnitude of models’ grammatical inflections preferences, as well as compare which neurons process subject-verb agreement across sentences with different syntactic structures. In our results, we uncover both similarities and differences across architectures and model sizes, and get a glimpse at the within-model mechanisms that produce number agreement. Notably, we learn that larger models do not necessarily learn stronger preferences, we observe two distinct mechanisms for producing subject- verb agreement depending on the syntactic structure of the input sentence, and we find that language models rely on similar sets of neurons when given sentences with similar syntactic structure.
|
|
Keyword:
Linguistics
|
|
URL: https://nrs.harvard.edu/URN-3:HUL.INSTREPOS:37368546
|
|
BASE
|
|
Hide details
|
|
|
| 4 |
UK consensus on pre-clinical vascular cognitive impairment functional outcomes assessment: Questionnaire and workshop proceedings
|
|
|
|
In: J Cereb Blood Flow Metab (2020)
|
|
BASE
|
|
Show details
|
|
|
| 5 |
UK consensus on pre-clinical vascular cognitive impairment functional outcomes assessment : questionnaire and workshop proceedings
|
|
|
|
BASE
|
|
Show details
|
|
|
| 6 |
UK consensus on pre-clinical vascular cognitive impairment functional outcomes assessment: questionnaire and workshop proceedings
|
|
|
|
BASE
|
|
Show details
|
|
|
| 7 |
UK consensus on pre-clinical vascular cognitive impairment functional outcomes assessment: questionnaire and workshop proceedings
|
|
|
|
BASE
|
|
Show details
|
|
|
| 8 |
On Adversarial Removal of Hypothesis-only Bias in Natural Language Inference ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 9 |
On Evaluating the Generalization of LSTM Models in Formal Languages
|
|
|
|
In: Proceedings of the Society for Computation in Linguistics (2019)
|
|
BASE
|
|
Show details
|
|
|
| 10 |
On Evaluating the Generalization of LSTM Models in Formal Languages ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 12 |
A Novel Approach to Dream Content Analysis Reveals Links Between Learning-Related Dream Incorporation and Cognitive Abilities
|
|
|
|
BASE
|
|
Show details
|
|
|
| 13 |
Communication challenges of web development SMEs: The benefits and challenges of organizational tensions
|
|
|
|
BASE
|
|
Show details
|
|
|
| 14 |
A novel approach to dream content analysis reveals links between learning-related dream incorporation and cognitive abilities
|
|
|
|
In: BrainsCAN Publications (2018)
|
|
BASE
|
|
Show details
|
|
|
| 15 |
Sleep spindles and intellectual ability: Epiphenomenon or directly related?
|
|
|
|
In: BrainsCAN Publications (2017)
|
|
BASE
|
|
Show details
|
|
|
| 16 |
Sleep Spindles and Intellectual Ability: Epiphenomenon or Directly Related?
|
|
|
|
In: Anatomy and Cell Biology Publications (2017)
|
|
BASE
|
|
Show details
|
|
|
| 17 |
Student perspectives on using Google Glass recordings to assess their communicative and clinical skills with standardized patients
|
|
|
|
In: Author (2016)
|
|
BASE
|
|
Show details
|
|
|
| 19 |
Spelling of derivational and inflectional suffixes by Greek-speaking children with and without dyslexia
|
|
|
|
In: READING AND WRITING , 27 (2) 337 - 358. (2014) (2014)
|
|
BASE
|
|
Show details
|
|
|
| 20 |
Constructing fictional stories: a study of story narratives by children with autistic spectrum disorder.
|
|
|
|
In: Res Dev Disabil , 35 (10) pp. 2438-2449. (2014) (2014)
|
|
BASE
|
|
Show details
|
|
|
|
|
