1 |
Child-directed Listening: How Caregiver Inference Enables Children's Early Verbal Communication ...
|
|
|
|
BASE
|
|
Show details
|
|
2 |
A Targeted Assessment of Incremental Processing in Neural LanguageModels and Humans ...
|
|
|
|
Abstract:
We present a targeted, scaled-up comparison of incremental processing in humans and neural language models by collecting by-word reaction time data for sixteen different syntactic test suites across a range of structural phenomena. Human reaction time data comes from a novel online experimental paradigm called the Interpolated Maze task. We compare human reaction times to by-word probabilities for four contemporary language models, with different architectures and trained on a range of data set sizes. We find that across many phenomena, both humans and language models show increased processing difficulty in ungrammatical sentence regions with human and model `accuracy' scores (a la Marvin and Linzen(2018)) about equal. However, although language model outputs match humans in direction, we show that models systematically under-predict the difference in magnitude of incremental processing difficulty between grammatical and ungrammatical sentences. Specifically, when models encounter syntactic violations they ... : To appear at ACL 2021 ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://arxiv.org/abs/2106.03232 https://dx.doi.org/10.48550/arxiv.2106.03232
|
|
BASE
|
|
Hide details
|
|
4 |
A Systematic Assessment of Syntactic Generalization in Neural Language Models ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|