DE eng

Search in the Catalogues and Directories

Hits 1 – 5 of 5

1
Masked language models directly encode linguistic uncertainty ...
Jacobs, Cassandra; Hubbard, Ryan J.; Federmeier, Kara D.. - : University of Massachusetts Amherst, 2022
BASE
Show details
2
Masked language models directly encode linguistic uncertainty
In: Proceedings of the Society for Computation in Linguistics (2022)
Abstract: Large language models (LLMs) have recently been used as models of psycholinguistic processing, usually focusing on lexical or syntactic surprisal. However, this approach casts away representations of utterance meaning (e.g., hidden states), which are used by LLMs to predict upcoming words. The present work explores whether hidden state representations of LLMs encode human language processing-relevant uncertainty. We specifically assess this possibility using sentences from Federmeier et al. (2007) that are either strongly or weakly predictive of a final word. Using a machine learning approach, we tested and confirmed that LLMs encode uncertainty in their hidden states.
Keyword: Computational Linguistics; natural language processing; neural network; prediction; psycholinguistics; Psycholinguistics and Neurolinguistics
URL: https://scholarworks.umass.edu/cgi/viewcontent.cgi?article=1237&context=scil
https://scholarworks.umass.edu/scil/vol5/iss1/23
BASE
Hide details
3
Representational Pattern Similarity of Electrical Brain Activity Reveals Rapid and Specific Prediction during Language Comprehension
In: Cereb Cortex (2021)
BASE
Show details
4
Downstream Behavioral and Electrophysiological Consequences of Word Prediction on Recognition Memory
Hubbard, Ryan J.; Rommers, Joost; Jacobs, Cassandra L.. - : Frontiers Media S.A., 2019
BASE
Show details
5
Flexible conceptual combination: Electrophysiological correlates and consequences for associative memory
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
5
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern