DE eng

Search in the Catalogues and Directories

Hits 1 – 2 of 2

1
Multimodal semantic revision during inferential processing: The role of inhibitory control in text and picture comprehension. ...
Pérez, A; Schmidt, E; Kourtzi, Zoe. - : Apollo - University of Cambridge Repository, 2020
BASE
Show details
2
Multimodal semantic revision during inferential processing: The role of inhibitory control in text and picture comprehension.
Pérez, A; Schmidt, E; Kourtzi, Zoe; Tsimpli, Ianthi. - : Elsevier BV, 2020. : Neuropsychologia, 2020
Abstract: Although language comprehension usually requires multimodal information, no study to date has investigated how comprehenders deal with the revision of a text's interpretation when different modalities are involved. Twenty-four young adults listened to a story prompting an inference (e.g., polar bear), and then saw a picture that was either consistent (polar bear) or inconsistent but still plausible (penguin). Larger negativity (N400) in the inconsistent picture indicated successful inferential monitoring. Subsequently, a sentence carried the disambiguating word which was either expected ("bear") or unexpected ("penguin") in relation to the auditory-verbal information. Larger negativity in the unexpected word coming from the consistent picture suggested that comprehenders had difficulties selecting the unexpected concept when previous information was contradictory. More importantly, this effect was modulated by inhibitory control, where a higher resistance to distractor interference (flanker task) was associated with a better ability to suppress pictorial information, therefore preventing semantic competition. Similarly, accuracy measured in a final comprehension question demonstrated that higher inhibitory control was related to a more efficient ability to revise the situation model across modalities. Our findings speak to a relationship between story comprehension and mental flexibility during multimodal processing.
Keyword: Adult; Attention; Comprehension; Electroencephalography; Evoked Potentials; Executive Function; Female; Humans; Inhibition; Male; Pattern Recognition; Psychological; Semantics; Speech Perception; Thinking; Visual; Young Adult
URL: https://doi.org/10.17863/CAM.50868
https://www.repository.cam.ac.uk/handle/1810/303788
BASE
Hide details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
2
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern