| 1 |
Event Structure In Vision And Language
|
|
|
|
In: Publicly Accessible Penn Dissertations (2019)
|
|
Abstract:
Our visual experience is surprisingly rich: We do not only see low-level properties such as colors or contours; we also see events, or what is happening. Within linguistics, the examination of how we talk about events suggests that relatively abstract elements exist in the mind which pertain to the relational structure of events, including general thematic roles (e.g., Agent), Causation, Motion, and Transfer. For example, “Alex gave Jesse flowers” and “Jesse gave Alex flowers” both refer to an event of transfer, with the directionality of the transfer having different social consequences. The goal of the present research is to examine the extent to which abstract event information of this sort (event structure) is generated in visual perceptual processing. Do we perceive this information, just as we do with more ‘traditional’ visual properties like color and shape? In the first study (Chapter 2), I used a novel behavioral paradigm to show that event roles – who is acting on whom – are rapidly and automatically extracted from visual scenes, even when participants are engaged in an orthogonal task, such as color or gender identification. In the second study (Chapter 3), I provided functional magnetic resonance (fMRI) evidence for commonality in content between neural representations elicited by static snapshots of actions and by full, dynamic action sequences. These two studies suggest that relatively abstract representations of events are spontaneously extracted from sparse visual information. In the final study (Chapter 4), I return to language, the initial inspiration for my investigations of events in vision. Here I test the hypothesis that the human brain represents verbs in part via their associated event structures. Using a model of verbs based on event-structure semantic features (e.g., Cause, Motion, Transfer), it was possible to successfully predict fMRI responses in language-selective brain regions as people engaged in real-time comprehension of naturalistic speech. Taken together, my research reveals that in both perception and language, the mind rapidly constructs a representation of the world that includes events with relational structure.
|
|
Keyword:
action recognition; Cognitive Psychology; event perception; fMRI; Linguistics; Neuroscience and Neurobiology; semantic structure; thematic roles; visual perception
|
|
URL: https://repository.upenn.edu/cgi/viewcontent.cgi?article=5004&context=edissertations
https://repository.upenn.edu/edissertations/3218
|
|
BASE
|
|
Hide details
|
|
|
| 2 |
The Dynamic Role of Subphonemic Cues in Speech Perception: Investigating Coarticulatory Processing Across Sound Classes
|
|
|
|
BASE
|
|
Show details
|
|
|
| 3 |
Receptive Vocabulary Knowledge in Low-Functioning Autism as Assessed by Eye Movements, Pupillary Dilation, and Event-Related Potentials
|
|
|
|
In: DTIC (2011)
|
|
BASE
|
|
Show details
|
|
|
| 4 |
Improving Information Extraction and Translation Using Component Interactions
|
|
|
|
In: DTIC (2008)
|
|
BASE
|
|
Show details
|
|
|
| 5 |
Entropy Based Classifier Combination for Sentence Segmentation
|
|
|
|
In: DTIC (2007)
|
|
BASE
|
|
Show details
|
|
|
| 6 |
The ICSI+ Multilingual Sentence Segmentation System
|
|
|
|
In: DTIC (2006)
|
|
BASE
|
|
Show details
|
|
|
| 7 |
Not every pseudoword disrupts word recognition: an ERP study
|
|
|
|
BASE
|
|
Show details
|
|
|
| 8 |
Discriminative Slot Detection Using Kernel Methods
|
|
|
|
In: DTIC (2004)
|
|
BASE
|
|
Show details
|
|
|
|
|
