1 |
Event integration mechanisms across languages and their psychological reality
|
|
|
|
In: 15th International Cognitive Linguistics Conference: "Crosslinguistic Perspectives on Cognitive Linguistics" ; https://hal.archives-ouvertes.fr/hal-02277569 ; 15th International Cognitive Linguistics Conference: "Crosslinguistic Perspectives on Cognitive Linguistics", Aug 2019, Nishinomiya, Japan ; https://iclc2019.site (2019)
|
|
Abstract:
International audience ; Two different modes of visual attention are recognized in visual cognition research: (a) an early ambient mode of processing; and (b) a late focal mode –the former associated with bottom-up mechanisms guided by low-level perceptual saliency features (i.e. configuration), and the latter related to top-down processing, based on high-level (i.e. contextual) information and depending on knowledge-based features such as semantic schemas, content, co-occurrence of objects in a scene etc. (Pannasch & Velichkovsky 2009). Knowledge-based information can be related to the linguistic knowledge of the viewers. More specifically, in the domain of motion event encoding, speakers’ knowledge depends on how available spatial components (e.g. Path, Manner) are in a language and how they combine into semantic schemas to form constrained spatial arrangements (Talmy 2006). Each language has a relatively closed set of ‘pre-packaged’ schemas and focuses differently on the core schema (i.e. the Path a Figure follows in a displacement): some (i.e. French) lexicalize the core schema in the main verb; others (i.e. English) express it in the periphery of the sentence. Many psycholinguistic studies (e.g. Papafragou et al. 2008) suggest that such language differences are only surface differences that cannot influence visual processing of events (unless only momentarily). According to these authors, gaze behaviour can change due to momentary top-down language effects when people prepare to speak, but language interference, if any, occurs late in the viewing process and is therefore considered to be superficial. For others, language effects do not only occur in verbal behaviour but extend to non-verbal behaviours such as eye movements (cf. Soroli et al. 2019 for a review) and have an early effect on low-level processing (Meteyard et al. 2007). Using verbal (production) and non-verbal measures (eye tracking), we investigated how speakers of two typologically different languages (English, French) perceive motion events visually and describe them verbally. Assuming that language can only have superficial effects that occur late during processing, no language differences should be found during the first stages of visual exploration. If, on the other hand, language has deeper psychological reality, then differences should be found not only during late exploration and verbalization but also during early/low-level scene viewing. The verbal measures confirmed the typological differences across the groups: English speakers systematically encoded Path in peripheral devices and lexicalized Manner in the verb; French speakers preferred to lexicalize Path downplaying details related to Manner. With respect to eye movements, the participants of the two groups explored the scenes very differently: while both groups showed higher proportion of focal than ambient fixations, short saccades and long smooth pursuits were more frequent in the English data compared with the French participants who opted for ambient gazes with higher proportions of large saccade amplitudes at the earliest stages of visual exploration. The findings suggest that both verbal encoding and event perception can be affected to a great extent by language-specific features. Typological properties are not just surface forms that merely emerge in verbal behavior: They leave traces at the earliest stages of cognitive processing and thus have a psychological reality that should not be ignored. ReferencesMeteyard, L., Bahrami, B. & Vigliocco, G. (2007). Motion detection and motion verbs: language affects low-level visual perception. Psychological Science, 18(11), 1007–1013.Pannasch, S. & Velichkovsky, B. M. (2009). Distractor effect and saccade amplitudes: Further evidence on different modes of processing in free exploration of visual images. Visual Cognition, 17(6–7), 1109–1131.Papafragou, A., Hulbert, J. & Trueswell, J. (2008). Does Language Guide Event Perception? Evidence from Eye Movements. Cognition, 108(1), 155–184.Soroli E., Hickmann M. & Hendriks H. (2019). Casting an eye on motion events: eye tracking and its implications for linguistic typology. In M. Aurnague & D. Stosic (eds.), The semantics of dynamic space in French: Descriptive, experimental and formal studies on motion expression, 249–288. Amsterdam: John Benjamins.Talmy, L. (2006). The fundamental system of spatial schemas in language. In B. Hampe (ed.) From perception to meaning: Image Schemas in Cognitive Linguistics, 199–234. Mouton de Gruyter.
|
|
Keyword:
[SCCO.LING]Cognitive science/Linguistics; [SCCO.PSYC]Cognitive science/Psychology; [SCCO]Cognitive science; [SDV.NEU.SC]Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC]/Cognitive Sciences; [SHS.LANGUE]Humanities and Social Sciences/Linguistics; [SHS.PSY]Humanities and Social Sciences/Psychology; ambient/focal attentional modes; eye movements; language effect; motion event perception
|
|
URL: https://hal.archives-ouvertes.fr/hal-02277569
|
|
BASE
|
|
Hide details
|
|
2 |
Casting an eye on motion events: Eye tracking and its implications for linguistic typology
|
|
|
|
In: The Semantics of Dynamic Space in French: Descriptive, experimental and formal studies on motion expression ; https://hal.archives-ouvertes.fr/hal-02268556 ; In Michel Aurnague & Dejan Stosic (eds.). The Semantics of Dynamic Space in French: Descriptive, experimental and formal studies on motion expression, pp.249-288, 2019 (2019)
|
|
BASE
|
|
Show details
|
|
3 |
Tobii or not Tobii? Assessing the validity of eye tracking data: Challenges and solutions
|
|
|
|
In: Scandinavian Workshop on Applied Eye Tracking (SWAET) ; https://hal.archives-ouvertes.fr/hal-01876773 ; Scandinavian Workshop on Applied Eye Tracking (SWAET), Aug 2018, Frederiksberg, Denmark. pp.7, ⟨10.16910/jemr.11.5⟩ ; https://bop.unibe.ch/JEMR/article/view/SWAET2018-Abstracts (2018)
|
|
BASE
|
|
Show details
|
|
4 |
What can variation tell us about first language acquisition?
|
|
|
|
In: Sources of variations in first language acquisition: Languages, contexts, and learners ; https://halshs.archives-ouvertes.fr/halshs-03107662 ; Sources of variations in first language acquisition: Languages, contexts, and learners, 2018 (2018)
|
|
BASE
|
|
Show details
|
|
5 |
Expressing and categorizing motion in French and English: Verbal and non-verbal cognition across languages
|
|
|
|
In: Motion and Space across Languages ; https://halshs.archives-ouvertes.fr/halshs-01638095 ; Iraide Ibarretxe-Antuñano. Motion and Space across Languages, 59, John Benjamins Publishing Company, pp.61-94, 2017, Human Cognitive Processing, 9789027246752. ⟨10.1075/hcp.59.04hic⟩ ; https://benjamins.com/#catalog/books/hcp.59.04hic/details (2017)
|
|
BASE
|
|
Show details
|
|
6 |
Procès spatiaux causatifs en chinois L2 : entre productions atypiques et idiosyncrasiques
|
|
|
|
In: Analyse des erreurs commises par des Francophones apprenant une langue éloignée ; https://hal.archives-ouvertes.fr/hal-01492361 ; Analyse des erreurs commises par des Francophones apprenant une langue éloignée, Feb 2016, Paris, France (2016)
|
|
BASE
|
|
Show details
|
|
7 |
Conceptualization in process: Motion event processing in English and French
|
|
|
|
In: 3rd AttLis workshop "The Attentive Listener in the Visual World" ; https://halshs.archives-ouvertes.fr/halshs-01293405 ; 3rd AttLis workshop "The Attentive Listener in the Visual World", Mar 2016, Potsdam, Germany ; http://www.uni-potsdam.de/attlis2016/index.html (2016)
|
|
BASE
|
|
Show details
|
|
8 |
Procès spatiaux causatifs en chinois L2 : entre productions atypiques et idiosyncrasiques
|
|
|
|
In: Analyse des erreurs commises par des Francophones apprenant une langue éloignée ; https://hal.archives-ouvertes.fr/hal-01492361 ; Analyse des erreurs commises par des Francophones apprenant une langue éloignée, Feb 2016, Paris, France (2016)
|
|
BASE
|
|
Show details
|
|
9 |
From language acquisition to language pathology: cross-linguistic perspectives
|
|
|
|
In: Neuropsycholinguistic perspectives on language cognition ; https://hal.archives-ouvertes.fr/hal-01337674 ; Corine Astésano & Mélanie Jucla (Eds.). Neuropsycholinguistic perspectives on language cognition, Oxford: Routledge, 2015, 9780815356974 ; https://www.routledge.com/Neuropsycholinguistic-Perspectives-on-Language-Cognition-Essays-in-honour/Astesano-Jucla/p/book/9780815356974 (2015)
|
|
BASE
|
|
Show details
|
|
10 |
Landmark and route knowledge in children's spatial representation of a virtual environment
|
|
|
|
In: ISSN: 1664-1078 ; Frontiers in Psychology ; https://hal.archives-ouvertes.fr/hal-01399481 ; Frontiers in Psychology, Frontiers, 2015, ⟨10.3389/fpsyg.2014.01522⟩ (2015)
|
|
BASE
|
|
Show details
|
|
11 |
L'expression des procès spatiaux causatifs en chinois L2
|
|
|
|
In: AFLICO6 ; https://hal.archives-ouvertes.fr/hal-01492375 ; AFLICO6, May 2015, Grenoble, France (2015)
|
|
BASE
|
|
Show details
|
|
12 |
Motion events in French Sign Language and spoken French acquisition
|
|
|
|
In: ICSLA ; https://hal.archives-ouvertes.fr/hal-01187870 ; ICSLA, Jul 2015, Amsterdam, Netherlands ; http://icsla2015.nl/ (2015)
|
|
BASE
|
|
Show details
|
|
13 |
Acquisition des procès spatiaux causatifs en chinois L2 : problèmes d'encodage chez les apprenants francophones ; 汉语致使运动事件的二语习得: 法文母语学习者的编码问题
|
|
|
|
In: “汉语语法研究与习得——句法和语义”国际研讨会 ; https://hal-inalco.archives-ouvertes.fr/hal-01354954 ; “汉语语法研究与习得——句法和语义”国际研讨会, AREC, Jun 2015, Paris, France (2015)
|
|
BASE
|
|
Show details
|
|
14 |
How language impacts memory of motion events in English and French
|
|
|
|
In: ISSN: 1612-4782 ; EISSN: 1612-4790 ; Cognitive Processing ; https://halshs.archives-ouvertes.fr/halshs-01226096 ; Cognitive Processing, Springer Verlag, 2015, ICSC 2015 - 6th International Conference on Spatial Cognition: Space and Situated Cognition, 16 (1 Supplement), pp.209-213. ⟨10.1007/s10339-015-0696-7⟩ (2015)
|
|
BASE
|
|
Show details
|
|
15 |
How language impacts memory of motion events in English and French
|
|
|
|
In: 6th International Conference on Spatial Cognition: "Space and Situated Cognition" ; https://halshs.archives-ouvertes.fr/halshs-01225950 ; 6th International Conference on Spatial Cognition: "Space and Situated Cognition", Sep 2015, Rome, Italy. ⟨10.1007/s10339-015-0696-7⟩ (2015)
|
|
BASE
|
|
Show details
|
|
16 |
Language effects on spatial cognition? Cross-linguistic evidence and eye-tracking
|
|
|
|
In: NINJAL International Symposium: Typology and Cognition in Motion Event Descriptions ; https://halshs.archives-ouvertes.fr/halshs-01111712 ; NINJAL International Symposium: Typology and Cognition in Motion Event Descriptions, NINJAL, Jan 2015, Tokyo, Japan (2015)
|
|
BASE
|
|
Show details
|
|
17 |
Discourse of children
|
|
|
|
In: International Encyclopedia of Language and Social Interaction ; https://hal.archives-ouvertes.fr/hal-01337652 ; K. Tracy. International Encyclopedia of Language and Social Interaction, John Wiley & Sons, Inc., 2015, ⟨10.1002/9781118611463⟩ (2015)
|
|
BASE
|
|
Show details
|
|
18 |
Finding One’s Path Into Another Language: On the Expression of Boundary Crossing in English Learners of French
|
|
|
|
In: ISSN: 1540-4781 ; The Modern Language Journal ; https://hal.archives-ouvertes.fr/hal-01337597 ; The Modern Language Journal, Heidi Byrnes, 2015, The Language and Thought of Motion in Second Language Speakers, 99 (Issue S1), pp.14-31. ⟨10.1111/j.1540-4781.2015.12176.x⟩ (2015)
|
|
BASE
|
|
Show details
|
|
19 |
L’expression des procès spatiaux causatifs en chinois L2
|
|
|
|
In: Sixième Conférence internationale de l’Association Française de Linguistique Cognitive, Langage, cognition et société ; https://hal.archives-ouvertes.fr/hal-01338859 ; Sixième Conférence internationale de l’Association Française de Linguistique Cognitive, Langage, cognition et société, Université Grenoble 3, May 2015, Grenoble, France (2015)
|
|
BASE
|
|
Show details
|
|
20 |
Time talk in narrative discourse: Evidence from child and adult language acquisition
|
|
|
|
In: Tense, Aspect and Modality: from Sentence Grammar to Discourse Grammar ; https://hal.archives-ouvertes.fr/hal-01337656 ; J. Guéron. Tense, Aspect and Modality: from Sentence Grammar to Discourse Grammar, Oxford University Press, pp.92-120, 2015 (2015)
|
|
BASE
|
|
Show details
|
|
|
|