| 41 |
Visual-tactile integration in speech perception : evidence for modality neutral speech primitives.
|
|
|
|
Abstract:
© 2016 Acoustical Society of America. Audio-visual [McGurk and MacDonald (1976). Nature 264, 746-748] and audio-tactile [Gick and Derrick (2009). Nature 462(7272), 502-504] speech stimuli enhance speech perception over audio stimuli alone. In addition, multimodal speech stimuli form an asymmetric window of integration that is consistent with the relative speeds of the various signals [Munhall, Gribble, Sacco, and Ward (1996). Percept. Psychophys. 58(3), 351-362; Gick, Ikegami, and Derrick (2010). J. Acoust. Soc. Am. 128(5), EL342-EL346]. In this experiment, participants were presented video of faces producing /pa/ and /ba/ syllables, both alone and with air puffs occurring synchronously and at different timings up to 300 ms before and after the stop release. Perceivers were asked to identify the syllable they perceived, and were more likely to respond that they perceived /pa/ when air puffs were present, with asymmetrical preference for puffs following the video signal - consistent with the relative speeds of visual and air puff signals. The results demonstrate that visual-tactile integration of speech perception occurs much as it does with audio-visual and audio-tactile stimuli. This finding contributes to the understanding of multimodal speech perception, lending support to the idea that speech is not perceived as an audio signal that is supplemented by information from other modes, but rather that primitives of speech perception are, in principle, modality neutral.
|
|
Keyword:
communication and culture::4704 - Linguistics::470410 - Phonetics and speech science; Field of Research::17 - Psychology and Cognitive Sciences::1702 - Cognitive Science::170204 - Linguistic Processes (incl. Speech Production and Comprehension); Fields of Research::47 - Language
|
|
URL: https://doi.org/10.1121/1.4965968
http://hdl.handle.net/10092/17682
|
|
BASE
|
|
Hide details
|
|
|
| 42 |
Global Syntactic Variation in Seven Languages: Towards a Computational Dialectology
|
|
|
|
BASE
|
|
Show details
|
|
|
| 43 |
Language-Independent Ensemble Approaches to Metaphor Identification
|
|
|
|
BASE
|
|
Show details
|
|
|
| 44 |
How linguistic structure influences and helps to predict metaphoric meaning
|
|
Dunn J. - : Walter de Gruyter GmbH, 2019
|
|
BASE
|
|
Show details
|
|
|
| 45 |
Modeling Global Syntactic Variation in English Using Dialect Classification
|
|
Dunn J. - : Association for Computational Linguistics, 2019
|
|
BASE
|
|
Show details
|
|
|
| 46 |
Finding variants for construction-based dialectometry: A corpus-based approach to regional CxGs
|
|
Dunn J. - : Walter de Gruyter GmbH, 2019
|
|
BASE
|
|
Show details
|
|
|
| 47 |
Mapping Languages and Demographics with Georeferenced Corpora
|
|
|
|
BASE
|
|
Show details
|
|
|
| 49 |
Exploring the opportunities and challenges of the digital world for early childhood services with vulnerable children
|
|
|
|
BASE
|
|
Show details
|
|
|
| 50 |
A Phonological and Morphological Sketch of Isanzu Lect (Bantu, Tanzania) ; Фонетико-морфологический обзор языка исанзу (банту, Танзания)
|
|
|
|
BASE
|
|
Show details
|
|
|
| 51 |
Professionally-related communication: Sociolinguistic monitoring of most frequently used words of youth sociolect
|
|
|
|
In: IOP Conference Series: Materials Science and Engineering (2019)
|
|
BASE
|
|
Show details
|
|
|
| 52 |
Productivity, influence, and evolution: The complex language shift of Modern Ladino
|
|
|
|
BASE
|
|
Show details
|
|
|
| 53 |
Manuscript of fieldnotes on Azamgarhi language ; Maaz Shaikh Collection
|
|
|
|
BASE
|
|
Show details
|
|
|
| 54 |
Developing a real-time translator from neural signals to text: An articulatory phonetics approach
|
|
|
|
In: Proceedings of the Society for Computation in Linguistics (2019)
|
|
BASE
|
|
Show details
|
|
|
| 55 |
Inpretation of Associative Data as a Methodogical Issue of Psycholinguistics
|
|
|
|
In: Russian journal of linguistics: Vestnik RUDN, Vol 23, Iss 3, Pp 749-761 (2019) (2019)
|
|
BASE
|
|
Show details
|
|
|
| 56 |
Representation of the Verbal Image of Aggression in the Informational Universe of the English-Language Mass Media
|
|
|
|
In: Russian journal of linguistics: Vestnik RUDN, Vol 23, Iss 1, Pp 149-164 (2019) (2019)
|
|
BASE
|
|
Show details
|
|
|
| 57 |
Constructing the global from the local: On the FSP status of keywords in academic discourse
|
|
|
|
In: Linguistica Pragensia, Vol 29, Iss 2, Pp 192-212 (2019) (2019)
|
|
BASE
|
|
Show details
|
|
|
|
|
