2 |
The Role of Surface and Underlying Forms When Processing Tonal Alternations in Mandarin Chinese: A Mismatch Negativity Study
|
|
|
|
BASE
|
|
Show details
|
|
3 |
ADFAC: Automatic detection of facial articulatory features
|
|
|
|
In: MethodsX (2020)
|
|
Abstract:
Using computer-vision and image processing techniques, we aim to identify specific visual cues as induced by facial movements made during monosyllabic speech production. The method is named ADFAC: Automatic Detection of Facial Articulatory Cues. Four facial points of interest were detected automatically to represent head, eyebrow and lip movements: nose tip (proxy for head movement), medial point of left eyebrow, and midpoints of the upper and lower lips. The detected points were then automatically tracked in the subsequent video frames. Critical features such as the distance, velocity, and acceleration describing local facial movements with respect to the resting face of each speaker were extracted from the positional profiles of each tracked point. In this work, a variant of random forest is proposed to determine which facial features are significant in classifying speech sound categories. The method takes in both video and audio as input and extracts features from any video with a plain or simple background. The method is implemented in MATLAB and scripts are made available on GitHub for easy access. • Using innovative computer-vision and image processing techniques to automatically detect and track keypoints on the face during speech production in videos, thus allowing more natural articulation than previous sensor-based approaches. • Measuring multi-dimensional and dynamic facial movements by extracting time-related, distance-related and kinematics-related features in speech production. • Adopting the novel random forest classification approach to determine and rank the significance of facial features toward accurate speech sound categorization.
|
|
Keyword:
Computer Science
|
|
URL: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC7393529/ https://doi.org/10.1016/j.mex.2020.101006
|
|
BASE
|
|
Hide details
|
|
4 |
The Role of Surface and Underlying Forms When Processing Tonal Alternations in Mandarin Chinese: A Mismatch Negativity Study
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Training Children to Perceive Non-native Lexical Tones: Tone Language Background, Bilingualism, and Auditory-Visual Information
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Training children to perceive non-native lexical tones : tone language background, bilingualism, and auditory-visual information
|
|
|
|
BASE
|
|
Show details
|
|
9 |
Cross-modal Association between Auditory and Visuospatial Information in Mandarin Tone Perception in Noise by Native and Non-native Perceivers
|
|
|
|
BASE
|
|
Show details
|
|
10 |
A COMPARATIVE STUDY OF ENGLISH SECOND LANGUAGE READING COMPREHENSION OF A RELIGION-BASED ASSESSMENT IN TWO DIFFERENT LOCATIONAL CONTEXTS
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Cross-modal Association between Auditory and Visuospatial Information in Mandarin Tone Perception in Noise by Native and Non-native Perceivers
|
|
|
|
BASE
|
|
Show details
|
|
13 |
fMRI evidence for cortical modification during learning of Mandarin lexical tone
|
|
|
|
BASE
|
|
Show details
|
|
14 |
Explicit teaching of Japanese mimetic words using voicing, gemintion, and reduplication rules
|
|
|
|
BASE
|
|
Show details
|
|
15 |
THE PHONOGRAPHIC NETWORK OF LANGUAGE: USING NETWORK SCIENCE TO INVESTIGATE THE PHONOLOGICAL AND ORTHOGRAPHIC SIMILARITY STRUCTURE OF LANGUAGE
|
|
|
|
BASE
|
|
Show details
|
|
16 |
Acoustic analyses and perceptual data on anticipatory labial coarticulation in adults and children
|
|
|
|
BASE
|
|
Show details
|
|
17 |
Observing the contribution of both underlying and surface representations: Evidence from priming and event-related potentials
|
|
|
|
BASE
|
|
Show details
|
|
18 |
Acoustic analyses and perceptual data on anticipatory labial coarticulation in adults and children
|
|
|
|
BASE
|
|
Show details
|
|
19 |
Perceptual and production training of intervocalic /d, Q, r/ in American English learners of Spanish
|
|
|
|
BASE
|
|
Show details
|
|
|
|