DE eng

Search in the Catalogues and Directories

Page: 1 2 3 4
Hits 1 – 20 of 78

1
Using deep neural networks to estimate tongue movements from speech face motion
Abstract: This study concludes a tripartite investigation into the indirect visibility of the moving tongue in human speech as reflected in co-occurring changes of the facial surface. We were in particular interested in how the shared information is distributed over the range of contributing frequencies. In the current study we examine the degree to which tongue movements during speech can be reliably estimated from face motion using artificial neural networks. We simultaneously acquired data for both movement types; tongue movements were measured with Electromagnetic Articulography (EMA), face motion with a passive marker-based motion capture system. A multiresolution analysis using wavelets provided the desired decomposition into frequency subbands. In the two earlier studies of the project we established linear and non-linear relations between lingual and facial speech motions, as predicted and compatible with previous research in auditory-visual speech. The results of the current study using a Deep Neural Network (DNN) for prediction show that a substantive amount of variance can be recovered (between 13.9 and 33.2% dependent on the speaker and tongue sensor location). Importantly, however, the recovered variance values and the root mean squared error values of the Euclidean distances between the measured and the predicted tongue trajectories are in the range of the linear estimations of our earlier study.
URL: http://epubs.surrey.ac.uk/841496/1/kroos_et_al_AVSP2017_revised.pdf
BASE
Hide details
2
Using deep neural networks to estimate tongue movements from speech face motion
Kroos, Christian; Bundgaard-Nielsen, Rikke L. (R14172); Best, Catherine T. (R11322). - : Sweden, KTH Royal Institute of Technology, 2017
BASE
Show details
3
Analysis of tongue configuration in multi-speaker, multi-volume MRI data
Hoole, Phil [Verfasser] [Herausgeber]; Wismueller, Axel [Verfasser]; Leinsinger, Gerda [Verfasser]. - Mannheim : Institut für Deutsche Sprache, Bibliothek, 2016
DNB Subject Category Language
Show details
4
Are there compensatory effects in natural speech?
Geumann, Anja [Verfasser]; Kroos, Christian [Verfasser]; Tillmann, Hans G. [Verfasser]. - Mannheim : Institut für Deutsche Sprache, Bibliothek, 2016
DNB Subject Category Language
Show details
5
Consonantal timing and release burst acoustics distinguish multiple coronal stop place distinctions in Wubuy (Australia)
Bundgaard-Nielsen, Rikke L. (R14172); Kroos, Christian; Baker, Brett. - : U.S., Acoustical Society of America, 2016
BASE
Show details
6
Message vs. messenger effects on cross-modal matching for spoken phrases
Kroos, Christian; Fort, M.; Best, C.. - : ISCA, 2015
BASE
Show details
7
Discrimination of Multiple Coronal Stop Contrasts in Wubuy (Australia): A Natural Referent Consonant Account
Baker, B.; Best, C.; Bundgaard-Nielsen, R.. - : Public Library of Science, 2015
BASE
Show details
8
Discrimination of Multiple Coronal Stop Contrasts in Wubuy (Australia): A Natural Referent Consonant Account
Bundgaard-Nielsen, Rikke L.; Baker, Brett J.; Kroos, Christian H.. - : Public Library of Science, 2015
BASE
Show details
9
Message vs. messenger effects on cross-modal matching for spoken phrases
Best, Catherine T. (R11322); Kroos, Christian; Mulak, Karen E. (R18007). - : France, International Speech Communication Association, 2015
BASE
Show details
10
Discrimination of multiple coronal stop contrasts in Wubuy (Australia) : a natural referent consonant account
Bundgaard-Nielsen, Rikke L. (R14172); Baker, Brett; Kroos, Christian (R11604). - : U.S., PLoS, 2015
BASE
Show details
11
Discrimination of multiple coronal stop contrasts in Wubuy (Australia): a natural referent consonant account
Bundgaard-Nielsen, Rikke L.; Baker, Brett J.; Kroos, Christian H.. - : Public Library of Science, 2015
BASE
Show details
12
Singing emotionally: a study of pre-production, production, and post-production facial expressions
Quinto, L.; Thompson, W.; Kroos, Christian. - : Frontiers Research Foundation, 2014
BASE
Show details
13
Singing emotionally : a study of pre-production, production, and post-production facial expressions
Quinto, Lena R; Thompson, William F; Kroos, Christian. - : Frontiers Research Foundation, 2014
BASE
Show details
14
Articulatory basis of the apical/laminal distinction : tongue tip/body coordination in the Wubuy 4-way coronal stop contrast
Best, Catherine T. (R11322); Kroos, Christian (R11604); Bundgaard-Nielsen, Rikke L. (R14172). - : Germany, University of Cologne, 2014
BASE
Show details
15
Exploring nonlinear relationships between speech face motion and tongue movements using Mutual Information
Kroos, Christian; Bundgaard-Nielsen, Rikke L. (R14172); Best, Catherine T. (R11322). - : Germany, International Seminar on Speech Production, 2014
BASE
Show details
16
Evaluation of the measurement precision in three-dimensional electromagnetic articulography (Carstens AG500)
In: Journal of phonetics. - Amsterdam : Elsevier 40 (2012) 3, 453-465
BLLDB
OLC Linguistik
Show details
17
The diffusion of novel signs beyond the dyad
In: Language sciences. - Amsterdam : Elsevier 34 (2012) 5, 583-590
BLLDB
OLC Linguistik
Show details
18
Second language learners' vocabulary expansion is associated with improved second language vowel intelligibility
In: Applied psycholinguistics. - Cambridge [u.a.] : Cambridge Univ. Press 33 (2012) 3, 643-664
BLLDB
OLC Linguistik
Show details
19
The effects of rapidity of fading on communication systems
In: Experimental semiotics (Amsterdam, 2012), p. 101-112
MPI für Psycholinguistik
Show details
20
Now you see it, now you don’t - frequency distribution of articulatory information reflected in speech face motion
Kroos, Christian; Bundgaard-Nielsen, R.; Best, C.. - : Australasian Speech Science and Technology Association (ASSTA), 2012
BASE
Show details

Page: 1 2 3 4

Catalogues
1
0
8
0
3
0
0
Bibliographies
10
0
0
0
0
0
0
0
3
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
59
0
0
1
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern