| 1 |
Automatic generation of the complete vocal tract shape from the sequence of phonemes to be articulated
|
|
|
|
In: ISSN: 0167-6393 ; EISSN: 1872-7182 ; Speech Communication ; https://hal.univ-lorraine.fr/hal-03650212 ; Speech Communication, Elsevier : North-Holland, 2022, ⟨10.1016/j.specom.2022.04.004⟩ (2022)
|
|
BASE
|
|
Show details
|
|
|
| 2 |
Multimodal dataset of real-time 2D and static 3D MRI of healthy French speakers
|
|
|
|
In: ISSN: 2052-4463 ; EISSN: 2052-4463 ; Scientific Data ; https://hal.archives-ouvertes.fr/hal-03507532 ; Scientific Data , Nature Publishing Group, 2021, 8 (1), pp.258. ⟨10.1038/s41597-021-01041-3⟩ (2021)
|
|
BASE
|
|
Show details
|
|
|
| 3 |
Towards the prediction of the vocal tract shape from the sequence of phonemes to be articulated
|
|
|
|
In: iNTERSPEECH 2021 ; https://hal.inria.fr/hal-03360113 ; iNTERSPEECH 2021, Aug 2021, Brno, Czech Republic (2021)
|
|
Abstract:
International audience ; In this work, we address the prediction of speech articulators' temporal geometric position from the sequence of phonemes to be articulated. We start from a set of real-time MRI sequences uttered by a female French speaker. The contours of five articulators were tracked automatically in each of the frames in the MRI video. Then, we explore the capacity of a bidirectional GRU to correctly predict each articulator's shape and position given the sequence of phonemes and their duration. We propose a 5-fold cross-validation experiment to evaluate the generalization capacity of the model. In a second experiment, we evaluate our model's data efficiency by reducing training data. We evaluate the point-to-point Euclidean distance and the Pearson's correlations along time between the predicted and the target shapes. We also evaluate produced shapes of the critical articulators of specific phonemes. We show that our model can achieve good results with minimal data, producing very realistic vocal tract shapes.
|
|
Keyword:
[INFO]Computer Science [cs]; neural networks; phoneme-to-articulatory; speech production
|
|
URL: https://hal.inria.fr/hal-03360113/file/INTERSPEECH_2021_Phoneme_to_Articulatory.pdf
https://hal.inria.fr/hal-03360113
https://hal.inria.fr/hal-03360113/document
|
|
BASE
|
|
Hide details
|
|
|
|
|
