| 1 |
Spat~ : a comprehensive toolbox for sound spatialization in Max
|
|
|
|
In: ISSN: 2317-9694 ; Ideas Sonicas ; https://hal.archives-ouvertes.fr/hal-03356292 ; Ideas Sonicas, João Pedro Oliveira, 2021, Electroacoustic Space - Reflections - Tools for its design, 13 (24), pp.12 - 23 ; http://sonicideas.org (2021)
|
|
BASE
|
|
Show details
|
|
|
| 2 |
Re-synchronization using the Hand Preceding Model for Multi-modal Fusion in Automatic Continuous Cued Speech Recognition
|
|
|
|
In: ISSN: 1520-9210 ; IEEE Transactions on Multimedia ; https://hal.archives-ouvertes.fr/hal-02433830 ; IEEE Transactions on Multimedia, Institute of Electrical and Electronics Engineers, 2021, 23, pp.292-305. ⟨10.1109/TMM.2020.2976493⟩ (2021)
|
|
Abstract:
International audience ; Cued Speech (CS) is an augmented lip reading complemented by hand coding, and it is very helpful to the deaf people. Automatic CS recognition can help communications between the deaf people and others. Due to the asynchronous nature of lips and hand movements, fusion of them in automatic CS recognition is a challenging problem. In this work, we propose a novel re-synchronization procedure for multi-modal fusion, which aligns the hand features with lips feature. It is realized by delaying hand position and hand shape with their optimal hand preceding time which is derived by investigating the temporal organizations of hand position and hand shape movements in CS. This re-synchronization procedure is incorporated into a practical continuous CS recognition system that combines convolutional neural network (CNN) with multi-stream hidden markov model (MSHMM). A significant improvement of about 4.6% has been achieved retaining 76.6% CS phoneme recognition correctness compared with the state-of-the-art architecture (72.04%), which did not take into account the asynchrony issue of multi-modal fusion in CS. To our knowledge, this is the first work to tackle the asynchronous multi-modal fusion in the automatic continuous CS recognition.
|
|
Keyword:
[SPI.ACOU]Engineering Sciences [physics]/Acoustics [physics.class-ph]; [SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processing; Automatic CS recognition; CNN; Index Terms-Cued Speech; MSHMM; Multi-modal fusion; Re- synchronization procedure
|
|
URL: https://hal.archives-ouvertes.fr/hal-02433830
https://hal.archives-ouvertes.fr/hal-02433830/file/A%20New%20Re-synchronization%20Method%20based%20Multi-modal%20Fusion%20for%20Automatic%20Continuous%20Cued%20Speech%20Recognition.pdf
https://hal.archives-ouvertes.fr/hal-02433830/document
https://doi.org/10.1109/TMM.2020.2976493
|
|
BASE
|
|
Hide details
|
|
|
| 3 |
Human Beatbox: from extreme use of voice and speech to its use in speech therapy ; Le Human Beatbox : d’une utilisation extrême de la voix et de la parole à son utilité en orthophonie
|
|
|
|
In: ISSN: 0034-222X ; Rééducation orthophonique ; https://hal.archives-ouvertes.fr/hal-03377693 ; Rééducation orthophonique, Ortho édition, 2021, Rééducation orthophonique n°286 - Les phonations : sur la voie des voix, 286 ; https://www.orthoedition.com/revues/n-les-phonations-sur-la-voie-des-voix-4341.html (2021)
|
|
BASE
|
|
Show details
|
|
|
| 4 |
Relationship between phoneme-level spectral acoustics and speech intelligibility in healthy speech: a systematic review
|
|
|
|
In: ISSN: 1092-4388 ; EISSN: 1558-9102 ; Journal of Speech, Language, and Hearing Research ; https://hal.archives-ouvertes.fr/hal-03543196 ; Journal of Speech, Language, and Hearing Research, American Speech-Language-Hearing Association, 2021, In a new world of research, what do we already know? Systematic and scoping reviews in Speech, Language and Hearing, 24 (2), pp.105 - 132. ⟨10.1080/2050571x.2021.1913300⟩ ; https://www.tandfonline.com/doi/abs/10.1080/2050571X.2021.1913300?journalCode=yslh20 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 5 |
Clinical characteristics of singers attending a phoniatric outpatient clinic
|
|
|
|
In: ISSN: 1401-5439 ; Logopedics Phoniatrics Vocology ; https://hal.archives-ouvertes.fr/hal-03269924 ; Logopedics Phoniatrics Vocology, Taylor & Francis, 2021, pp.1-10. ⟨10.1080/14015439.2021.1924853⟩ (2021)
|
|
BASE
|
|
Show details
|
|
|
| 6 |
La voce umana, dal respiro al canto
|
|
|
|
In: ISSN: 2611-5689 ; Bollettino del Laboratorio di Fonetica Sperimentale "Arturo Genre" ; https://hal.archives-ouvertes.fr/hal-03508030 ; Bollettino del Laboratorio di Fonetica Sperimentale "Arturo Genre", Universita di Torino, 2021, https://www.lfsag.unito.it/ricerca/phonews/07/7_3.pdf ; https://www.lfsag.unito.it/ricerca/phonews/index.html (2021)
|
|
BASE
|
|
Show details
|
|
|
| 7 |
Vocal drum sounds in human beatboxing: An acoustic and articulatory exploration using electromagnetic articulography
|
|
|
|
In: ISSN: 0001-4966 ; EISSN: 1520-8524 ; Journal of the Acoustical Society of America ; https://hal.univ-grenoble-alpes.fr/hal-03107358 ; Journal of the Acoustical Society of America, Acoustical Society of America, 2021, 149 (1), pp.191-206. ⟨10.1121/10.0002921⟩ ; https://asa.scitation.org/doi/full/10.1121/10.0002921 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 8 |
Communiquer et enseigner avec un masque : réflexions scientifiques et cliniques
|
|
|
|
In: UPLF Info ; https://hal.archives-ouvertes.fr/hal-03305166 ; UPLF Info, UPLF, 2021, pp.19-27 ; http://hdl.handle.net/2268/259278 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 9 |
Automatic music analysis and "Musée de l'Homme" sound archives ; L'analyse automatique de la musique et les archives sonores du "Musée de l'Homme"
|
|
|
|
In: Analytical Approaches To World Music 2020-2021 ; https://halshs.archives-ouvertes.fr/halshs-03472999 ; Analytical Approaches To World Music 2020-2021, Jun 2021, Paris, France. 2021 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 10 |
Automatic music analysis and "Musée de l'Homme" sound archives ; L'analyse automatique de la musique et les archives sonores du "Musée de l'Homme"
|
|
|
|
In: Analytical Approaches To World Music ; https://halshs.archives-ouvertes.fr/halshs-03472999 ; Analytical Approaches To World Music, Jun 2021, Paris, France. 2021 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 11 |
Le principe de l'analyse spectrale
|
|
|
|
In: La voix : anatomie, physiologie et explorations ; https://hal.archives-ouvertes.fr/hal-03383706 ; A. Giovanni. La voix : anatomie, physiologie et explorations, deboeck supérieur, pp.134-144, 2021, 978-2-807-32492-3 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 12 |
L'amplitude du signal sonore
|
|
|
|
In: La voix : anatomie, physiologie et explorations ; https://hal.archives-ouvertes.fr/hal-03383671 ; A. Giovanni. La voix : anatomie, physiologie et explorations, deboeck supérieur, pp.107-116, 2021, 978-2-807-32492-3 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 13 |
Les mesures de signal sur bruit
|
|
|
|
In: La voix : anatomie, physiologie et explorations ; https://hal.archives-ouvertes.fr/hal-03383716 ; A. Giovanni. La voix : anatomie, physiologie et explorations, deboeck supérieur, pp.145-152, 2021, 978-2-807-32492-3 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 14 |
Les mesures d'instabilité du signal vocal
|
|
|
|
In: La voix : anatomie, physiologie et explorations ; https://hal.archives-ouvertes.fr/hal-03383701 ; A. Giovanni. La voix : anatomie, physiologie et explorations, deboeck supérieur, pp.126-133, 2021, 978-2-807-32492-3 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 15 |
A quoi sert l'analyse cepstrale ?
|
|
|
|
In: La voix : anatomie, physiologie et explorations ; https://hal.archives-ouvertes.fr/hal-03383721 ; A. Giovanni. La voix : anatomie, physiologie et explorations, deboeck supérieur, pp.153-158, 2021, 978-2-807-32492-3 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 16 |
Qu'est-ce que le signal vocal ?
|
|
|
|
In: La voix : anatomie, physiologie et explorations ; https://hal.archives-ouvertes.fr/hal-03383652 ; A. Giovanni. La voix : anatomie, physiologie et explorations, deboeck supérieur, pp.101-106, 2021, 978-2-807-32492-3 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 17 |
La fréquence du signal sonore
|
|
|
|
In: La voix : anatomie, physiologie et explorations ; https://hal.archives-ouvertes.fr/hal-03383686 ; A. Giovanni. La voix : anatomie, physiologie et explorations, deboeck supérieur, pp.117-125, 2021, 978-2-807-32492-3 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 18 |
Humming beatboxing : the vocal orchestra within
|
|
|
|
In: MAVEBA 2021 - 12th International Workshop Models and Analysis of Vocal Emissions for Biomedical Applications ; https://hal.archives-ouvertes.fr/hal-03510719 ; MAVEBA 2021 - 12th International Workshop Models and Analysis of Vocal Emissions for Biomedical Applications, Universita Degli Studi Firenze, Dec 2021, Florence, Italy ; http://maveba.dinfo.unifi.it (2021)
|
|
BASE
|
|
Show details
|
|
|
| 19 |
La voix, un instrument de timbre ; La voix, un instrument de timbre: Comment joue-t-on du timbre vocal ?
|
|
|
|
In: ISSN: 1662-372X ; EISSN: 2235-7688 ; Cahiers d'ethnomusicologie ; https://hal.archives-ouvertes.fr/hal-03508088 ; Cahiers d'ethnomusicologie, Ateliers d'ethnomusicologie, 2021, 34 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 20 |
Mechanism subvariations and their importance in the search for the Mix
|
|
|
|
In: La Voce Artistica 2021 - 13 Corzo Internationale Foniatria et Logopedia ; https://hal.archives-ouvertes.fr/hal-03512230 ; La Voce Artistica 2021 - 13 Corzo Internationale Foniatria et Logopedia, Nov 2021, Ravenna, Italy (2021)
|
|
BASE
|
|
Show details
|
|
|
|
|
