1 |
RETRIEVING SPEAKER INFORMATION FROM PERSONALIZED ACOUSTIC MODELS FOR SPEECH RECOGNITION
|
|
|
|
In: IEEE ICASSP 2022 ; https://hal.archives-ouvertes.fr/hal-03539741 ; IEEE ICASSP 2022, 2022, Singapour, Singapore (2022)
|
|
Abstract:
International audience ; The widespread of powerful personal devices capable of collecting voice of their users has opened the opportunity to build speaker adapted speech recognition system (ASR) or to participate to collaborative learning of ASR. In both cases, personalized acoustic models (AM), i.e. fine-tuned AM with specific speaker data, can be built. A question that naturally arises is whether the dissemination of personalized acoustic models can leak personal information. In this paper, we show that it is possible to retrieve the gender of the speaker, but also his identity, by just exploiting the weight matrix changes of a neural acoustic model locally adapted to this speaker. Incidentally we observe phenomena that may be useful towards explainability of deep neural networks in the context of speech processing. Gender can be identified almost surely using only the first layers and speaker verification performs well when using middle-up layers. Our experimental study on the TED-LIUM 3 dataset with HMM/TDNN models shows an accuracy of 95% for gender detection, and an Equal Error Rate of 9.07% for a speaker verification task by only exploiting the weights from personalized models that could be exchanged instead of user data.
|
|
Keyword:
[INFO.INFO-CL]Computer Science [cs]/Computation and Language [cs.CL]; acoustic model; Automatic speech recognition; collaborative learning; personalized acoustic models; speaker information
|
|
URL: https://hal.archives-ouvertes.fr/hal-03539741 https://hal.archives-ouvertes.fr/hal-03539741/document https://hal.archives-ouvertes.fr/hal-03539741/file/ICASSP_2022_SpeakerAnalysisInfoPrivacyVF.pdf
|
|
BASE
|
|
Hide details
|
|
2 |
An Overview of Indian Spoken Language Recognition from Machine Learning Perspective
|
|
|
|
In: ISSN: 2375-4699 ; EISSN: 2375-4702 ; ACM Transactions on Asian and Low-Resource Language Information Processing ; https://hal.inria.fr/hal-03616853 ; ACM Transactions on Asian and Low-Resource Language Information Processing, ACM, In press, ⟨10.1145/3523179⟩ (2022)
|
|
BASE
|
|
Show details
|
|
3 |
One model for the learning of language.
|
|
|
|
In: Proceedings of the National Academy of Sciences of the United States of America, vol 119, iss 5 (2022)
|
|
BASE
|
|
Show details
|
|
4 |
Thirty Years of Machine Translation in Language Teaching and Learning: A Review of the Literature
|
|
|
|
In: L2 Journal, vol 14, iss 1 (2022)
|
|
BASE
|
|
Show details
|
|
5 |
Assessing the impact of OCR noise on multilingual event detection over digitised documents
|
|
|
|
In: ISSN: 1432-5012 ; EISSN: 1432-1300 ; International Journal on Digital Libraries ; https://hal.archives-ouvertes.fr/hal-03635985 ; International Journal on Digital Libraries, Springer Verlag, 2022, ⟨10.1007/s00799-022-00325-2⟩ (2022)
|
|
BASE
|
|
Show details
|
|
6 |
MAGIC DUST FOR CROSS-LINGUAL ADAPTATION OF MONOLINGUAL WAV2VEC-2.0
|
|
|
|
In: ICASSP 2022 ; https://hal.archives-ouvertes.fr/hal-03544515 ; ICASSP 2022, May 2022, Singapour, Singapore (2022)
|
|
BASE
|
|
Show details
|
|
7 |
Introducing the HIPE 2022 Shared Task: Named Entity Recognition and Linking in Multilingual Historical Documents
|
|
|
|
In: Advances in Information Retrieval. 44th European Conference on IR Research, ECIR 2022, Stavanger, Norway, April 10–14, 2022, Proceedings, Part II ; https://hal.archives-ouvertes.fr/hal-03635971 ; Matthias Hagen; Suzan Verberne; Craig Macdonald; Christin Seifert; Krisztian Balog; Kjetil Nørvåg; Vinay Setty. Advances in Information Retrieval. 44th European Conference on IR Research, ECIR 2022, Stavanger, Norway, April 10–14, 2022, Proceedings, Part II, 13186, Springer International Publishing, pp.347-354, 2022, Lecture Notes in Computer Science, 978-3-030-99738-0. ⟨10.1007/978-3-030-99739-7_44⟩ (2022)
|
|
BASE
|
|
Show details
|
|
8 |
Can Character-based Language Models Improve Downstream Task Performance in Low-Resource and Noisy Language Scenarios?
|
|
|
|
In: Seventh Workshop on Noisy User-generated Text (W-NUT 2021, colocated with EMNLP 2021) ; https://hal.inria.fr/hal-03527328 ; Seventh Workshop on Noisy User-generated Text (W-NUT 2021, colocated with EMNLP 2021), Jan 2022, punta cana, Dominican Republic ; https://aclanthology.org/2021.wnut-1.47/ (2022)
|
|
BASE
|
|
Show details
|
|
9 |
Cross-lingual few-shot hate speech and offensive language detection using meta learning
|
|
|
|
In: ISSN: 2169-3536 ; EISSN: 2169-3536 ; IEEE Access ; https://hal.archives-ouvertes.fr/hal-03559484 ; IEEE Access, IEEE, 2022, 10, pp.14880-14896. ⟨10.1109/ACCESS.2022.3147588⟩ (2022)
|
|
BASE
|
|
Show details
|
|
10 |
Annotation of Morphological Errors in L2 Russian Corpus Analysis
|
|
|
|
In: 21st Annual Second Language Acquisition and Teaching Interdisciplinary Roundtable ; https://hal.archives-ouvertes.fr/hal-03620469 ; 21st Annual Second Language Acquisition and Teaching Interdisciplinary Roundtable, University of Arizona, Feb 2022, Tucson, United States (2022)
|
|
BASE
|
|
Show details
|
|
11 |
Cross-Situational Learning Towards Robot Grounding
|
|
|
|
In: https://hal.archives-ouvertes.fr/hal-03628290 ; 2022 (2022)
|
|
BASE
|
|
Show details
|
|
12 |
Cross-Situational Learning Towards Robot Grounding
|
|
|
|
In: https://hal.archives-ouvertes.fr/hal-03628290 ; 2022 (2022)
|
|
BASE
|
|
Show details
|
|
13 |
A Methodology for the Comparison of Human Judgments With Metrics for Coreference Resolution
|
|
|
|
In: HumEval at ACL ; https://hal.archives-ouvertes.fr/hal-03650294 ; HumEval at ACL, May 2022, Dublin, Ireland ; https://humeval.github.io/ (2022)
|
|
BASE
|
|
Show details
|
|
14 |
Le modèle Transformer: un « couteau suisse » pour le traitement automatique des langues
|
|
|
|
In: Techniques de l'Ingenieur ; https://hal.archives-ouvertes.fr/hal-03619077 ; Techniques de l'Ingenieur, Techniques de l'ingénieur, 2022, ⟨10.51257/a-v1-in195⟩ ; https://www.techniques-ingenieur.fr/base-documentaire/innovation-th10/innovations-en-electronique-et-tic-42257210/transformer-des-reseaux-de-neurones-pour-le-traitement-automatique-des-langues-in195/ (2022)
|
|
BASE
|
|
Show details
|
|
15 |
The use of MT by undergraduate translation students for different learning tasks
|
|
|
|
In: https://hal.archives-ouvertes.fr/hal-03547415 ; 2022 (2022)
|
|
BASE
|
|
Show details
|
|
16 |
Formulaic Expressions for Foreign Language Learning and Teaching
|
|
|
|
In: ISSN: 1615-3014 ; Linguistik Online ; https://hal.archives-ouvertes.fr/hal-03562566 ; Linguistik Online, Bern Open Publishing, 2022, Vermischtes/Miscellaneous, 113 (1), pp.91-110 ; https://bop.unibe.ch/linguistik-online (2022)
|
|
BASE
|
|
Show details
|
|
17 |
КОНТРОЛЬ КАК ОСНОВА ЭФФЕКТИВНОГО ОБУЧЕНИЯ ИНОСТРАННОМУ ЯЗЫКУ СТУДЕНТОВ НЕЯЗЫКОВЫХ ВУЗОВ ... : CONTROL AS A BASIS FOR EFFECTIVE FOREIGN LANGUAGE TEACHING OF STUDENTS IN NON-LINGUISTIC UNIVERSITIES ...
|
|
|
|
BASE
|
|
Show details
|
|
18 |
МОНОЛОГИЧЕСКАЯ РЕЧЬ С ТОЧКИ ЗРЕНИЯ УЧЁНЫХ ... : MONOLOGICAL SPEECH FROM THE POINT OF VIEW OF SCIENTISTS ...
|
|
|
|
BASE
|
|
Show details
|
|
19 |
АКТУАЛЬНЫЕ ТЕНДЕНЦИИ ЦИФРОВИЗАЦИИ ИНОЯЗЫЧНОГО ОБУЧЕНИЯ В НЕЯЗЫКОВОМ ВУЗЕ ... : CURRENT TRENDS IN DIGITALIZATION OF FOREIGN LANGUAGE EDUCATION IN A NON-LINGUISTIC UNIVERSITY ...
|
|
|
|
BASE
|
|
Show details
|
|
20 |
THE ROLE OF LISTENING IN LANGUAGE ACQUISITION; THE CHALLENGES & STRATEGIES IN TEACHING LISTENING ... : РОЛЬ СЛУШАНИЯ В ОФОРМЛЕНИИ ЯЗЫКА; ПРОБЛЕМЫ И СТРАТЕГИИ ОБУЧЕНИЯ АУДИРОВАНИЮ ...
|
|
Zokirova, Zulkhumor. - : Oriental renaissance: Innovative, educational, natural and social sciences, 2022
|
|
BASE
|
|
Show details
|
|
|
|