DE eng

Search in the Catalogues and Directories

Hits 1 – 3 of 3

1
Baby Cloud, a technological platform for parents and researchers
In: LREC 2018 - 11th edition of the Language Resources and Evaluation Conference ; https://hal.archives-ouvertes.fr/hal-01948107 ; LREC 2018 - 11th edition of the Language Resources and Evaluation Conference, May 2018, Miyazaki, Japan (2018)
BASE
Show details
2
Cognitive science in the era of artificial intelligence: A roadmap for reverse-engineering the infant language-learner
In: ISSN: 0010-0277 ; EISSN: 1873-7838 ; Cognition ; https://hal.archives-ouvertes.fr/hal-01888694 ; Cognition, Elsevier, 2018, 173, pp.43 - 59. ⟨10.1016/j.cognition.2017.11.008⟩ (2018)
BASE
Show details
3
Sampling strategies in Siamese Networks for unsupervised speech representation learning
In: Interspeech 2018 ; https://hal.archives-ouvertes.fr/hal-01888725 ; Interspeech 2018, Sep 2018, Hyderabad, India (2018)
Abstract: Conference paper at Interspeech 2018 ; International audience ; Recent studies have investigated siamese network architectures for learning invariant speech representations using same-different side information at the word level. Here we investigate systematically an often ignored component of siamese networks: the sampling procedure (how pairs of same vs. different tokens are selected). We show that sampling strategies taking into account Zipf's Law, the distribution of speakers and the proportions of same and different pairs of words significantly impact the performance of the network. In particular, we show that word frequency compression improves learning across a large range of variations in number of training pairs. This effect does not apply to the same extent to the fully unsupervised setting, where the pairs of same-different words are obtained by spoken term discovery. We apply these results to pairs of words discovered using an unsupervised algorithm and show an improvement on state-of-the-art in unsupervised representation learning using siamese networks.
Keyword: [INFO.INFO-CL]Computer Science [cs]/Computation and Language [cs.CL]; [SCCO.LING]Cognitive science/Linguistics; [SCCO]Cognitive science; [STAT.OT]Statistics [stat]/Other Statistics [stat.ML]; ABX; Index Terms: language acquisition; Language acquisition; sam-pling; Sampling; Siamese network; speech embeddings; speech recognition; unsupervised learning; weakly supervised learning; zero re-source speech technology; Zero resource speech technology; Zipf's law; Zipf’s law
URL: https://hal.archives-ouvertes.fr/hal-01888725/document
https://hal.archives-ouvertes.fr/hal-01888725
https://hal.archives-ouvertes.fr/hal-01888725/file/Riad_DKZSD_2018_Sampling_strategies_for_unsup_siamese.Interspeech.pdf
BASE
Hide details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
3
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern