| 1 |
The Zero Resource Speech Challenge 2021: Spoken language modelling
|
|
|
|
In: ISSN: 0162-8828 ; IEEE Transactions on Pattern Analysis and Machine Intelligence ; https://hal.inria.fr/hal-03329301 ; IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2021, pp.1-1. ⟨10.1109/TPAMI.2021.3083839⟩ (2021)
|
|
BASE
|
|
Show details
|
|
|
| 2 |
The Zero Resource Speech Challenge 2021: Spoken language modelling
|
|
|
|
In: Interspeech 2021 - Conference of the International Speech Communication Association ; https://hal.inria.fr/hal-03329301 ; Interspeech 2021 - Conference of the International Speech Communication Association, Aug 2021, Brno, Czech Republic. ⟨10.1109/TPAMI.2021.3083839⟩ (2021)
|
|
BASE
|
|
Show details
|
|
|
| 4 |
The Zero Resource Speech Challenge 2021: Spoken language modelling ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 5 |
The Zero Resource Speech Benchmark 2021: Metrics and baselines for unsupervised spoken language modeling
|
|
|
|
In: NeuRIPS Workshop on Self-Supervised Learning for Speech and Audio Processing ; https://hal.archives-ouvertes.fr/hal-03070362 ; NeuRIPS Workshop on Self-Supervised Learning for Speech and Audio Processing, Dec 2020, Virtuel, France (2020)
|
|
Abstract:
14 pages, including references and supplementary material ; International audience ; We introduce a new unsupervised task, spoken language modeling: the learning of linguistic representations from raw audio signals without any labels, along with the Zero Resource Speech Benchmark 2021: a suite of 4 black-box, zero-shot metrics probing for the quality of the learned models at 4 linguistic levels: phonetics, lexicon, syntax and semantics. We present the results and analyses of a composite baseline made of the concatenation of three unsupervised systems: self-supervised contrastive representation learning (CPC), clustering (k-means) and language modeling (LSTM or BERT). The language models learn on the basis of the pseudo-text derived from clustering the learned representations. This simple pipeline shows better than chance performance on all four metrics, demonstrating the feasibility of spoken language modeling from raw speech. It also yields worse performance compared to text-based 'topline' systems trained on the same data, delineating the space to be explored by more sophisticated end-to-end models.
|
|
Keyword:
[INFO.INFO-CL]Computer Science [cs]/Computation and Language [cs.CL]; [INFO.INFO-SD]Computer Science [cs]/Sound [cs.SD]
|
|
URL: https://hal.archives-ouvertes.fr/hal-03070362
https://hal.archives-ouvertes.fr/hal-03070362/document
https://hal.archives-ouvertes.fr/hal-03070362/file/2011.11588.pdf
|
|
BASE
|
|
Hide details
|
|
|
| 6 |
The Perceptimatic English Benchmark for Speech Perception Models
|
|
|
|
In: CogSci 2020 - 42nd Annual Virtual Meeting of the Cognitive Science Society ; https://hal.archives-ouvertes.fr/hal-03087248 ; CogSci 2020 - 42nd Annual Virtual Meeting of the Cognitive Science Society, Jul 2020, Toronto / Virtual, Canada (2020)
|
|
BASE
|
|
Show details
|
|
|
| 7 |
Perceptimatic: A human speech perception benchmark for unsupervised subword modelling
|
|
|
|
In: Interspeech 2020 - 21st Annual Conference of the International Speech Communication Association ; https://hal.archives-ouvertes.fr/hal-03087252 ; Interspeech 2020 - 21st Annual Conference of the International Speech Communication Association, Oct 2020, Shanghai / Virtual, China ; http://www.interspeech2020.org/ (2020)
|
|
BASE
|
|
Show details
|
|
|
| 8 |
Modelling Perceptual Effects of Phonology with ASR Systems
|
|
|
|
In: CogSci 2020 - 42nd Annual Virtual Meeting of the Cognitive Science Society ; https://hal.archives-ouvertes.fr/hal-03070281 ; CogSci 2020 - 42nd Annual Virtual Meeting of the Cognitive Science Society, Jul 2020, Virtual, France (2020)
|
|
BASE
|
|
Show details
|
|
|
| 9 |
The Zero Resource Speech Challenge 2020: Discovering discrete subword and word units
|
|
|
|
In: Interspeech 2020 - Conference of the International Speech Communication Association ; https://hal.archives-ouvertes.fr/hal-02962224 ; Interspeech 2020 - Conference of the International Speech Communication Association, Oct 2020, Shangai / Virtual, China (2020)
|
|
BASE
|
|
Show details
|
|
|
| 10 |
Analogies minus analogy test: measuring regularities in word embeddings
|
|
|
|
In: CoNLL 2020 - 24th Conference on Computational Natural Language Learning ; https://hal.archives-ouvertes.fr/hal-03070260 ; CoNLL 2020 - 24th Conference on Computational Natural Language Learning, Nov 2020, Virtual, France (2020)
|
|
BASE
|
|
Show details
|
|
|
| 11 |
Independent and Automatic Evaluation of Speaker-Independent Acoustic-to-Articulatory Reconstruction
|
|
|
|
In: Interspeech 2020 - 21st Annual Conference of the International Speech Communication Association ; https://hal.archives-ouvertes.fr/hal-03087264 ; Interspeech 2020 - 21st Annual Conference of the International Speech Communication Association, Oct 2020, Shanghai / Virtual, China ; http://www.interspeech2020.org/ (2020)
|
|
BASE
|
|
Show details
|
|
|
| 12 |
Analogies minus analogy test: measuring regularities in word embeddings ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 13 |
The Zero Resource Speech Benchmark 2021: Metrics and baselines for unsupervised spoken language modeling ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 14 |
Perceptimatic: A human speech perception benchmark for unsupervised subword modelling ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 15 |
The Perceptimatic English Benchmark for Speech Perception Models ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 16 |
Tensor Product Decomposition Networks: Uncovering Representations of Structure Learned by Neural Networks
|
|
|
|
In: Proceedings of the Society for Computation in Linguistics (2020)
|
|
BASE
|
|
Show details
|
|
|
| 17 |
Comparing unsupervised speech learning directly to human performance in speech perception
|
|
|
|
In: Proceedings of the Annual Conference of the Cognitive Science Society (Cog Sci) ; CogSci 2019 - 41st Annual Meeting of Cognitive Science Society ; https://hal.archives-ouvertes.fr/hal-02274499 ; CogSci 2019 - 41st Annual Meeting of Cognitive Science Society, Jul 2019, Montréal, Canada (2019)
|
|
BASE
|
|
Show details
|
|
|
| 18 |
Generative grammar, neural networks, and the implementational mapping problem: Response to Pater
|
|
|
|
In: ISSN: 0097-8507 ; EISSN: 1535-0665 ; Language ; https://hal.archives-ouvertes.fr/hal-02274522 ; Language, Linguistic Society of America, 2019, 95 (1), pp.e87-e98. ⟨10.1353/lan.2019.0013⟩ (2019)
|
|
BASE
|
|
Show details
|
|
|
| 19 |
RNNs Implicitly Implement Tensor Product Representations
|
|
|
|
In: International Conference on Learning Representations ; ICLR 2019 - International Conference on Learning Representations ; https://hal.archives-ouvertes.fr/hal-02274498 ; ICLR 2019 - International Conference on Learning Representations, May 2019, New Orleans, United States (2019)
|
|
BASE
|
|
Show details
|
|
|
| 20 |
The Zero Resource Speech Challenge 2019: TTS without T
|
|
|
|
In: Interspeech 2019 - 20th Annual Conference of the International Speech Communication Association ; https://hal.archives-ouvertes.fr/hal-02274112 ; Interspeech 2019 - 20th Annual Conference of the International Speech Communication Association, Sep 2019, Graz, Austria (2019)
|
|
BASE
|
|
Show details
|
|
|
|
|
