1 |
Emotion Intensity and its Control for Emotional Voice Conversion ...
|
|
|
|
BASE
|
|
Show details
|
|
2 |
Dawn of the transformer era in speech emotion recognition: closing the valence gap ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
Probing Speech Emotion Recognition Transformers for Linguistic Knowledge ...
|
|
|
|
Abstract:
Large, pre-trained neural networks consisting of self-attention layers (transformers) have recently achieved state-of-the-art results on several speech emotion recognition (SER) datasets. These models are typically pre-trained in self-supervised manner with the goal to improve automatic speech recognition performance -- and thus, to understand linguistic information. In this work, we investigate the extent in which this information is exploited during SER fine-tuning. Using a reproducible methodology based on open-source tools, we synthesise prosodically neutral speech utterances while varying the sentiment of the text. Valence predictions of the transformer model are very reactive to positive and negative sentiment content, as well as negations, but not to intensifiers or reducers, while none of those linguistic features impact arousal or dominance. These findings show that transformers can successfully leverage linguistic information to improve their valence predictions, and that linguistic analysis should ... : This work has been submitted for publication to Interspeech 2022 ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences; Machine Learning cs.LG
|
|
URL: https://dx.doi.org/10.48550/arxiv.2204.00400 https://arxiv.org/abs/2204.00400
|
|
BASE
|
|
Hide details
|
|
4 |
An Improved StarGAN for Emotional Voice Conversion: Enhancing Voice Quality and Data Augmentation ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
The INTERSPEECH 2021 Computational Paralinguistics Challenge: COVID-19 Cough, COVID-19 Speech, Escalation & Primates ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
On the Impact of Word Error Rate on Acoustic-Linguistic Speech Emotion Recognition: An Update for the Deep Learning Era ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Multistage linguistic conditioning of convolutional layers for speech emotion recognition ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
A Comparison of Acoustic and Linguistics Methodologies for Alzheimer's Dementia Recognition
|
|
|
|
In: http://infoscience.epfl.ch/record/284990 (2021)
|
|
BASE
|
|
Show details
|
|
9 |
The voice of COVID-19: Acoustic correlates of infection in sustained vowels
|
|
|
|
In: J Acoust Soc Am (2021)
|
|
BASE
|
|
Show details
|
|
10 |
COVID-19 and Computer Audition: An Overview on What Speech & Sound Analysis Could Contribute in the SARS-CoV-2 Corona Crisis
|
|
|
|
In: Front Digit Health (2021)
|
|
BASE
|
|
Show details
|
|
11 |
AI-based Human Audio Processing for COVID-19: A Comprehensive Overview
|
|
|
|
In: Pattern Recognit (2021)
|
|
BASE
|
|
Show details
|
|
12 |
Face Mask Recognition from Audio: The MASC Database and an Overview on the Mask Challenge
|
|
|
|
In: Pattern Recognit (2021)
|
|
BASE
|
|
Show details
|
|
13 |
Audio, Speech, Language, & Signal Processing for COVID-19: A Comprehensive Overview ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
Speaker trait characterization in web videos: Uniting speech, language, and facial features
|
|
|
|
In: Proceedings of the 38th International Conference on Acoustics, Speech and Signal Processing (ICASSP 2013) ; 3647-3651 ; International Conference on Acoustics, Speech and Signal Processing (ICASSP 2013) ; 38 (2020)
|
|
BASE
|
|
Show details
|
|
15 |
On-line emotion recognition in a 3-D activation-valence-time continuum using acoustic and linguistic cues
|
|
|
|
BASE
|
|
Show details
|
|
16 |
Discrimination of speech and non-linguistic vocalizations by non-negative matrix factorization
|
|
|
|
BASE
|
|
Show details
|
|
17 |
A comparison of acoustic and linguistics methodologies for Alzheimer's dementia recognition
|
|
|
|
BASE
|
|
Show details
|
|
18 |
"The Godfather" vs. "Chaos": comparing linguistic analysis based on on-line knowledge sources and Bags-of-N-Grams for movie review valence estimation
|
|
|
|
BASE
|
|
Show details
|
|
19 |
Speaker independent emotion recognition by early fusion of acoustic and linguistic features within ensembles
|
|
|
|
BASE
|
|
Show details
|
|
20 |
On the influence of phonetic content variation for acoustic emotion recognition
|
|
|
|
BASE
|
|
Show details
|
|
|
|