2 |
Space omics research in Europe: contributions, geographical distribution and ESA member state funding schemes
|
|
|
|
BASE
|
|
Show details
|
|
3 |
Towards Unsupervised Content Disentanglement in Sentence Representations via Syntactic Roles
|
|
|
|
In: CtrlGen: Controllable Generative Modeling in Language and Vision ; https://hal.inria.fr/hal-03540084 ; CtrlGen: Controllable Generative Modeling in Language and Vision, Jan 2022, virtual, France (2022)
|
|
Abstract:
International audience ; Linking neural representations to linguistic factors is crucial in order to build and analyze NLP models interpretable by humans. Among these factors, syntactic roles (e.g. subjects, direct objects,. .) and their realizations are essential markers since they can be understood as a decomposition of predicative structures and thus the meaning of sentences. Starting from a deep probabilistic generative model with attention, we measure the interaction between latent variables and realizations of syntactic roles, and show that it is possible to obtain, without supervision, representations of sentences where different syntactic roles correspond to clearly identified different latent variables. The probabilistic model we propose is an Attention-Driven Variational Autoencoder (ADVAE). Drawing inspiration from Transformer-based machine translation models, ADVAEs enable the analysis of the interactions between latent variables and input tokens through attention. We also develop an evaluation protocol to measure disentanglement with regard to the realizations of syntactic roles. This protocol is based on attention maxima for the encoder and on disturbing individual latent variables for the decoder. Our experiments on raw English text from the SNLI dataset show that i) disentanglement of syntactic roles can be induced without supervision, ii) ADVAE separates more syntactic roles than classical sequence VAEs, iii) realizations of syntactic roles can be separately modified in sentences by mere intervention on the associated latent variables. Our work constitutes a first step towards unsupervised controllable content generation. The code for our work is publicly available 1 .
|
|
Keyword:
[INFO.INFO-TT]Computer Science [cs]/Document and Text Processing
|
|
URL: https://hal.inria.fr/hal-03540084 https://hal.inria.fr/hal-03540084/document https://hal.inria.fr/hal-03540084/file/lqVcfT-CTRLGEN%20%287%29.pdf
|
|
BASE
|
|
Hide details
|
|
4 |
Local community and use of Ceiba petandra in Banwa province in Burkina Faso ; Communautés locales et utilisation de Ceiba petandra dans la province des Banwa au Burkina Faso
|
|
|
|
In: ISSN: 2456-2165 ; International Journal of Innovative Science and Research Technology ; https://hal.archives-ouvertes.fr/hal-03644895 ; International Journal of Innovative Science and Research Technology , International Journal of Innovative Science and Research Technology 2022, 7 (3), pp.520-527 (2022)
|
|
BASE
|
|
Show details
|
|
5 |
Histoire de peuple Bale
|
|
|
|
In: ISSN: 2673-7604 ; EISSN: 2673-7604 ; Revue d’histoire contemporaine de l’Afrique ; https://hal.archives-ouvertes.fr/hal-03609252 ; Revue d’histoire contemporaine de l’Afrique, Université de Genève, 2022 (2022)
|
|
BASE
|
|
Show details
|
|
6 |
Language Learning Through Contemporary Technologies: A Case Of Tpack Teaching Model ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Language Learning Through Contemporary Technologies: A Case Of Tpack Teaching Model ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Cross-linguistic patterns of speech prosodic differences in autism: A machine learning study ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
Formulaic expressions in official Roman Republican epistolography inscribed in Greek ...
|
|
|
|
BASE
|
|
Show details
|
|
10 |
Formulaic expressions in official Roman Republican epistolography inscribed in Greek ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
Would a Bulbasaur by any other name be as iconic? Analyzing motivations in Pokémon name localization
|
|
|
|
BASE
|
|
Show details
|
|
13 |
Correcting Misproducted Speech using Spectrogram Inpainting ...
|
|
|
|
BASE
|
|
Show details
|
|
18 |
sj-pdf-1-pqx-10.1177_10986111211053843 – Supplemental Material for The Alignment Between Community Policing and the Work of School Resource Officers ...
|
|
|
|
BASE
|
|
Show details
|
|
19 |
sj-pdf-1-pqx-10.1177_10986111211053843 – Supplemental Material for The Alignment Between Community Policing and the Work of School Resource Officers ...
|
|
|
|
BASE
|
|
Show details
|
|
20 |
sj-pdf-2-pqx-10.1177_10986111211053843 – Supplemental Material for The Alignment Between Community Policing and the Work of School Resource Officers ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|