| 1 |
ViQuAE, a Dataset for Knowledge-based Visual Question Answering about Named Entities
|
|
|
|
In: ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’22) ; https://hal-universite-paris-saclay.archives-ouvertes.fr/hal-03650618 ; 2022 (2022)
|
|
Abstract:
International audience ; Whether to retrieve, answer, translate, or reason, multimodality opens up new challenges and perspectives. In this context, we are interested in answering questions about named entities grounded in a visual context using a Knowledge Base (KB). To benchmark this task, called KVQAE (Knowledge-based Visual Question Answering about named Entities), we provide ViQuAE, a dataset of 3.7K questions paired with images. This is the first KVQAE dataset to cover a wide range of entity types (e.g. persons, landmarks, and products). The dataset is annotated using a semi-automatic method. We also propose a KB composed of 1.5M Wikipedia articles paired with images. To set a baseline on the benchmark, we address KVQAE as a two-stage problem: Information Retrieval and Reading Comprehension, with both zero-and few-shot learning methods. The experiments empirically demonstrate the difficulty of the task, especially when questions are not about persons. This work paves the way for better multimodal entity representations and question answering. The dataset, KB, code, and semi-automatic annotation pipeline are freely available at https://github.com/PaulLerner/ViQuAE.
|
|
Keyword:
[INFO.INFO-IR]Computer Science [cs]/Information Retrieval [cs.IR]; [INFO.INFO-MM]Computer Science [cs]/Multimedia [cs.MM]; dataset; knowledge-based visual question answering; multimodal
|
|
URL: https://hal-universite-paris-saclay.archives-ouvertes.fr/hal-03650618
https://hal-universite-paris-saclay.archives-ouvertes.fr/hal-03650618/document
https://doi.org/10.1145/3477495.3531753
https://hal-universite-paris-saclay.archives-ouvertes.fr/hal-03650618/file/lerner_sigir_2022_camera.pdf
|
|
BASE
|
|
Hide details
|
|
|
| 2 |
Trans-Translation Is an Appealing Target for the Development of New Antimicrobial Compounds
|
|
|
|
In: EISSN: 2076-2607 ; Microorganisms ; https://hal.archives-ouvertes.fr/hal-03575603 ; Microorganisms, 2022, 10 (1), ⟨10.3390/microorganisms10010003⟩ (2022)
|
|
BASE
|
|
Show details
|
|
|
| 3 |
Label-Free Plasmonic Biosensor for Rapid, Quantitative, and Highly Sensitive COVID-19 Serology: Implementation and Clinical Validation
|
|
|
|
BASE
|
|
Show details
|
|
|
| 4 |
American cultural regions mapped through the linguistic analysis of social media
|
|
|
|
BASE
|
|
Show details
|
|
|
| 5 |
Language contact in northern Asia
|
|
|
|
In: World of Linguistics, Volume 10: The Languages and Linguistics of Northern Asia: A Comprehensive Guide ; https://hal.univ-lyon2.fr/hal-03610588 ; Edward Vajda; José Andrés Alonso de la Fuente. World of Linguistics, Volume 10: The Languages and Linguistics of Northern Asia: A Comprehensive Guide, In press (2022)
|
|
BASE
|
|
Show details
|
|
|
| 6 |
For Critical Language Awareness and Against the “Exclusive-use-of-the-target-language” Myth: The Effects of Sociolinguistic Content in English in an Elementary Spanish Classroom
|
|
|
|
In: L2 Journal, vol 14, iss 3 (2022)
|
|
BASE
|
|
Show details
|
|
|
| 7 |
A Comparative Study of Mathematics Classroom Practices in Chile, Colombia, and Mexico
|
|
|
|
BASE
|
|
Show details
|
|
|
| 8 |
SEMIOTAX: EQUATIONAL MODELS FOR THE LINGUISTIC SENTENCE AND THE 'COMPUTATIONAL THOUGHT'
|
|
|
|
In: https://hal.archives-ouvertes.fr/hal-03639891 ; 2022 (2022)
|
|
BASE
|
|
Show details
|
|
|
| 9 |
Se préparer à la constitution du corpus : questions théoriques et pratiques
|
|
|
|
In: Les corpus en didactique des langues : de la constitution à l’analyse ; https://hal.archives-ouvertes.fr/hal-03563405 ; Les corpus en didactique des langues : de la constitution à l’analyse, Feb 2022, Paris, France (2022)
|
|
BASE
|
|
Show details
|
|
|
| 10 |
Pirá: A Bilingual Portuguese-English Dataset for Question-Answering about the Ocean ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 11 |
Corpus of Political Speeches: Policy responses to the Great Recession in the United Kingdom and Spain (2008-2014) ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 12 |
Brezhoneg war an dachenn : Enquête de dialectologie et sociolinguistique bretonnes – Breton dialectal de Lanvaudan
|
|
|
|
BASE
|
|
Show details
|
|
|
| 13 |
Discriminating Bacterial Infection from Other Causes of Fever Using Body Temperature Entropy Analysis
|
|
|
|
In: Entropy; Volume 24; Issue 4; Pages: 510 (2022)
|
|
BASE
|
|
Show details
|
|
|
| 14 |
“Thou Shalt Not Take the Lord’s Name in Vain”: A Methodological Proposal to Identify Religious Hate Content on Digital Social Networks
|
|
|
|
In: International Journal of Communication; Vol 16 (2022); 22 ; 1932-8036 (2022)
|
|
BASE
|
|
Show details
|
|
|
| 15 |
Locality and attachment preferences in preverbal versus post-verbal Relative Clauses ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 17 |
Locality and attachment preferences in preverbal versus post-verbal Relative Clauses ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|
|
