| 1 |
Visual Goal-Step Inference using wikiHow ...
|
|
|
|
Abstract:
Anthology paper link: https://aclanthology.org/2021.emnlp-main.165/ Abstract: Understanding what sequence of steps are needed to complete a goal can help artificial intelligence systems reason about human activities. Past work in NLP has examined the task of goal-step inference for text. We introduce the visual analogue. We propose the Visual Goal-Step Inference (VGSI) task, where a model is given a textual goal and must choose which of four images represents a plausible step towards that goal. With a new dataset harvested from wikiHow consisting of 772,277 images representing human actions, we show that our task is challenging for state-of-the-art multimodal models. Moreover, the multimodal representation learned from our data can be effectively transferred to other datasets like HowTo100m, increasing the VGSI accuracy by 15 - 20%. Our task will facilitate multimodal reasoning about procedural events. ...
|
|
Keyword:
Computational Linguistics; Machine Learning; Machine Learning and Data Mining; Natural Language Processing
|
|
URL: https://dx.doi.org/10.48448/z6gp-g111
https://underline.io/lecture/37557-visual-goal-step-inference-using-wikihow
|
|
BASE
|
|
Hide details
|
|
|
| 2 |
Wikily Supervised Neural Translation Tailored to Cross-Lingual Tasks ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 4 |
BiSECT: Learning to Split and Rephrase Sentences with Bitexts ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 6 |
Resolving Pronouns in Twitter Streams: Context can Help! ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 7 |
Artificial Intelligence in mental health and the biases of language based models
|
|
|
|
In: PLoS One (2020)
|
|
BASE
|
|
Show details
|
|
|
| 8 |
Paraphrase-Sense-Tagged Sentences
|
|
|
|
In: Transactions of the Association for Computational Linguistics, Vol 7, Pp 714-728 (2019) (2019)
|
|
BASE
|
|
Show details
|
|
|
| 9 |
Simplification Using Paraphrases and Context-Based Lexical Substitution
|
|
|
|
In: Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies ; https://hal.archives-ouvertes.fr/hal-01838519 ; Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Association for Computational Linguistics, Jun 2018, Nouvelle Orléans, United States (2018)
|
|
BASE
|
|
Show details
|
|
|
| 10 |
Automated Paraphrase Lattice Creation for HyTER Machine Translation Evaluation
|
|
|
|
In: Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies ; https://hal.archives-ouvertes.fr/hal-01838521 ; Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Association for Computational Linguistics Jun 2018, Nouvelle Orléans, United States (2018)
|
|
BASE
|
|
Show details
|
|
|
| 11 |
Comparing Constraints for Taxonomic Organization
|
|
|
|
In: Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies ; https://hal.archives-ouvertes.fr/hal-01838520 ; Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Association for Computational Linguistics Jun 2018, Nouvelle Orléans, United States (2018)
|
|
BASE
|
|
Show details
|
|
|
| 12 |
Mapping the Paraphrase Database to WordNet
|
|
|
|
In: Conference on Lexical and Computational Semantics ; https://hal.archives-ouvertes.fr/hal-01838527 ; Conference on Lexical and Computational Semantics, Aug 2017, Vancouver, Canada (2017)
|
|
BASE
|
|
Show details
|
|
|
| 13 |
Learning Antonyms with Paraphrases and a Morphology-aware Neural Network
|
|
|
|
In: Conference on Lexical and Computational Semantics ; https://hal.archives-ouvertes.fr/hal-01838526 ; Conference on Lexical and Computational Semantics, Aug 2017, Vancouver, Canada (2017)
|
|
BASE
|
|
Show details
|
|
|
| 14 |
Word Sense Filtering Improves Embedding-Based Lexical Substitution
|
|
|
|
In: Conference of the European Chapter of the Association for Computational Linguistics ; https://hal.archives-ouvertes.fr/hal-01838524 ; Conference of the European Chapter of the Association for Computational Linguistics , Apr 2017, Valencia, Spain (2017)
|
|
BASE
|
|
Show details
|
|
|
| 15 |
Learning Translations via Matrix Completion
|
|
|
|
In: Conference on Empirical Methods in Natural Language Processing ; https://hal.archives-ouvertes.fr/hal-01838532 ; Conference on Empirical Methods in Natural Language Processing, Sep 2017, Copenhagen, Denmark (2017)
|
|
BASE
|
|
Show details
|
|
|
| 16 |
KnowYourNyms? A Game of Semantic Relationships
|
|
|
|
In: Conference on Empirical Methods in Natural Language Processing ; https://hal.archives-ouvertes.fr/hal-01838528 ; Conference on Empirical Methods in Natural Language Processing, Sep 2017, Copenhagen, Denmark (2017)
|
|
BASE
|
|
Show details
|
|
|
| 17 |
Use of Modality and Negation in Semantically-Informed Syntactic MT ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 19 |
Bucking the Trend: Large-Scale Cost-Focused Active Learning for Statistical Machine Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 20 |
Fisher and CALLHOME Spanish--English Speech Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|
|
