1 |
CRAFT: A Benchmark for Causal Reasoning About Forces and inTeractions ...
|
|
|
|
BASE
|
|
Show details
|
|
2 |
CRAFT: A Benchmark for Causal Reasoning About Forces and inTeractions ...
|
|
Ates, Tayfun; Atesoglu, M. Samil; Yigit, Cagatay; Kesen, Ilker; Kobas, Mert; Erdem, Erkut; Erdem, Aykut; Goksun, Tilbe; Yuret, Deniz. - : Zenodo, 2021
|
|
Abstract:
Humans are able to perceive, understand and reason about physical events. Developing models with similar physical understanding capabilities is a long-standing goal of artificial intelligence. As a step towards this goal, in this work, we introduce CRAFT, a new visual question answering dataset that requires causal reasoning about physical forces and object interactions. It contains 58K video and question pairs that are generated from 10K videos from 20 different virtual environments, containing various objects in motion that interact with each other and the scene. Two question categories from CRAFT include previously studied descriptive and counterfactual questions. Besides, inspired by the theories of force dynamics in cognitive linguistics, we introduce new question categories that involve understanding the interactions of objects through the notions of cause , enable , and prevent . Our results demonstrate that even though these tasks seem to be simple and intuitive for humans, the evaluated baseline ... : CRAFT was supported in part by GEBIP 2018 Award of the Turkish Academy of Sciences to E. Erdem and T. Goksun, BAGEP 2021 Award of the Science Academy to A. Erdem, and AI Fellowship to Ilker Kesen provided by the KUIS AI Lab. ...
|
|
Keyword:
causal reasoning; force dynamics; intuitive physics; temporal reasoning; visual question answering
|
|
URL: https://dx.doi.org/10.5281/zenodo.4904782 https://zenodo.org/record/4904782
|
|
BASE
|
|
Hide details
|
|
3 |
CRAFT: A Benchmark for Causal Reasoning About Forces and inTeractions ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|