DE eng

Search in the Catalogues and Directories

Page: 1 2
Hits 1 – 20 of 26

1
Trajectory Prediction with Linguistic Representations
Kuo, Yen-Ling; Huang, Xin; Barbu, Andrei; McGill, Stephen G.; Katz, Boris; Leonard, John J.; Rosman, Guy. - : Center for Brains, Minds and Machines (CBMM), International Conference on Robotics and Automation (ICRA), 2022
Abstract: Language allows humans to build mental models that interpret what is happening around them resulting in more accurate long-term predictions. We present a novel trajectory prediction model that uses linguistic intermediate representations to forecast trajectories, and is trained using trajectory sam- ples with partially-annotated captions. The model learns the meaning of each of the words without direct per-word supervision. At inference time, it generates a linguistic description of trajectories which captures maneuvers and interactions over an extended time interval. This generated description is used to refine predictions of the trajectories of multiple agents. We train and validate our model on the Argoverse dataset, and demonstrate improved accuracy results in trajectory prediction. In addition, our model is more interpretable: it presents part of its reasoning in plain language as captions, which can aid model development and can aid in building confidence in the model before deploying it. ; This work was supported by the Center for Brains, Minds and Machines (CBMM), funded by NSF STC award CCF – 1231216.
URL: https://hdl.handle.net/1721.1/141362
BASE
Hide details
2
Compositional Networks Enable Systematic Generalization for Grounded Language Understanding
Kuo, Yen-Ling; Katz, Boris; Barbu, Andrei. - : Center for Brains, Minds and Machines (CBMM), Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021
BASE
Show details
3
Trajectory Prediction with Linguistic Representations ...
BASE
Show details
4
Measuring Social Biases in Grounded Vision and Language Embeddings ...
NAACL 2021 2021; Barbu, Andrei; Katz, Boris. - : Underline Science Inc., 2021
BASE
Show details
5
Compositional Networks Enable Systematic Generalization for Grounded Language Understanding ...
BASE
Show details
6
Measuring Social Biases in Grounded Vision and Language Embeddings
Ross, Candace; Barbu, Andrei; Katz, Boris. - : Center for Brains, Minds and Machines (CBMM), Annual Conference of the North American Chapter of the Association for Computational Linguistics (HLT/NAACL), 2021
BASE
Show details
7
Learning a natural-language to LTL executable semantic parser for grounded robotics
Wang, Christopher; Ross, Candace; Kuo, Yen-Ling. - : Center for Brains, Minds and Machines (CBMM), Conference on Robot Learning (CoRL), 2020
BASE
Show details
8
Compositional Networks Enable Systematic Generalization for Grounded Language Understanding ...
BASE
Show details
9
Learning a natural-language to LTL executable semantic parser for grounded robotics ...
BASE
Show details
10
Measuring Social Biases in Grounded Vision and Language Embeddings ...
BASE
Show details
11
Encoding formulas as deep networks: Reinforcement learning for zero-shot execution of LTL formulas
Kuo, Yen-Ling; Katz, Boris; Barbu, Andrei. - : Center for Brains, Minds and Machines (CBMM), The Ninth International Conference on Learning Representations (ICLR), 2020
BASE
Show details
12
Temporal Grounding Graphs for Language Understanding with Accrued Visual-Linguistic Context ...
BASE
Show details
13
Temporal Grounding Graphs for Language Understanding with Accrued Visual-Linguistic Context
In: Other repository (2018)
BASE
Show details
14
Do You See What I Mean? Visual Resolution of Linguistic Ambiguities
Berzak, Yevgeni; Barbu, Andrei; Harari, Daniel. - : Center for Brains, Minds and Machines (CBMM), arXiv, 2016
BASE
Show details
15
Anchoring and Agreement in Syntactic Annotations
Berzak, Yevgeni; Huang, Yan; Barbu, Andrei. - : Center for Brains, Minds and Machines (CBMM), arXiv, 2016
BASE
Show details
16
Do You See What I Mean? Visual Resolution of Linguistic Ambiguities ...
BASE
Show details
17
Seeing What You’re Told: Sentence-Guided Activity Recognition In Video
Siddharth, Narayanaswamy; Barbu, Andrei; Siskind, Jeffrey Mark. - : Center for Brains, Minds and Machines (CBMM), arXiv, 2014
BASE
Show details
18
The Compositional Nature of Event Representations in the Human Brain
Barbu, Andrei; Narayanaswamy, Siddharth; Xiong, Caiming. - : Center for Brains, Minds and Machines (CBMM), arXiv, 2014
BASE
Show details
19
Video In Sentences Out ...
BASE
Show details
20
Saying What You're Looking For: Linguistics Meets Video Search ...
BASE
Show details

Page: 1 2

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
26
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern