2 |
Painting Pictures with Words - From Theory to System ...
|
|
|
|
Abstract:
A picture paints a thousand words, or so we are told. But how many words does it take to paint a picture? And how can words create pictures in the first place? In this thesis we examine a new theory of linguistic meaning -- where the meaning of words and sentences is determined by the scenes they evoke. We describe how descriptive text is parsed and semantically interpreted and how the semantic interpretation is then depicted as a rendered 3D scene. In doing so, we describe WordsEye, our text-to-scene system, and touch upon many fascinating issues of lexical semantics, knowledge representation, and what we call "graphical semantics." We introduce the notion of vignettes as a way to bridge between function and form, between the semantics of language and the grounded semantics of 3D scenes. And we describe how VigNet, our lexical semantic and graphical knowledge base, mediates the whole process. In the second part of this thesis, we describe four different ways WordsEye has been tested. We first discuss an ...
|
|
Keyword:
Computational linguistics; Computer science; FOS Languages and literature; Linguistics; Programming languages Electronic computers--Semantics; Semantics
|
|
URL: https://academiccommons.columbia.edu/doi/10.7916/D8QC084F https://dx.doi.org/10.7916/d8qc084f
|
|
BASE
|
|
Hide details
|
|
3 |
Compositional Lexical Semantics In Natural Language Inference
|
|
|
|
In: Publicly Accessible Penn Dissertations (2017)
|
|
BASE
|
|
Show details
|
|
|
|