1 |
Universal Dependency Parsing for Hindi-English Code-switching ...
|
|
|
|
Abstract:
Code-switching is a phenomenon of mixing grammatical structures of two or more languages under varied social constraints. The code-switching data differ so radically from the benchmark corpora used in NLP community that the application of standard technologies to these data degrades their performance sharply. Unlike standard corpora, these data often need to go through additional processes such as language identification, normalization and/or back-transliteration for their efficient processing. In this paper, we investigate these indispensable processes and other problems associated with syntactic parsing of code-switching data and propose methods to mitigate their effects. In particular, we study dependency parsing of code-switching data of Hindi and English multilingual speakers from Twitter. We present a treebank of Hindi-English code-switching tweets under Universal Dependencies scheme and propose a neural stacking model for parsing that efficiently leverages part-of-speech tag and syntactic tree ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://arxiv.org/abs/1804.05868 https://dx.doi.org/10.48550/arxiv.1804.05868
|
|
BASE
|
|
Hide details
|
|
2 |
Joining Hands: Exploiting Monolingual Treebanks for Parsing of Code-mixing Data ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|