1 |
A Comprehensive Understanding of Code-mixed Language Semantics using Hierarchical Transformer ...
|
|
|
|
BASE
|
|
Show details
|
|
2 |
HIT - A Hierarchically Fused Deep Attention Network for Robust Code-mixed Language Representation ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
HIT: A Hierarchically Fused Deep Attention Network for Robust Code-mixed Language Representation ...
|
|
|
|
Abstract:
Understanding linguistics and morphology of resource-scarce code-mixed texts remains a key challenge in text processing. Although word embedding comes in handy to support downstream tasks for low-resource languages, there are plenty of scopes in improving the quality of language representation particularly for code-mixed languages. In this paper, we propose HIT, a robust representation learning method for code-mixed texts. HIT is a hierarchical transformer-based framework that captures the semantic relationship among words and hierarchically learns the sentence-level semantics using a fused attention mechanism. HIT incorporates two attention modules, a multi-headed self-attention and an outer product attention module, and computes their weighted sum to obtain the attention weights. Our evaluation of HIT on one European (Spanish) and five Indic (Hindi, Bengali, Tamil, Telugu, and Malayalam) languages across four NLP tasks on eleven datasets suggests significant performance improvement against various ... : 15 pages, 13 tables, 6 Figures. Accepted at ACL-IJCNLP-2021 (Findings) ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://arxiv.org/abs/2105.14600 https://dx.doi.org/10.48550/arxiv.2105.14600
|
|
BASE
|
|
Hide details
|
|
4 |
Nice perfume. How long did you marinate in it? Multimodal Sarcasm Explanation ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
LESA: Linguistic Encapsulation and Semantic Amalgamation Based Generalised Claim Detection from Online Content ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
DESYR: Definition and Syntactic Representation Based Claim Detection on the Web ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Related Tasks can Share! A Multi-task Framework for Affective language ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|