| 1 |
Commonsense Knowledge-Aware Prompt Tuning for Few-Shot NOTA Relation Classification
|
|
|
|
In: Applied Sciences; Volume 12; Issue 4; Pages: 2185 (2022)
|
|
Abstract:
Compared with the traditional few-shot task, the few-shot none-of-the-above (NOTA) relation classification focuses on the realistic scenario of few-shot learning, in which a test instance might not belong to any of the target categories. This undoubtedly increases the task’s difficulty because given only a few support samples, this cannot represent the distribution of NOTA categories in space. The model needs to make full use of the syntactic information and word meaning information learned in the pre-training stage to distinguish the NOTA category and the support sample category in the embedding space. However, previous fine-tuning methods mainly focus on optimizing the extra classifiers (on top of pre-trained language models (PLMs)) and neglect the connection between pre-training objectives and downstream tasks. In this paper, we propose the commonsense knowledge-aware prompt tuning (CKPT) method for a few-shot NOTA relation classification task. First, a simple and effective prompt-learning method is developed by constructing relation-oriented templates, which can further stimulate the rich knowledge distributed in PLMs to better serve downstream tasks. Second, external knowledge is incorporated into the model by a label-extension operation, which forms knowledgeable prompt tuning to improve and stabilize prompt tuning. Third, to distinguish the NOTA pairs and positive pairs in embedding space more accurately, a learned scoring strategy is proposed, which introduces a learned threshold classification function and improves the loss function by adding a new term focused on NOTA identification. Experiments on two widely used benchmarks (FewRel 2.0 and Few-shot TACRED) show that our method is a simple and effective framework, and a new state of the art is established in the few-shot classification field.
|
|
Keyword:
commonsense knowledge-aware prompt tuning; few-shot none-of-the-above relation classification; pre-trained language models; scoring strategy
|
|
URL: https://doi.org/10.3390/app12042185
|
|
BASE
|
|
Hide details
|
|
|
| 2 |
Особенности сравнения китайских и русских имен : магистерская диссертация ; Peculiar properties of comparing Chinese and Russian names
|
|
|
|
BASE
|
|
Show details
|
|
|
| 3 |
Multimodal data revealed different neurobiological correlates of intelligence between males and females
|
|
|
|
In: Brain Imaging Behav (2020)
|
|
BASE
|
|
Show details
|
|
|
| 4 |
Gender Differences in Connectome-based Predictions of Individualized Intelligence Quotient and Sub-domain Scores
|
|
|
|
BASE
|
|
Show details
|
|
|
| 5 |
Skeleton to Abstraction: An Attentive Information Extraction Schema for Enhancing the Saliency of Text Summarization
|
|
|
|
In: Information ; Volume 9 ; Issue 9 (2018)
|
|
BASE
|
|
Show details
|
|
|
| 7 |
Neural ensemble dynamics underlying a long-term associative memory
|
|
|
|
BASE
|
|
Show details
|
|
|
| 9 |
Language-general and -specific white matter microstructural bases for reading
|
|
|
|
BASE
|
|
Show details
|
|
|
| 10 |
The contribution of the left mid-fusiform cortical thickness to Chinese and English reading in a large Chinese sample.
|
|
|
|
BASE
|
|
Show details
|
|
|
| 11 |
Resting-state functional connectivity and reading abilities in first and second languages
|
|
|
|
BASE
|
|
Show details
|
|
|
| 16 |
Foreign Language Learners' Use and Perception of Online Dictionaries: A Survey Study
|
|
|
|
In: http://jolt.merlot.org/vol9no4/jin_1213.pdf
|
|
BASE
|
|
Show details
|
|
|
| 17 |
RESEARCH ARTICLE Open Access Genetic evidence supports linguistic affinity of
|
|
|
|
In: http://www.biomedcentral.com/content/pdf/1471-2156-11-18.pdf
|
|
BASE
|
|
Show details
|
|
|
| 18 |
pp. 193–219 LANGUAGE DEVELOPMENT AND SCAFFOLDING IN A SINO-AMERICAN TELECOLLABORATIVE PROJECT
|
|
|
|
In: http://llt.msu.edu/issues/june2013/jin.pdf
|
|
BASE
|
|
Show details
|
|
|
| 19 |
Sciences of the USA 1418 -1421 ͉ PNAS
|
|
|
|
In: http://www.picb.ac.cn/picb-dynamic/admin/pic/JinLi2006-Linkage-disequilibrium%20sharing%20and%20haplotype-tagged%20snp%20portability%20between%20populations.pdf
|
|
BASE
|
|
Show details
|
|
|
|
|
