1 |
IR-GAN: Image Manipulation with Linguistic Instruction by Increment Reasoning ...
|
|
|
|
BASE
|
|
Show details
|
|
2 |
Improving Encoder by Auxiliary Supervision Tasks for Table-to-Text Generation ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
32 II-A2 TreeBERT: A Tree-Based Pre-Trained Model for Programming Language ...
|
|
|
|
Abstract:
Full paper: https://www.auai.org/uai2021/pdf/uai2021.32.pdf Abstract: Source code can be parsed into the abstract syntax tree (AST) based on defined syntax rules. However, in pre-training, little work has considered the incorporation of tree structure into the learning process. In this paper, we present TreeBERT, a tree-based pre-trained model for improving programming language-oriented generation tasks. To utilize tree structure, TreeBERT represents the AST corresponding to the code as a set of composition paths and introduces node position embedding. The model is trained by tree masked language modeling (TMLM) and node order prediction (NOP) with a hybrid objective. TMLM uses a novel masking strategy designed according to the tree's characteristics to help the model understand the AST and infer the missing semantics of the AST. With NOP, TreeBERT further extracts the syntactical structure by learning the order constraints of nodes in AST. We pre-trained TreeBERT on datasets covering multiple programming ...
|
|
Keyword:
Machine Learning; Neural Network
|
|
URL: https://dx.doi.org/10.48448/8csy-st53 https://underline.io/lecture/28833-32-ii-a2-treebert-a-tree-based-pre-trained-model-for-programming-language
|
|
BASE
|
|
Hide details
|
|
4 |
TreeBERT: A Tree-Based Pre-Trained Model for Programming Language ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
Using Artificial Intelligence for the Construction of University Physical Training and Teaching Systems
|
|
|
|
In: J Healthc Eng (2021)
|
|
BASE
|
|
Show details
|
|
6 |
Common Brain Substrates Underlying Auditory Speech Priming and Perceived Spatial Separation
|
|
|
|
In: Front Neurosci (2021)
|
|
BASE
|
|
Show details
|
|
7 |
Bundle-driven move analysis: Sentence initial lexical bundles in PhD abstracts
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Measurement of $W^{\pm}$-boson and $Z$-boson production cross-sections in $pp$ collisions at $\sqrt{s}=2.76$ TeV with the ATLAS detector
|
|
|
|
BASE
|
|
Show details
|
|
9 |
Knowledge-guided Pairwise Reconstruction Network for Weakly Supervised Referring Expression Grounding ...
|
|
|
|
BASE
|
|
Show details
|
|
10 |
Adaptive Reconstruction Network for Weakly Supervised Referring Expression Grounding ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
Sentence initial bundles: A comparative study between Chinese master’s L2 theses and published writing
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Chinese postgraduates' explanation of the sources of sentence initial bundles in their thesis writing
|
|
|
|
BASE
|
|
Show details
|
|
13 |
Logical Parsing from Natural Language Based on a Neural Translation Model ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
Family involvement in preschoolers' bilingual heritage language development: a cultural-historical study of Chinese-Australian families' everyday practices ...
|
|
|
|
BASE
|
|
Show details
|
|
15 |
Sentence initial bundles in L2 thesis writing: A comparative study of Chinese L2 and New Zealand L1 postgraduates’ writing
|
|
|
|
BASE
|
|
Show details
|
|
16 |
Interaction between auditory and motor systems in speech perception
|
|
|
|
BASE
|
|
Show details
|
|
17 |
Primitive Auditory Memory Is Correlated with Spatial Unmasking That Is Based on Direct-Reflection Integration
|
|
|
|
BASE
|
|
Show details
|
|
18 |
Family involvement in preschoolers' bilingual heritage language development: a cultural-historical study of Chinese-Australian families' everyday practices
|
|
Li, Liang. - : Monash University. Faculty of Education. Early Childhood Education, 2012
|
|
BASE
|
|
Show details
|
|
|
|