1 |
Denoising Word Embeddings by Averaging in a Shared Space ...
|
|
|
|
BASE
|
|
Show details
|
|
2 |
CDLM: Cross-Document Language Modeling ...
|
|
|
|
Abstract:
Anthology paper link: https://aclanthology.org/2021.findings-emnlp.225.pdf Abstract: We introduce a new pretraining approach geared for multi-document language modeling, incorporating two key ideas into the masked language modeling self-supervised objective. First, instead of considering documents in isolation, we pretrain over sets of multiple related documents, encouraging the model to learn cross-document relationships. Second, we improve over recent long-range transformers by introducing dynamic global attention that has access to the entire input to predict masked tokens. We release CDLM (Cross-Document Language Model), a new general language model for multi-document setting that can be easily applied to downstream tasks. Our extensive analysis shows that both ideas are essential for the success of CDLM, and work in synergy to set new state-of-the-art results for several multi-text tasks. ...
|
|
Keyword:
Computational Linguistics; Language Models; Machine Learning; Machine Learning and Data Mining; Natural Language Processing
|
|
URL: https://dx.doi.org/10.48448/pbq6-k224 https://underline.io/lecture/39791-cdlm-cross-document-language-modeling
|
|
BASE
|
|
Hide details
|
|
3 |
Cross-document Coreference Resolution over Predicted Mentions ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
Summary-Source Proposition-level Alignment: Task, Datasets and Supervised Baseline ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
Teach the Rules, Provide the Facts: Targeted Relational-knowledge Enhancement for Textual Inference ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
Denoising Word Embeddings by Averaging in a Shared Space ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Realistic Evaluation Principles for Cross-document Coreference Resolution ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
QA-Align: Representing Cross-Text Content Overlap by Aligning Question-Answer Propositions ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
Asking It All: Generating Contextualized Questions for any Semantic Role ...
|
|
|
|
BASE
|
|
Show details
|
|
10 |
Paraphrasing vs Coreferring: Two Sides of the Same Coin ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
Revisiting the Binary Linearization Technique for Surface Realization
|
|
|
|
In: Proceedings of The 12th International Conference on Natural Language Generation ; https://hal.archives-ouvertes.fr/hal-02460309 ; Proceedings of The 12th International Conference on Natural Language Generation, 2019, pp.268 - 278 (2019)
|
|
BASE
|
|
Show details
|
|
12 |
Revisiting Joint Modeling of Cross-document Entity and Event Coreference Resolution ...
|
|
|
|
BASE
|
|
Show details
|
|
13 |
ABSApp: A Portable Weakly-Supervised Aspect-Based Sentiment Extraction System ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
Still a Pain in the Neck: Evaluating Text Representations on Lexical Composition ...
|
|
|
|
BASE
|
|
Show details
|
|
15 |
Still a Pain in the Neck: Evaluating Text Representations on Lexical Composition
|
|
|
|
In: Transactions of the Association for Computational Linguistics, Vol 7, Pp 403-419 (2019) (2019)
|
|
BASE
|
|
Show details
|
|
16 |
Paraphrase to Explicate: Revealing Implicit Noun-Compound Relations ...
|
|
|
|
BASE
|
|
Show details
|
|
17 |
CogALex-V Shared Task: LexNET - Integrated Path-based and Distributional Method for the Identification of Semantic Relations ...
|
|
|
|
BASE
|
|
Show details
|
|
18 |
Path-based vs. Distributional Information in Recognizing Lexical Semantic Relations ...
|
|
|
|
BASE
|
|
Show details
|
|
19 |
SemEval-2013 Task 7: The Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge
|
|
|
|
In: DTIC (2013)
|
|
BASE
|
|
Show details
|
|
20 |
UKP-BIU: Similarity and Entailment Metrics for Student Response Analysis ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|