1 |
How effective is BERT without word ordering? Implications for language understanding and data privacy ...
|
|
|
|
BASE
|
|
Show details
|
|
2 |
CLIPScore: A Reference-free Evaluation Metric for Image Captioning ...
|
|
|
|
Abstract:
Anthology paper link: https://aclanthology.org/2021.emnlp-main.595/ Abstract: Image captioning has conventionally relied on reference-based automatic evaluations, where machine captions are compared against captions written by humans. This is in contrast to the reference-free manner in which humans assess caption quality. In this paper, we report the surprising empirical finding that CLIP (Radford et al., 2021), a cross-modal model pretrained on 400M image+caption pairs from the web, can be used for robust automatic evaluation of image captioning without the need for references. Experiments spanning several corpora demonstrate that our new reference-free metric, CLIPScore, achieves the highest correlation with human judgements, outperforming existing reference-based metrics like CIDEr and SPICE. Information gain experiments demonstrate that CLIPScore, with its tight focus on image-text compatibility, is complementary to existing reference-based metrics that emphasize text-text similarities. Thus, we also ...
|
|
Keyword:
Computational Linguistics; Machine Learning; Machine Learning and Data Mining; Natural Language Processing
|
|
URL: https://dx.doi.org/10.48448/8nqz-5843 https://underline.io/lecture/37364-clipscore-a-reference-free-evaluation-metric-for-image-captioning
|
|
BASE
|
|
Hide details
|
|
3 |
Domain-Specific Lexical Grounding in Noisy Visual-Textual Documents ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|