ANALOGICAL -- A Novel Benchmark for Long Text Analogy Evaluation in
Large Language Models

v1v2v3 (latest)

ANALOGICAL -- A Novel Benchmark for Long Text Analogy Evaluation in Large Language Models

8 May 2023

Thilini Wijesiriwardene

Ruwan Wickramarachchi

Shreeyash Mukul Gowaikar

Aishwarya N. Reganti

ArXiv (abs)PDF HTML

Papers citing "ANALOGICAL -- A Novel Benchmark for Long Text Analogy Evaluation in Large Language Models"

18 / 18 papers shown

Title
Scientific and Creative Analogies in Pretrained Language Models Tamara Czinczoll H. Yannakoudakis Pushkar Mishra Ekaterina Shutova ELM 48 8 0 28 Nov 2022
LinkBERT: Pretraining Language Models with Document Links Michihiro Yasunaga J. Leskovec Percy Liang KELM 106 361 0 29 Mar 2022
Measuring and Improving BERT's Mathematical Abilities by Predicting the Order of Reasoning Piotr Pikekos Henryk Michalewski Mateusz Malinowski 63 28 0 07 Jun 2021
Measuring Compositional Generalization: A Comprehensive Method on Realistic Data Daniel Keysers Nathanael Scharli Nathan Scales Hylke Buisman Daniel Furrer ... Tibor Tihon Dmitry Tsarkov Tianlin Li Marc van Zee Olivier Bousquet CoGe 68 355 0 20 Dec 2019
Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot Fly Nora Kassner Hinrich Schütze 76 324 0 08 Nov 2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan Mingda Chen Sebastian Goodman Kevin Gimpel Piyush Sharma Radu Soricut SSL AIMat 375 6,472 0 26 Sep 2019
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers Iryna Gurevych 1.3K 12,332 0 27 Aug 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 700 24,572 0 26 Jul 2019
SpanBERT: Improving Pre-training by Representing and Predicting Spans Mandar Joshi Danqi Chen Yinhan Liu Daniel S. Weld Luke Zettlemoyer Omer Levy 174 1,970 0 24 Jul 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding Zhilin Yang Zihang Dai Yiming Yang J. Carbonell Ruslan Salakhutdinov Quoc V. Le AI4CE 236 8,455 0 19 Jun 2019
SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems Alex Jinpeng Wang Yada Pruksachatkun Nikita Nangia Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 279 2,326 0 02 May 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 1.1K 7,201 0 20 Apr 2018
A Unified approach for Conventional Zero-shot, Generalized Zero-shot and Few-shot Learning Shafin Rahman Salman H. Khan Fatih Porikli 98 175 0 27 Jun 2017
Enriching Word Vectors with Subword Information Piotr Bojanowski Edouard Grave Armand Joulin Tomas Mikolov NAI SSL VLM 234 9,986 0 15 Jul 2016
Generating Sentences from a Continuous Space Samuel R. Bowman Luke Vilnis Oriol Vinyals Andrew M. Dai Rafal Jozefowicz Samy Bengio DRL 113 2,365 0 19 Nov 2015
A large annotated corpus for learning natural language inference Samuel R. Bowman Gabor Angeli Christopher Potts Christopher D. Manning 338 4,297 0 21 Aug 2015
WordRep: A Benchmark for Research on Learning Word Representations Bin Gao Jiang Bian Tie-Yan Liu OffRL 82 40 0 07 Jul 2014
Efficient Estimation of Word Representations in Vector Space Tomas Mikolov Kai Chen G. Corrado J. Dean 3DV 693 31,571 0 16 Jan 2013