CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLP

18 April 2021

Xiang Ren

Papers citing "CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLP"

50 / 140 papers shown

Title
Meta-training with Demonstration Retrieval for Efficient Few-shot Learning Aaron Mueller Kanika Narang Lambert Mathias Qifan Wang Hamed Firooz RALM 22 3 0 30 Jun 2023
Differentiable Instruction Optimization for Cross-Task Generalization Masaru Isonuma Junichiro Mori Ichiro Sakata 29 0 0 16 Jun 2023
Revisit Few-shot Intent Classification with PLMs: Direct Fine-tuning vs. Continual Pre-training Haode Zhang Haowen Liang Li-Ming Zhan Xiao-Ming Wu Albert Y. S. Lam VLM 16 8 0 08 Jun 2023
Did You Read the Instructions? Rethinking the Effectiveness of Task Definitions in Instruction Learning Fan Yin Jesse Vig Philippe Laban Chenyu You Caiming Xiong Chien-Sheng Wu ALM 21 39 0 01 Jun 2023
Are Layout-Infused Language Models Robust to Layout Distribution Shifts? A Case Study with Scientific Documents Catherine Chen Zejiang Shen Dan Klein Gabriel Stanovsky Doug Downey Kyle Lo 21 2 0 01 Jun 2023
BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer Akari Asai Sneha Kudugunta Xinyan Velocity Yu Terra Blevins Hila Gonen Machel Reid Yulia Tsvetkov Sebastian Ruder Hannaneh Hajishirzi 41 54 0 24 May 2023
Estimating Large Language Model Capabilities without Labeled Test Data Harvey Yiyun Fu Qinyuan Ye Albert Xu Xiang Ren Robin Jia 21 8 0 24 May 2023
Mixture-of-Experts Meets Instruction Tuning:A Winning Combination for Large Language Models Sheng Shen Le Hou Yan-Quan Zhou Nan Du Shayne Longpre ... Vincent Zhao Hongkun Yu Kurt Keutzer Trevor Darrell Denny Zhou ALM MoE 35 54 0 24 May 2023
Active Learning Principles for In-Context Learning with Large Language Models Katerina Margatina Timo Schick Nikolaos Aletras Jane Dwivedi-Yu 30 39 0 23 May 2023
TaskWeb: Selecting Better Source Tasks for Multi-task NLP Joongwon Kim Akari Asai Gabriel Ilharco Hannaneh Hajishirzi 29 11 0 22 May 2023
Do Models Really Learn to Follow Instructions? An Empirical Study of Instruction Tuning Po-Nien Kung Nanyun Peng 17 49 0 19 May 2023
Instruction Tuned Models are Quick Learners Himanshu Gupta Saurabh Arjun Sawant Swaroop Mishra Mutsumi Nakamura Arindam Mitra Santosh Mashetty Chitta Baral 26 26 0 17 May 2023
Symbol tuning improves in-context learning in language models Jerry W. Wei Le Hou Andrew Kyle Lampinen Xiangning Chen Da Huang ... Xinyun Chen Yifeng Lu Denny Zhou Tengyu Ma Quoc V. Le LRM 30 74 0 15 May 2023
Revisiting Relation Extraction in the era of Large Language Models Somin Wadhwa Silvio Amir Byron C. Wallace ReLM KELM LRM 25 139 0 08 May 2023
Improving Cross-Task Generalization with Step-by-Step Instructions Yang Wu Yanyan Zhao Zhongyang Li Bing Qin Kai Xiong LRM ALM 19 9 0 08 May 2023
A Comparative Study between Full-Parameter and LoRA-based Fine-Tuning on Chinese Instruction Data for Instruction Following Large Language Model Xianghui Sun Yunjie Ji Baochang Ma Xiangang Li ALM 13 17 0 17 Apr 2023
From Zero to Hero: Examining the Power of Symbolic Tasks in Instruction Tuning Qian Liu Fan Zhou Zhengbao Jiang Longxu Dou Min-Bin Lin 18 17 0 17 Apr 2023
Chinese Open Instruction Generalist: A Preliminary Release Ge Zhang Yemin Shi Ruibo Liu Ruibin Yuan Yizhi Li ... Zhaoqun Li Zekun Wang Chenghua Lin Wen-Fen Huang Jie Fu ALM 33 29 0 17 Apr 2023
Towards Better Instruction Following Language Models for Chinese: Investigating the Impact of Training Data and Evaluation Yunjie Ji Yan Gong Yong Deng Yiping Peng Qiang Niu Baochang Ma Xiangang Li ALM ELM 22 22 0 16 Apr 2023
SimpLex: a lexical text simplification architecture Ciprian-Octavian Truică Andrei-Ionuţ Stan Elena Simona Apostol 29 6 0 14 Apr 2023
AGI for Agriculture Guoyu Lu Sheng Li Gengchen Mai Jin Sun Dajiang Zhu ... R. Xu Daniel Petti Changying Li Tianming Liu Changying Li AI4CE 48 17 0 12 Apr 2023
Exploring the Impact of Instruction Data Scaling on Large Language Models: An Empirical Study on Real-World Use Cases Yunjie Ji Yong Deng Yan Gong Yiping Peng Qiang Niu Lefei Zhang Baochang Ma Xiangang Li ALM 21 93 0 26 Mar 2023
Large Language Model Instruction Following: A Survey of Progresses and Challenges Renze Lou Kai Zhang Wenpeng Yin ALM LRM 32 20 0 18 Mar 2023
Multitask Prompt Tuning Enables Parameter-Efficient Transfer Learning Zhen Wang Yikang Shen Leonid Karlinsky Rogerio Feris Huan Sun Yoon Kim VLM VPVLM 33 107 0 06 Mar 2023
Modular Deep Learning Jonas Pfeiffer Sebastian Ruder Ivan Vulić E. Ponti MoMe OOD 32 73 0 22 Feb 2023
Learning to Initialize: Can Meta Learning Improve Cross-task Generalization in Prompt Tuning? Chengwei Qin Q. Li Ruochen Zhao Chenyu You VLM LRM 23 15 0 16 Feb 2023
CrossCodeBench: Benchmarking Cross-Task Generalization of Source Code Models Changan Niu Chuanyi Li Vincent Ng Bin Luo ELM ALM 34 9 0 08 Feb 2023
Chain of Hindsight Aligns Language Models with Feedback Hao Liu Carmelo Sferrazza Pieter Abbeel ALM 25 117 0 06 Feb 2023
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning Shayne Longpre Le Hou Tu Vu Albert Webson Hyung Won Chung ... Denny Zhou Quoc V. Le Barret Zoph Jason W. Wei Adam Roberts ALM 41 633 0 31 Jan 2023
tasksource: A Dataset Harmonization Framework for Streamlined NLP Multi-Task Learning and Evaluation Damien Sileo 14 10 0 14 Jan 2023
OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization Srinivasan Iyer Xi Lin Ramakanth Pasunuru Todor Mihaylov Daniel Simig ... Jeff Wang Christopher Dewan Asli Celikyilmaz Luke Zettlemoyer Veselin Stoyanov ALM 36 261 0 22 Dec 2022
In-context Learning Distillation: Transferring Few-shot Learning Ability of Pre-trained Language Models Yukun Huang Yanda Chen Zhou Yu Kathleen McKeown 27 30 0 20 Dec 2022
FewFedWeight: Few-shot Federated Learning Framework across Multiple NLP Tasks Weilong Dong Xinwei Wu Junzhuo Li Shuangzhi Wu Chao Bian Deyi Xiong FedML 34 6 0 16 Dec 2022
Systematic Analysis for Pretrained Language Model Priming for Parameter-Efficient Fine-tuning Shih-Cheng Huang Shi Wang Min-Han Shih Saurav Sahay Hung-yi Lee 39 0 0 02 Dec 2022
SciRepEval: A Multi-Format Benchmark for Scientific Document Representations Amanpreet Singh Mike DÁrcy Arman Cohan Doug Downey Sergey Feldman 22 79 0 23 Nov 2022
HyperTuning: Toward Adapting Large Language Models without Back-propagation Jason Phang Yi Mao Pengcheng He Weizhu Chen 16 30 0 22 Nov 2022
Few-Shot Character Understanding in Movies as an Assessment to Meta-Learning of Theory-of-Mind Mo Yu Qiujing Wang Shunchi Zhang Yisi Sang Kangsheng Pu ... Han Wang Liyan Xu Jing Li Yue Yu Jie Zhou 32 19 0 09 Nov 2022
Multi-Head Adapter Routing for Cross-Task Generalization Lucas Caccia E. Ponti Zhan Su Matheus Pereira Nicolas Le Roux Alessandro Sordoni 18 20 0 07 Nov 2022
Zero-Shot Classification by Logical Reasoning on Natural Language Explanations Chi Han Hengzhi Pei Xinya Du Heng Ji NAI 10 3 0 07 Nov 2022
TAPE: Assessing Few-shot Russian Language Understanding Ekaterina Taktasheva Tatiana Shavrina Alena Fenogenova Denis Shevelev Nadezhda Katricheva ... Svetlana Iordanskaia Alena Spiridonova Valentina Kurenshchikova Ekaterina Artemova Vladislav Mikhailov AAML 45 10 0 23 Oct 2022
Scaling Instruction-Finetuned Language Models Hyung Won Chung Le Hou Shayne Longpre Barret Zoph Yi Tay ... Jacob Devlin Adam Roberts Denny Zhou Quoc V. Le Jason W. Wei ReLM LRM 70 2,999 0 20 Oct 2022
Continued Pretraining for Better Zero- and Few-Shot Promptability Zhaofeng Wu IV RobertL.Logan Pete Walsh Akshita Bhagia Dirk Groeneveld Sameer Singh Iz Beltagy VLM 41 12 0 19 Oct 2022
Learning Instructions with Unlabeled Data for Zero-Shot Cross-Task Generalization Yuxian Gu Pei Ke Xiaoyan Zhu Minlie Huang ALM 39 17 0 17 Oct 2022
ConEntail: An Entailment-based Framework for Universal Zero and Few Shot Classification with Supervised Contrastive Pretraining H. Zhang Aysa Xuemo Fan Rui Zhang VLM 43 3 0 14 Oct 2022
State-of-the-art generalisation research in NLP: A taxonomy and review Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Ryan Cotterell Zhijing Jin 121 94 0 06 Oct 2022
Zemi: Learning Zero-Shot Semi-Parametric Language Models from Multiple Tasks Zhenhailong Wang Xiaoman Pan Dian Yu Dong Yu Jianshu Chen Heng Ji VLM 38 9 0 01 Oct 2022
CSL: A Large-scale Chinese Scientific Literature Dataset Yudong Li Yuqing Zhang Zhe Zhao Lin-cheng Shen Weijie Liu Weiquan Mao Hui Zhang AILaw 132 50 0 12 Sep 2022
Few-shot Adaptation Works with UnpredicTable Data Jun Shern Chan Michael Pieler Jonathan Jao Jérémy Scheurer Ethan Perez 31 5 0 01 Aug 2022
MVP: Multi-task Supervised Pre-training for Natural Language Generation Tianyi Tang Junyi Li Wayne Xin Zhao Ji-Rong Wen 43 24 0 24 Jun 2022
KnowDA: All-in-One Knowledge Mixture Model for Data Augmentation in Low-Resource NLP Yufei Wang Jiayi Zheng Can Xu Xiubo Geng Tao Shen Chongyang Tao Daxin Jiang VLM MoE 31 2 0 21 Jun 2022