Self-Supervised Meta-Learning for Few-Shot Natural Language Classification Tasks

17 September 2020

Trapit Bansal

Rishikesh Jha

Tsendsuren Munkhdalai

Papers citing "Self-Supervised Meta-Learning for Few-Shot Natural Language Classification Tasks"

50 / 52 papers shown

Title
A Practical Guide to Fine-tuning Language Models with Limited Data Márton Szép Daniel Rueckert Rüdiger von Eisenhart-Rothe Florian Hinterwimmer SyDa ALM 49 2 0 14 Nov 2024
MetaRM: Shifted Distributions Alignment via Meta-Learning Shihan Dou Yan Liu Enyu Zhou Tianlong Li Haoxiang Jia ... Junjie Ye Rui Zheng Tao Gui Qi Zhang Xuanjing Huang OOD 69 2 0 01 May 2024
Analyzing the Roles of Language and Vision in Learning from Limited Data Allison Chen Ilia Sucholutsky Olga Russakovsky Thomas Griffiths VLM 29 2 0 15 Feb 2024
Retrieval-Augmented Meta Learning for Low-Resource Text Classification Rongsheng Li Yongqian Li Hai-Tao Zheng Chaiyut Luoyiching Hai-Tao Zheng Nannan Zhou Hanjing Su RALM 20 2 0 10 Sep 2023
Unleash Model Potential: Bootstrapped Meta Self-supervised Learning Jingyao Wang Zeen Song Wenwen Qiang Changwen Zheng SSL 22 1 0 28 Aug 2023
Advances and Challenges in Meta-Learning: A Technical Review Anna Vettoruzzo Mohamed-Rafik Bouguelia Joaquin Vanschoren Thorsteinn Rögnvaldsson K. Santosh OffRL 34 70 0 10 Jul 2023
Meta-training with Demonstration Retrieval for Efficient Few-shot Learning Aaron Mueller Kanika Narang Lambert Mathias Qifan Wang Hamed Firooz RALM 32 3 0 30 Jun 2023
Towards Reliable Neural Machine Translation with Consistency-Aware Meta-Learning Rongxiang Weng Qiang Wang Wensen Cheng Changfeng Zhu Min Zhang 32 2 0 20 Mar 2023
Improving Few-Shot Generalization by Exploring and Exploiting Auxiliary Data Alon Albalak Colin Raffel William Yang Wang 27 12 0 01 Feb 2023
Disentangling Task Relations for Few-shot Text Classification via Self-Supervised Hierarchical Task Clustering Juan Zha Zheng Li Ying Wei Yu Zhang 33 5 0 16 Nov 2022
Learning New Tasks from a Few Examples with Soft-Label Prototypes Avyav Kumar Singh Ekaterina Shutova H. Yannakoudakis VLM 40 0 0 31 Oct 2022
Don't Prompt, Search! Mining-based Zero-Shot Learning with Language Models Mozes van de Kar Mengzhou Xia Danqi Chen Mikel Artetxe 44 19 0 26 Oct 2022
TAPE: Assessing Few-shot Russian Language Understanding Ekaterina Taktasheva Tatiana Shavrina Alena Fenogenova Denis Shevelev Nadezhda Katricheva ... Svetlana Iordanskaia Alena Spiridonova Valentina Kurenshchikova Ekaterina Artemova Vladislav Mikhailov AAML 45 10 0 23 Oct 2022
Meta-learning Pathologies from Radiology Reports using Variance Aware Prototypical Networks Arijit Sehanobish Kawshik Kannan Nabila Abraham Anasuya Das Benjamin Odry VLM 31 0 0 22 Oct 2022
Continued Pretraining for Better Zero- and Few-Shot Promptability Zhaofeng Wu IV RobertL.Logan Pete Walsh Akshita Bhagia Dirk Groeneveld Sameer Singh Iz Beltagy VLM 44 12 0 19 Oct 2022
Learning Instructions with Unlabeled Data for Zero-Shot Cross-Task Generalization Yuxian Gu Pei Ke Xiaoyan Zhu Minlie Huang ALM 39 17 0 17 Oct 2022
State-of-the-art generalisation research in NLP: A taxonomy and review Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Ryan Cotterell Zhijing Jin 129 95 0 06 Oct 2022
Adaptive Meta-learner via Gradient Similarity for Few-shot Text Classification Tianyi Lei Honghui Hu Qiaoyang Luo Dezhong Peng Xu Wang 20 12 0 10 Sep 2022
Simple and Effective Gradient-Based Tuning of Sequence-to-Sequence Models Jared Lichtarge Chris Alberti Shankar Kumar 47 4 0 10 Sep 2022
FactMix: Using a Few Labeled In-domain Examples to Generalize to Cross-domain Named Entity Recognition Linyi Yang Lifan Yuan Leyang Cui Wen Gao Yue Zhang 40 15 0 24 Aug 2022
On the cross-lingual transferability of multilingual prototypical models across NLU tasks Oralie Cattan Christophe Servan S. Rosset 34 9 0 19 Jul 2022
Persian Natural Language Inference: A Meta-learning approach Heydar Soudani Mohammadreza Mojab H. Beigy 32 1 0 18 May 2022
FETA: A Benchmark for Few-Sample Task Transfer in Open-Domain Dialogue Alon Albalak Yi-Lin Tuan Pegah Jandaghi Connor Pryor Luke Yoffe Deepak Ramachandran Lise Getoor Jay Pujara William Yang Wang 24 14 0 12 May 2022
Improving In-Context Few-Shot Learning via Self-Supervised Training Mingda Chen Jingfei Du Ramakanth Pasunuru Todor Mihaylov Srini Iyer Ves Stoyanov Zornitsa Kozareva SSL AI4MH 38 64 0 03 May 2022
Meta Learning for Natural Language Processing: A Survey Hung-yi Lee Shang-Wen Li Ngoc Thang Vu 57 42 0 03 May 2022
Contrastive Learning for Prompt-Based Few-Shot Language Learners Yiren Jian Chongyang Gao Soroush Vosoughi VLM 18 32 0 03 May 2022
Embedding Hallucination for Few-Shot Language Fine-tuning Yiren Jian Chongyang Gao Soroush Vosoughi 28 4 0 03 May 2022
MGIMN: Multi-Grained Interactive Matching Network for Few-shot Text Classification Jianhai Zhang M. Maimaiti Xing Gao Yuanhang Zheng Ji Zhang 23 9 0 11 Apr 2022
$Meta-X$_{NLG}$: A Meta-Learning Approach Based on Language Clustering for Zero-Shot Cross-Lingual Transfer and Generation$ Meta-X $_{NLG}$ : A Meta-Learning Approach Based on Language Clustering for Zero-Shot Cross-Lingual Transfer and Generation Kaushal Kumar Maurya M. Desarkar 23 8 0 19 Mar 2022
Grad2Task: Improved Few-shot Text Classification Using Gradients for Task Representation Jixuan Wang Kuan-Chieh Jackson Wang Frank Rudzicz M. Brudno VLM 22 21 0 27 Jan 2022
AcTune: Uncertainty-aware Active Self-Training for Semi-Supervised Active Learning with Pretrained Language Models Yue Yu Lingkai Kong Jieyu Zhang Rongzhi Zhang Chao Zhang 19 3 0 16 Dec 2021
Improving Both Domain Robustness and Domain Adaptability in Machine Translation Wen Lai Jindrich Libovický Alexander Fraser AI4CE 35 14 0 15 Dec 2021
Sharing to learn and learning to share; Fitting together Meta-Learning, Multi-Task Learning, and Transfer Learning: A meta review Richa Upadhyay Ronald Phlypo Rajkumar Saini Marcus Liwicki CLL 21 5 0 23 Nov 2021
CLUES: Few-Shot Learning Evaluation in Natural Language Understanding Subhabrata Mukherjee Xiaodong Liu Guoqing Zheng Saghar Hosseini Hao Cheng Greg Yang Christopher Meek Ahmed Hassan Awadallah Jianfeng Gao ELM 33 11 0 04 Nov 2021
Diverse Distributions of Self-Supervised Tasks for Meta-Learning in NLP Trapit Bansal K. Gunasekaran Tong Wang Tsendsuren Munkhdalai Andrew McCallum SSL OOD 51 19 0 02 Nov 2021
Squeezing Backbone Feature Distributions to the Max for Efficient Few-Shot Learning Yuqing Hu Vincent Gripon S. Pateux 47 37 0 18 Oct 2021
Revisiting Self-Training for Few-Shot Learning of Language Model Yiming Chen Yan Zhang Chen Zhang Grandee Lee Ran Cheng Haizhou Li 25 42 0 04 Oct 2021
STraTA: Self-Training with Task Augmentation for Better Few-shot Learning Tu Vu Minh-Thang Luong Quoc V. Le Grady Simon Mohit Iyyer 131 61 0 13 Sep 2021
Knowledge-Aware Meta-learning for Low-Resource Text Classification Huaxiu Yao Yingxin Wu Maruan Al-Shedivat Eric Xing VLM CLIP 72 11 0 10 Sep 2021
$k$ Folden: $k$ -Fold Ensemble for Out-Of-Distribution Detection Xiaoya Li Jiwei Li Xiaofei Sun Chun Fan Tianwei Zhang Fei Wu Yuxian Meng Jun Zhang FedML OODD 26 13 0 29 Aug 2021
Noisy Channel Language Model Prompting for Few-Shot Text Classification Sewon Min Michael Lewis Hannaneh Hajishirzi Luke Zettlemoyer VLM 40 218 0 09 Aug 2021
ProtoTransformer: A Meta-Learning Approach to Providing Student Feedback Mike Wu Noah D. Goodman Chris Piech Chelsea Finn 35 19 0 23 Jul 2021
FLEX: Unifying Evaluation for Few-Shot NLP Jonathan Bragg Arman Cohan Kyle Lo Iz Beltagy 205 104 0 15 Jul 2021
Meta-Learning with Variational Semantic Memory for Word Sense Disambiguation Yingjun Du Nithin Holla Xiantong Zhen Cees G. M. Snoek Ekaterina Shutova 33 9 0 05 Jun 2021
Bridging the Gap Between Practice and PAC-Bayes Theory in Few-Shot Meta-Learning Nan Ding Xi Chen Tomer Levinboim Sebastian Goodman Radu Soricut 27 31 0 28 May 2021
CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLP Qinyuan Ye Bill Yuchen Lin Xiang Ren 223 180 0 18 Apr 2021
Making Pre-trained Language Models Better Few-shot Learners Tianyu Gao Adam Fisch Danqi Chen 243 1,927 0 31 Dec 2020
Few-Shot Named Entity Recognition: A Comprehensive Study Jiaxin Huang Chunyuan Li K. Subudhi Damien Jose S. Balakrishnan Weizhu Chen Baolin Peng Jianfeng Gao Jiawei Han 29 79 0 29 Dec 2020
A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios Michael A. Hedderich Lukas Lange Heike Adel Jannik Strötgen Dietrich Klakow 219 287 0 23 Oct 2020
Data-Efficient Pretraining via Contrastive Self-Supervision Nils Rethmeier Isabelle Augenstein 28 20 0 02 Oct 2020