v1v2 (latest)

It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners

15 September 2020

Papers citing "It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners"

50 / 613 papers shown

Title
PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models Yuan Yao Qi-An Chen Ao Zhang Wei Ji Zhiyuan Liu Tat-Seng Chua Maosong Sun VLM MLLM 93 38 0 23 May 2022
Prompt Tuning for Discriminative Pre-trained Language Models Yuan Yao Bowen Dong Ao Zhang Zhengyan Zhang Ruobing Xie Zhiyuan Liu Leyu Lin Maosong Sun Jianyong Wang VLM 80 34 0 23 May 2022
DeepStruct: Pretraining of Language Models for Structure Prediction Chenguang Wang Xiao Liu Zui Chen Haoyun Hong Jie Tang Dawn Song 274 70 0 21 May 2022
Evaluating and Inducing Personality in Pre-trained Language Models Guangyuan Jiang Manjie Xu Song-Chun Zhu Wenjuan Han Chi Zhang Yixin Zhu 103 86 0 20 May 2022
Can Foundation Models Wrangle Your Data? A. Narayan Ines Chami Laurel J. Orr Simran Arora Christopher Ré LMTD AI4CE 233 229 0 20 May 2022
Are Prompt-based Models Clueless? Pride Kavumba Ryo Takahashi Yusuke Oda VLM 208 13 0 19 May 2022
Automatic Rule Induction for Interpretable Semi-Supervised Learning Reid Pryzant Ziyi Yang Yichong Xu Chenguang Zhu Michael Zeng 81 10 0 18 May 2022
LogicSolver: Towards Interpretable Math Word Problem Solving with Logical Prompt-enhanced Learning Zhicheng YANG Jinghui Qin Jiaqi Chen Liang Lin Xiaodan Liang ReLM LRM 86 33 0 17 May 2022
A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities Yisheng Song Ting-Yuan Wang S. Mondal J. P. Sahoo SLR 126 383 0 13 May 2022
Weakly Supervised Text Classification using Supervision Signals from a Language Model Huiping Zhuang Wei-Guo Ni Tianqing Fang Xiang Li Xinran Zhao Yangqiu Song 90 15 0 13 May 2022
Dynamic Prefix-Tuning for Generative Template-based Event Extraction Xiao Liu Heyan Huang Ge Shi Bo Wang 69 100 0 12 May 2022
Making Pretrained Language Models Good Long-tailed Learners Chen Zhang Lei Ren Jingang Wang Wei Wu Dawei Song RALM VLM 81 9 0 11 May 2022
Towards Unified Prompt Tuning for Few-shot Text Classification Jiadong Wang Chengyu Wang Fuli Luo Chuanqi Tan Minghui Qiu Fei Yang Qiuhui Shi Songfang Huang Ming Gao VLM 65 28 0 11 May 2022
Few-shot Mining of Naturally Occurring Inputs and Outputs Mandar Joshi Terra Blevins M. Lewis Daniel S. Weld Luke Zettlemoyer 81 1 0 09 May 2022
ProQA: Structural Prompt-based Pre-training for Unified Question Answering Wanjun Zhong Yifan Gao Ning Ding Yujia Qin Zhiyuan Liu Ming Zhou Jiahai Wang Jian Yin Nan Duan 68 34 0 09 May 2022
Odor Descriptor Understanding through Prompting Laura Sisson 40 1 0 07 May 2022
Improving In-Context Few-Shot Learning via Self-Supervised Training Mingda Chen Jingfei Du Ramakanth Pasunuru Todor Mihaylov Srini Iyer Ves Stoyanov Zornitsa Kozareva SSL AI4MH 105 67 0 03 May 2022
Textual Entailment for Event Argument Extraction: Zero- and Few-Shot with Multi-Source Learning Oscar Sainz Itziar Gonzalez-Dios Oier López de Lacalle Bonan Min Eneko Agirre 74 50 0 03 May 2022
OPT: Open Pre-trained Transformer Language Models Susan Zhang Stephen Roller Naman Goyal Mikel Artetxe Moya Chen ... Daniel Simig Punit Singh Koura Anjali Sridhar Tianlu Wang Luke Zettlemoyer VLM OSLM AI4CE 382 3,702 0 02 May 2022
Prompt Consistency for Zero-Shot Task Generalization Chunting Zhou Junxian He Xuezhe Ma Taylor Berg-Kirkpatrick Graham Neubig VLM 99 79 0 29 Apr 2022
Training Naturalized Semantic Parsers with Very Little Data Subendhu Rongali Konstantine Arkoudas M. Rubino Wael Hamza 76 11 0 29 Apr 2022
On the Limitations of Dataset Balancing: The Lost Battle Against Spurious Correlations Roy Schwartz Gabriel Stanovsky 102 26 0 27 Apr 2022
Label Anchored Contrastive Learning for Language Understanding Zhenyu Zhang Yuming Zhao Meng Chen Xiaodong He 51 13 0 26 Apr 2022
Super-Prompting: Utilizing Model-Independent Contextual Data to Reduce Data Annotation Required in Visual Commonsense Tasks Navid Rezaei Marek Reformat VLM 48 2 0 25 Apr 2022
Zero-shot Entity and Tweet Characterization with Designed Conditional Prompts and Contexts S. Srivatsa Tushar Mohan Kumari Neha Nishchay Malakar Ponnurangam Kumaraguru Srinath Srinivasa 55 0 0 18 Apr 2022
Exploiting Embodied Simulation to Detect Novel Object Classes Through Interaction Nikhil Krishnaswamy Sadaf Ghaffari 40 4 0 17 Apr 2022
Pathologies of Pre-trained Language Models in Few-shot Fine-tuning Hanjie Chen Guoqing Zheng Ahmed Hassan Awadallah Yangfeng Ji AI4MH 84 3 0 17 Apr 2022
In-BoXBART: Get Instructions into Biomedical Multi-Task Learning Mihir Parmar Swaroop Mishra Mirali Purohit Man Luo M. H. Murad Chitta Baral 89 23 0 15 Apr 2022
mGPT: Few-Shot Learners Go Multilingual Oleh Shliazhko Alena Fenogenova Maria Tikhonova Vladislav Mikhailov Anastasia Kozlova Tatiana Shavrina 111 155 0 15 Apr 2022
CLUES: A Benchmark for Learning Classifiers using Natural Language Explanations Rakesh R Menon Sayan Ghosh Shashank Srivastava LRM ELM 98 11 0 14 Apr 2022
Label Semantic Aware Pre-training for Few-shot Text Classification Aaron Mueller Jason Krone Salvatore Romeo Saab Mansour Elman Mansimov Yi Zhang Dan Roth VLM 52 38 0 14 Apr 2022
A Unified Multi-task Learning Framework for Multi-goal Conversational Recommender Systems Yang Deng Wenxuan Zhang Weiwen Xu Wenqiang Lei Tat-Seng Chua W. Lam LRM 104 66 0 14 Apr 2022
Automatic Multi-Label Prompting: Simple and Interpretable Few-Shot Classification Han Wang Canwen Xu Julian McAuley VLM 67 12 0 13 Apr 2022
Impossible Triangle: What's Next for Pre-trained Language Models? Chenguang Zhu Michael Zeng 78 1 0 13 Apr 2022
A Review on Language Models as Knowledge Bases Badr AlKhamissi Millicent Li Asli Celikyilmaz Mona T. Diab Marjan Ghazvininejad KELM 94 186 0 12 Apr 2022
Decomposed Meta-Learning for Few-Shot Named Entity Recognition Tingting Ma Huiqiang Jiang Qianhui Wu Tiejun Zhao Chin-Yew Lin 77 62 0 12 Apr 2022
Entities, Dates, and Languages: Zero-Shot on Historical Texts with T0 F. Toni Christopher Akiki Javier de la Rosa Clémentine Fourrier Enrique Manjavacas Stefan Schweter Daniel Alexander van Strien 63 11 0 11 Apr 2022
MGIMN: Multi-Grained Interactive Matching Network for Few-shot Text Classification Jianhai Zhang M. Maimaiti Xing Gao Yuanhang Zheng Ji Zhang 61 9 0 11 Apr 2022
Contrastive Demonstration Tuning for Pre-trained Language Models Xiaozhuan Liang Ningyu Zhang Shuyang Cheng Zhenru Zhang Chuanqi Tan Huajun Chen VLM ALM VPVLM 111 9 0 09 Apr 2022
PERFECT: Prompt-free and Efficient Few-shot Learning with Language Models Rabeeh Karimi Mahabadi Luke Zettlemoyer James Henderson Marzieh Saeidi Lambert Mathias Ves Stoyanov Majid Yazdani VLM 81 72 0 03 Apr 2022
Inverse is Better! Fast and Accurate Prompt for Few-shot Slot Tagging Yutai Hou Cheng Chen Xianzhen Luo Yue Liu Wanxiang Che BDL 57 22 0 02 Apr 2022
Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language Andy Zeng Maria Attarian Brian Ichter K. Choromanski Adrian S. Wong ... Michael S. Ryoo Vikas Sindhwani Johnny Lee Vincent Vanhoucke Peter R. Florence ReLM LRM 164 588 0 01 Apr 2022
Making Pre-trained Language Models End-to-end Few-shot Learners with Contrastive Prompt Tuning Ziyun Xu Chengyu Wang Minghui Qiu Fuli Luo Runxin Xu Songfang Huang Jun Huang VLM 98 33 0 01 Apr 2022
Exploring Visual Prompts for Adapting Large-Scale Models Hyojin Bahng Ali Jahanian S. Sankaranarayanan Phillip Isola VLM VPVLM LRM 77 272 0 31 Mar 2022
SpeechPrompt: An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Tasks Kai-Wei Chang Wei-Cheng Tseng Shang-Wen Li Hung-yi Lee 90 23 0 31 Mar 2022
Position-based Prompting for Health Outcome Generation Micheal Abaho Danushka Bollegala P. Williamson S. Dodd 58 10 0 30 Mar 2022
Evaluating Prompts Across Multiple Choice Tasks In a Zero-Shot Setting Gabriel Orlanski LRM 67 2 0 29 Mar 2022
PRBoost: Prompt-Based Rule Discovery and Boosting for Interactive Weakly-Supervised Learning Rongzhi Zhang Yue Yu Pranav Shetty Le Song Chao Zhang 136 25 0 18 Mar 2022
Multi-Stage Prompting for Knowledgeable Dialogue Generation Zihan Liu M. Patwary R. Prenger Shrimai Prabhumoye Ming-Yu Liu Mohammad Shoeybi Bryan Catanzaro 63 50 0 16 Mar 2022
Continuous Detection, Rapidly React: Unseen Rumors Detection based on Continual Prompt-Tuning Yuhui Zuo Wei Zhu Guoyong Cai CLL VLM 74 11 0 16 Mar 2022