It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners

15 September 2020

Papers citing "It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners"

50 / 606 papers shown

Title
Prompting open-source and commercial language models for grammatical error correction of English learner text Christopher Davis Andrew Caines Oistein Andersen Shiva Taslimipoor H. Yannakoudakis Zheng Yuan Christopher Bryant Marek Rei P. Buttery 35 13 0 15 Jan 2024
Promptly Predicting Structures: The Return of Inference Maitrey Mehta Valentina Pyatkin Vivek Srikumar 53 3 0 12 Jan 2024
A Novel Prompt-tuning Method: Incorporating Scenario-specific Concepts into a Verbalizer Yong Ma Senlin Luo Yu-Ming Shang Zhengjun Li Yong Liu VLM 28 2 0 10 Jan 2024
MERA: A Comprehensive LLM Evaluation in Russian Alena Fenogenova Artem Chervyakov Nikita Martynov Anastasia Kozlova Maria Tikhonova ... Nikita Savushkin Polina Mikhailova Denis Dimitrov Alexander Panchenko Sergey Markov ELM 39 10 0 09 Jan 2024
Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Series Vijay Ekambaram Arindam Jati Pankaj Dayama Sumanta Mukherjee Nam H. Nguyen Wesley M. Gifford Chandra Reddy Jayant Kalagnanam AI4TS VLM 38 21 0 08 Jan 2024
Understanding LLMs: A Comprehensive Overview from Training to Inference Yi-Hsueh Liu Haoyang He Tianle Han Xu-Yao Zhang Mengyuan Liu ... Xintao Hu Tuo Zhang Ning Qiang Tianming Liu Bao Ge SyDa 35 65 0 04 Jan 2024
Temporal Adaptive RGBT Tracking with Modality Prompt Hongyu Wang Xiaotao Liu Yifan Li Meng Sun Dian Yuan Jing Liu 33 28 0 02 Jan 2024
Building Efficient Universal Classifiers with Natural Language Inference Moritz Laurer W. Atteveldt Andreu Casas Kasper Welbers 38 8 0 29 Dec 2023
Semantic Draw Engineering for Text-to-Image Creation Yang Li Huaqiang Jiang Yangkai Wu 29 1 0 23 Dec 2023
Decoupling Representation and Knowledge for Few-Shot Intent Classification and Slot Filling Jie Han Yixiong Zou Yining Qi Jun Wang Wei Liu Yao Wu Tao Zhang Ruixuan Li VLM 28 0 0 21 Dec 2023
Batched Low-Rank Adaptation of Foundation Models Yeming Wen Swarat Chaudhuri OffRL 26 19 0 09 Dec 2023
MUFFIN: Curating Multi-Faceted Instructions for Improving Instruction-Following Renze Lou Kai Zhang Jian Xie Yuxuan Sun Janice Ahn Hanzi Xu Yu Su Wenpeng Yin 37 26 0 05 Dec 2023
TARGET: Template-Transferable Backdoor Attack Against Prompt-based NLP Models via GPT4 Zihao Tan Qingliang Chen Yongjian Huang Chen Liang SILM AAML 39 3 0 29 Nov 2023
MultiGPrompt for Multi-Task Pre-Training and Prompting on Graphs Xingtong Yu Chang Zhou Yuan Fang Xinming Zhang 25 29 0 28 Nov 2023
Large Language Models are Few-Shot Training Example Generators: A Case Study in Fallacy Recognition Tariq Alhindi Smaranda Muresan Preslav Nakov HILM LRM 40 4 0 16 Nov 2023
SQATIN: Supervised Instruction Tuning Meets Question Answering for Improved Dialogue NLU E. Razumovskaia Goran Glavas Anna Korhonen Ivan Vulić LRM 32 2 0 16 Nov 2023
Think Before You Speak: Cultivating Communication Skills of Large Language Models via Inner Monologue Junkai Zhou Liang Pang Huawei Shen Xueqi Cheng LRM 27 4 0 13 Nov 2023
Translating Legalese: Enhancing Public Understanding of Court Opinions with Legal Summarizers Elliott Ash Aniket Kesari Suresh Naidu Lena Song Dominik Stammbach ELM 27 5 0 11 Nov 2023
Mini Minds: Exploring Bebeshka and Zlata Baby Models Irina Proskurina Guillaume Metzler Julien Velcin ALM 23 1 0 06 Nov 2023
The language of prompting: What linguistic properties make a prompt successful? Alina Leidinger R. Rooij Ekaterina Shutova 41 43 0 03 Nov 2023
Learning to Adapt CLIP for Few-Shot Monocular Depth Estimation Xue-mei Hu Ce Zhang Yi Zhang Bowen Hai Ke Yu Zhihai He MDE VLM 42 17 0 02 Nov 2023
ProMap: Effective Bilingual Lexicon Induction via Language Model Prompting Abdellah El Mekki Muhammad Abdul-Mageed El Moatez Billah Nagoudi Ismail Berrada A. Khoumsi 34 2 0 28 Oct 2023
BLESS: Benchmarking Large Language Models on Sentence Simplification Tannon Kew Alison Chi Laura Vásquez-Rodríguez Sweta Agrawal Dennis Aumiller Fernando Alva-Manchego Teven Le Scao 45 23 0 24 Oct 2023
A Communication Theory Perspective on Prompting Engineering Methods for Large Language Models Yuanfeng Song Yuanqin He Xuefang Zhao Hanlin Gu Di Jiang Haijun Yang Lixin Fan Qiang Yang 37 3 0 24 Oct 2023
Open-Ended Instructable Embodied Agents with Memory-Augmented Large Language Models Gabriel H. Sarch Yue Wu Michael J. Tarr Katerina Fragkiadaki LM&Ro LLMAG 27 19 0 23 Oct 2023
A Survey on Semantic Processing Techniques Rui Mao Kai He Xulang Zhang Guanyi Chen Jinjie Ni Zonglin Yang Min Zhang 23 34 0 22 Oct 2023
PromptMix: A Class Boundary Augmentation Method for Large Language Model Distillation Gaurav Sahu Olga Vechtomova Dzmitry Bahdanau I. Laradji VLM 55 24 0 22 Oct 2023
Transductive Learning for Textual Few-Shot Classification in API-based Embedding Models Pierre Colombo Victor Pellegrain Malik Boudiaf Victor Storchan Myriam Tami Ismail Ben Ayed C´eline Hudelot Pablo Piantanida 38 8 0 21 Oct 2023
Enhancing Zero-Shot Crypto Sentiment with Fine-tuned Language Model and Prompt Engineering Rahman S. M. Wahidur Ishmam Tashdeed Manjit Kaur Heung-No Lee ALM 33 17 0 20 Oct 2023
NameGuess: Column Name Expansion for Tabular Data Jiani Zhang Zhengyuan Shen Balasubramaniam Srinivasan Shen Wang Huzefa Rangwala George Karypis 13 4 0 19 Oct 2023
Label-Aware Automatic Verbalizer for Few-Shot Text Classification Thanakorn Thaminkaew Piyawat Lertvittayakumjorn P. Vateekul VLM 6 1 0 19 Oct 2023
Chain-of-Thought Tuning: Masked Language Models can also Think Step By Step in Natural Language Understanding Caoyun Fan Jidong Tian Yitian Li Wenqing Chen Hao He Yaohui Jin LRM 32 3 0 18 Oct 2023
Reformulating NLP tasks to Capture Longitudinal Manifestation of Language Disorders in People with Dementia Dimitris Gkoumas Matthew Purver M. Liakata 31 2 0 15 Oct 2023
XAL: EXplainable Active Learning Makes Classifiers Better Low-resource Learners Yun Luo Zhen Yang Fandong Meng Yingjie Li Fang Guo Qinglin Qi Jie Zhou Yue Zhang 24 1 0 09 Oct 2023
Towards Better Chain-of-Thought Prompting Strategies: A Survey Zihan Yu Liang He Zhen Wu Xinyu Dai Jiajun Chen LRM 129 45 0 08 Oct 2023
Amortizing intractable inference in large language models Marvin Schmitt Moksh Jain Daniel Habermann Younesse Kaddar Ullrich Kothe Stefan T. Radev Nikolay Malkin AIFin BDL 32 47 0 06 Oct 2023
Think before you speak: Training Language Models With Pause Tokens Sachin Goyal Ziwei Ji A. S. Rawat A. Menon Sanjiv Kumar Vaishnavh Nagarajan LRM 24 96 0 03 Oct 2023
Intuitive or Dependent? Investigating LLMs' Behavior Style to Conflicting Prompts Jiahao Ying Yixin Cao Kai Xiong Yidong He Long Cui Yongbin Liu 31 7 0 29 Sep 2023
Prompt-and-Align: Prompt-Based Social Alignment for Few-Shot Fake News Detection Jiaying Wu Xinyu Chen Haobin Yang Qi Zhao Yuhui Shi AAML 27 11 0 28 Sep 2023
Defending Pre-trained Language Models as Few-shot Learners against Backdoor Attacks Zhaohan Xi Tianyu Du Changjiang Li Ren Pang S. Ji Jinghui Chen Fenglong Ma Ting Wang AAML 8 29 0 23 Sep 2023
Prompt Tuned Embedding Classification for Multi-Label Industry Sector Allocation V. Buchner Lele Cao Jan-Christoph Kalo Vilhelm von Ehrenheim VLM 37 1 0 21 Sep 2023
UniPCM: Universal Pre-trained Conversation Model with Task-aware Automatic Prompt Yucheng Cai Wentao Ma Yuchuan Wu Shuzheng Si Yuan Shao Zhijian Ou Yongbin Li 43 3 0 20 Sep 2023
ODSum: New Benchmarks for Open Domain Multi-Document Summarization Yijie Zhou Kejian Shi Wencai Zhang Yixin Liu Yilun Zhao Arman Cohan RALM 37 2 0 16 Sep 2023
How to Handle Different Types of Out-of-Distribution Scenarios in Computational Argumentation? A Comprehensive and Fine-Grained Field Study Andreas Waldis Yufang Hou Iryna Gurevych 30 2 0 15 Sep 2023
Characterizing Latent Perspectives of Media Houses Towards Public Figures S. Srivatsa Srinath Srinivasa 15 0 0 12 Sep 2023
Detecting Natural Language Biases with Prompt-based Learning Md Abdul Aowal Maliha T Islam P. Mammen Sandesh Shetty 14 1 0 11 Sep 2023
FIAT: Fusing learning paradigms with Instruction-Accelerated Tuning Xinyi Wang John Wieting J. Clark CLL ALM 29 1 0 09 Sep 2023
Manifold-based Verbalizer Space Re-embedding for Tuning-free Prompt-based Classification Hao Wang Sendong Zhao Chi-Liang Liu Nuwa Xi Muzhen Cai Bing Qin Ting Liu 29 1 0 08 Sep 2023
BatchPrompt: Accomplish more with less Jianzhe Lin Maurice Diesendruck Liang Du Robin Abraham LRM 24 9 0 01 Sep 2023
LMSanitator: Defending Prompt-Tuning Against Task-Agnostic Backdoors Chengkun Wei Wenlong Meng Zhikun Zhang M. Chen Ming-Hui Zhao Wenjing Fang Lei Wang Zihui Zhang Wenzhi Chen AAML 29 9 0 26 Aug 2023