Do Prompt-Based Models Really Understand the Meaning of their Prompts?

2 September 2021

Papers citing "Do Prompt-Based Models Really Understand the Meaning of their Prompts?"

50 / 254 papers shown

Title
uTeBC-NLP at SemEval-2024 Task 9: Can LLMs be Lateral Thinkers? Pouya Sadeghi Amirhossein Abaskohi Yadollah Yaghoobzadeh LRM ReLM 33 1 0 03 Apr 2024
Deconstructing In-Context Learning: Understanding Prompts via Corruption Namrata Shivagunde Vladislav Lialin Sherin Muckatira Anna Rumshisky 38 2 0 02 Apr 2024
Token-Efficient Leverage Learning in Large Language Models Yuanhao Zeng Min Wang Yihang Wang Yingxia Shao 37 0 0 01 Apr 2024
On-the-fly Definition Augmentation of LLMs for Biomedical NER Monica Munnangi Sergey Feldman Byron C. Wallace Silvio Amir Tom Hope Aakanksha Naik 32 11 0 29 Mar 2024
Automated Black-box Prompt Engineering for Personalized Text-to-Image Generation Yutong He Alexander Robey Naoki Murata Yiding Jiang J. Williams George Pappas Hamed Hassani Yuki Mitsufuji Ruslan Salakhutdinov J. Zico Kolter DiffM 104 4 0 28 Mar 2024
Monotonic Paraphrasing Improves Generalization of Language Model Prompting Qin Liu Fei Wang Nan Xu Tianyi Yan Tao Meng Muhao Chen LRM 43 7 0 24 Mar 2024
LAMPER: LanguAge Model and Prompt EngineeRing for zero-shot time series classification Zhicheng Du Zhaotian Xie Yan Tong Peiwu Qin AI4TS 31 1 0 23 Mar 2024
Improving the Robustness of Large Language Models via Consistency Alignment Zhao Yukun Lingyong Yan Weiwei Sun Guoliang Xing Shuaiqiang Wang Meng Chong Zhicong Cheng Zhaochun Ren Yin Dawei 35 19 0 21 Mar 2024
Genetic Auto-prompt Learning for Pre-trained Code Intelligence Language Models Chengzhe Feng Yanan Sun Ke Li Pan Zhou Jiancheng Lv Aojun Lu 51 1 0 20 Mar 2024
Third-Party Language Model Performance Prediction from Instruction Rahul Nadkarni Yizhong Wang Noah A. Smith ELM LRM 50 0 0 19 Mar 2024
On the Challenges and Opportunities in Generative AI Laura Manduchi Kushagra Pandey Robert Bamler Ryan Cotterell Sina Daubener ... F. Wenzel Frank Wood Stephan Mandt Vincent Fortuin Vincent Fortuin 56 17 0 28 Feb 2024
Beyond prompt brittleness: Evaluating the reliability and consistency of political worldviews in LLMs Tanise Ceron Neele Falk Ana Barić Dmitry Nikolaev Sebastian Padó 38 15 0 27 Feb 2024
Prompt Perturbation Consistency Learning for Robust Language Models Yao Qiang Subhrangshu Nandi Ninareh Mehrabi Greg Ver Steeg Anoop Kumar Anna Rumshisky Aram Galstyan 35 6 0 24 Feb 2024
Look Before You Leap: Problem Elaboration Prompting Improves Mathematical Reasoning in Large Language Models Haoran Liao Jidong Tian Shaohua Hu Hao He Yaohui Jin ReLM LRM 46 1 0 24 Feb 2024
On Sensitivity of Learning with Limited Labelled Data to the Effects of Randomness: Impact of Interactions and Systematic Choices Branislav Pecher Ivan Srba M. Bieliková 69 3 0 20 Feb 2024
Do Pre-Trained Language Models Detect and Understand Semantic Underspecification? Ask the DUST! Frank Wildenburg Michael Hanna Sandro Pezzelle 31 3 0 19 Feb 2024
Solving Data-centric Tasks using Large Language Models Shraddha Barke Christian Poelitz Carina Negreanu Ben Zorn J. Cambronero ... Nadia Polikarpova Advait Sarkar Brian Slininger N. Toronto Jack Williams 41 1 0 18 Feb 2024
Understanding In-Context Learning with a Pelican Soup Framework Ting-Rui Chiang Dani Yogatama 16 1 0 16 Feb 2024
Can we Soft Prompt LLMs for Graph Learning Tasks? Zheyuan Liu Xiaoxin He Yijun Tian Nitesh V. Chawla 55 21 0 15 Feb 2024
Chain-of-Thought Reasoning Without Prompting Xuezhi Wang Denny Zhou ReLM LRM 152 101 0 15 Feb 2024
Towards Safer Large Language Models through Machine Unlearning Zheyuan Liu Guangyao Dou Zhaoxuan Tan Yijun Tian Meng Jiang KELM MU 32 72 0 15 Feb 2024
Large Language Models for the Automated Analysis of Optimization Algorithms Camilo Chacón Sartori Christian Blum Gabriela Ochoa 19 2 0 13 Feb 2024
Are Large Language Models Good Prompt Optimizers? Ruotian Ma Xiaolei Wang Xin Zhou Jian Li Nan Du Tao Gui Qi Zhang Xuanjing Huang LLMAG LRM 28 28 0 03 Feb 2024
Actor Identification in Discourse: A Challenge for LLMs? Ana Barić Sean Papay Sebastian Padó 43 1 0 01 Feb 2024
Transfer Learning for the Prediction of Entity Modifiers in Clinical Text: Application to Opioid Use Disorder Case Detection A. Almudaifer Whitney L. Covington JaMor M. Hairston Zachary Deitch Ankit Anand ... William Bradford Lauren Walter Eaton Ellen Sue S Feldman John D Osborne 26 0 0 26 Jan 2024
ZS4C: Zero-Shot Synthesis of Compilable Code for Incomplete Code Snippets using ChatGPT Azmain Kabir Shaowei Wang Yuan Tian Tse-Hsun Chen Chen Muhammad Asaduzzaman Wenbin Zhang 12 1 0 25 Jan 2024
Evolving Code with A Large Language Model Erik Hemberg Stephen Moskal Una-May O’Reilly 24 26 0 13 Jan 2024
PUB: A Pragmatics Understanding Benchmark for Assessing LLMs' Pragmatics Capabilities S. Sravanthi Meet Doshi Tankala Pavan Kalyan Rudra Murthy Pushpak Bhattacharyya Raj Dabre 24 20 0 13 Jan 2024
Parameter-Efficient Detoxification with Contrastive Decoding Tong Niu Caiming Xiong Semih Yavuz Yingbo Zhou 25 12 0 13 Jan 2024
Mind Your Format: Towards Consistent Evaluation of In-Context Learning Improvements Anton Voronov Lena Wolf Max Ryabinin 24 46 0 12 Jan 2024
A Large Language Model-based Computational Approach to Improve Identity-Related Write-Ups Alex Doboli 29 0 0 27 Dec 2023
Modeling Complex Mathematical Reasoning via Large Language Model based MathAgent Haoran Liao Qinyi Du Shaohua Hu Hao He Yanyan Xu Jidong Tian Yaohui Jin LRM AI4CE 32 1 0 14 Dec 2023
Quantifying Divergence for Human-AI Collaboration and Cognitive Trust Muge Kural Ali Gebesçe T. Chubakov Gözde Gül Sahin FedML 26 0 0 14 Dec 2023
Helping Language Models Learn More: Multi-dimensional Task Prompt for Few-shot Tuning Jinta Weng Jiarui Zhang Yue Hu Daidong Fa Xiaofeng Xu Heyan Huang 16 1 0 13 Dec 2023
Comparable Demonstrations are Important in In-Context Learning: A Novel Perspective on Demonstration Selection Caoyun Fan Jidong Tian Yitian Li Hao He Yaohui Jin 34 4 0 12 Dec 2023
Boosting Prompt-Based Self-Training With Mapping-Free Automatic Verbalizer for Multi-Class Classification Yoo-Seok Kho Jaehee Kim Pilsung Kang VLM 28 0 0 08 Dec 2023
MUFFIN: Curating Multi-Faceted Instructions for Improving Instruction-Following Renze Lou Kai Zhang Jian Xie Yuxuan Sun Janice Ahn Hanzi Xu Yu Su Wenpeng Yin 34 26 0 05 Dec 2023
Zero-shot Conversational Summarization Evaluations with small Large Language Models R. Manuvinakurike Saurav Sahay Sangeeta Manepalli L. Nachman ELM LM&MA 22 0 0 29 Nov 2023
AviationGPT: A Large Language Model for the Aviation Domain Liya Wang Jason Chou Xin Zhou A. Tien Diane M. Baumgartner 21 7 0 29 Nov 2023
Visual cognition in multimodal large language models Luca M. Schulze Buschoff Elif Akata Matthias Bethge Eric Schulz LRM 51 14 0 27 Nov 2023
Prompt Risk Control: A Rigorous Framework for Responsible Deployment of Large Language Models Thomas P. Zollo Todd Morrill Zhun Deng Jake C. Snell T. Pitassi Richard Zemel 43 8 0 22 Nov 2023
To be or not to be? an exploration of continuously controllable prompt engineering Yuhan Sun Mukai Li Yixin Cao Kun Wang Wenxiao Wang Xingyu Zeng Rui Zhao LLMAG 29 2 0 16 Nov 2023
You don't need a personality test to know these models are unreliable: Assessing the Reliability of Large Language Models on Psychometric Instruments Bangzhao Shu Lechen Zhang Minje Choi Lavinia Dunagan Lajanugen Logeswaran Moontae Lee Dallas Card David Jurgens 21 33 0 16 Nov 2023
When does In-context Learning Fall Short and Why? A Study on Specification-Heavy Tasks Hao Peng Xiaozhi Wang Jianhui Chen Weikai Li Y. Qi ... Zhili Wu Kaisheng Zeng Bin Xu Lei Hou Juanzi Li 31 28 0 15 Nov 2023
Auto-ICL: In-Context Learning without Human Supervision Jinghan Yang Shuming Ma Furu Wei 29 9 0 15 Nov 2023
Are Large Language Models Temporally Grounded? Yifu Qiu Zheng Zhao Yftah Ziser Anna Korhonen E. Ponti Shay B. Cohen LRM 6 8 0 14 Nov 2023
Just Ask One More Time! Self-Agreement Improves Reasoning of Language Models in (Almost) All Scenarios Lei Lin Jiayi Fu Pengli Liu Qingyang Li Yan Gong Junchen Wan Fuzheng Zhang Zhongyuan Wang Di Zhang Kun Gai LRM 27 7 0 14 Nov 2023
In-context Learning Generalizes, But Not Always Robustly: The Case of Syntax Aaron Mueller Albert Webson Jackson Petty Tal Linzen ReLM LRM 34 13 0 13 Nov 2023
Generalization Analogies: A Testbed for Generalizing AI Oversight to Hard-To-Measure Domains Joshua Clymer Garrett Baker Rohan Subramani Sam Wang 22 6 0 13 Nov 2023
Language Model-In-The-Loop: Data Optimal Approach to Learn-To-Recommend Actions in Text Games Arjun Vaithilingam Sudhakar Prasanna Parthasarathi Janarthanan Rajendran Sarath Chandar 18 3 0 13 Nov 2023