Do Prompt-Based Models Really Understand the Meaning of their Prompts?

2 September 2021

Papers citing "Do Prompt-Based Models Really Understand the Meaning of their Prompts?"

50 / 254 papers shown

Title
On Measuring Faithfulness or Self-consistency of Natural Language Explanations Letitia Parcalabescu Anette Frank LRM 69 20 0 13 Nov 2023
How are Prompts Different in Terms of Sensitivity? Sheng Lu Hendrik Schuff Iryna Gurevych 37 18 0 13 Nov 2023
Developing a Named Entity Recognition Dataset for Tagalog Lester James Validad Miranda 25 5 0 13 Nov 2023
Prompt have evil twins Rimon Melamed Lucas H. McCabe T. Wakhare Yejin Kim H. H. Huang Enric Boix-Adsera 36 3 0 13 Nov 2023
Making LLMs Worth Every Penny: Resource-Limited Text Classification in Banking Lefteris Loukas Ilias Stogiannidis Odysseas Diamantopoulos Prodromos Malakasiotis Stavros Vassos 10 43 0 10 Nov 2023
Do LLMs exhibit human-like response biases? A case study in survey design Lindia Tjuatja Valerie Chen Sherry Tongshuang Wu Ameet Talwalkar Graham Neubig 29 80 0 07 Nov 2023
Extraction of Atypical Aspects from Customer Reviews: Datasets and Experiments with Language Models Smita Nannaware Erfan Al-Hossami Razvan Bunescu 19 0 0 05 Nov 2023
Automating Governing Knowledge Commons and Contextual Integrity (GKC-CI) Privacy Policy Annotations with Large Language Models Jake Chanenson Madison Pickering Noah J. Apthorpe 22 0 0 03 Nov 2023
The language of prompting: What linguistic properties make a prompt successful? Alina Leidinger R. Rooij Ekaterina Shutova 38 43 0 03 Nov 2023
Unlearn What You Want to Forget: Efficient Unlearning for LLMs Jiaao Chen Diyi Yang MU 30 136 0 31 Oct 2023
Constituency Parsing using LLMs Xuefeng Bai Jialong Wu Yulong Chen Zhongqing Wang Yue Zhang 38 1 0 30 Oct 2023
R $^3$ Prompting: Review, Rephrase and Resolve for Chain-of-Thought Reasoning in Large Language Models under Noisy Context Qingyuan Tian Hanlun Zhu Lei Wang Yang Li Yunshi Lan LRM ReLM 16 7 0 25 Oct 2023
Ignore This Title and HackAPrompt: Exposing Systemic Vulnerabilities of LLMs through a Global Scale Prompt Hacking Competition Sander Schulhoff Jeremy Pinto Anaum Khan Louis-Franccois Bouchard Chenglei Si Svetlina Anati Valen Tagliabue Anson Liu Kost Christopher Carnahan Jordan L. Boyd-Graber SILM 37 41 0 24 Oct 2023
Unnatural language processing: How do language models handle machine-generated prompts? Corentin Kervadec Francesca Franzon Marco Baroni 23 5 0 24 Oct 2023
Interpreting Answers to Yes-No Questions in User-Generated Content Shivam Mathur Keun Hee Park Dhivya Chinnappa Saketh Kotamraju Eduardo Blanco 18 0 0 24 Oct 2023
FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions Hyunwoo J. Kim Melanie Sclar Xuhui Zhou Ronan Le Bras Gunhee Kim Yejin Choi Maarten Sap LLMAG 18 79 0 24 Oct 2023
Unleashing the potential of prompt engineering in Large Language Models: a comprehensive review Banghao Chen Zhaofeng Zhang Nicolas Langrené Shengxin Zhu LLMAG 28 89 0 23 Oct 2023
Interpreting Indirect Answers to Yes-No Questions in Multiple Languages Zijie Wang Md Mosharaf Hossain Shivam Mathur Terry Cruz Melo Kadir Bulut Ozler ... Jacob Quintero MohammadHossein Rezaei Shreya Nupur Shakya Md Nayem Uddin Eduardo Blanco 35 1 0 20 Oct 2023
Revealing the Unwritten: Visual Investigation of Beam Search Trees to Address Language Model Prompting Challenges Thilo Spinner Rebecca Kehlbeck Rita Sevastjanova Tobias Stähle Daniel A. Keim Oliver Deussen Andreas Spitz Mennatallah El-Assady 32 2 0 17 Oct 2023
Assessing the Reliability of Large Language Model Knowledge Weixuan Wang Barry Haddow Alexandra Birch Wei Peng KELM HILM 77 15 0 15 Oct 2023
Topic-DPR: Topic-based Prompts for Dense Passage Retrieval Q. Xiao Shuangyin Li Lei Chen 31 2 0 10 Oct 2023
Rephrase, Augment, Reason: Visual Grounding of Questions for Vision-Language Models Archiki Prasad Elias Stengel-Eskin Mohit Bansal ReLM LRM 28 8 0 09 Oct 2023
"I'd Like to Have an Argument, Please": Argumentative Reasoning in Large Language Models Sizhe Wei Yifan Lu LRM 48 4 0 29 Sep 2023
Stress Testing Chain-of-Thought Prompting for Large Language Models Aayush Mishra Jitin Singla LRM 6 2 0 28 Sep 2023
HANS, are you clever? Clever Hans Effect Analysis of Neural Systems Leonardo Ranaldi Fabio Massimo Zanzotto 34 2 0 21 Sep 2023
Large Language Models on the Chessboard: A Study on ChatGPT's Formal Language Comprehension and Complex Reasoning Skills Mu-Tien Kuo Chih-Chung Hsueh Richard Tzong-Han Tsai ELM ReLM LRM 16 6 0 29 Aug 2023
Breaking the Bank with ChatGPT: Few-Shot Text Classification for Finance Lefteris Loukas Ilias Stogiannidis Prodromos Malakasiotis Stavros Vassos 24 19 0 28 Aug 2023
Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Models Martin Weyssow Xin Zhou Kisub Kim David Lo H. Sahraoui 35 27 0 21 Aug 2023
Discrete Prompt Compression with Reinforcement Learning Hoyoun Jung Kyung-Joong Kim 29 24 0 17 Aug 2023
Semantic Consistency for Assuring Reliability of Large Language Models Harsh Raj Vipul Gupta Domenic Rosati S. Majumdar HILM 110 14 0 17 Aug 2023
From Fake to Hyperpartisan News Detection Using Domain Adaptation Razvan-Alexandru Smadu Sebastian-Vasile Echim Dumitru-Clementin Cercel Iuliana Marin Florin-Catalin Pop 27 3 0 04 Aug 2023
Evaluating the Moral Beliefs Encoded in LLMs Nino Scherrer Claudia Shi Amir Feder David M. Blei 33 117 0 26 Jul 2023
Instruction-following Evaluation through Verbalizer Manipulation Shiyang Li Jun Yan Hai Wang Zheng Tang Xiang Ren Vijay Srinivasan Hongxia Jin 36 25 0 20 Jul 2023
A Comprehensive Overview of Large Language Models Humza Naveed Asad Ullah Khan Shi Qiu Muhammad Saqib Saeed Anwar Muhammad Usman Naveed Akhtar Nick Barnes Ajmal Saeed Mian OffRL 70 525 0 12 Jul 2023
ODD: A Benchmark Dataset for the Natural Language Processing based Opioid Related Aberrant Behavior Detection Sunjae Kwon Xun Wang Weisong Liu Emily Druhl Minhee L. Sung J. Reisman Wenjun Li R. Kerns William Becker Hongfeng Yu 28 2 0 05 Jul 2023
InstructEval: Systematic Evaluation of Instruction Selection Methods Anirudh Ajith Chris Pan Mengzhou Xia A. Deshpande Karthik Narasimhan ELM 25 16 0 01 Jul 2023
Developing Effective Educational Chatbots with ChatGPT prompts: Insights from Preliminary Tests in a Case Study on Social Media Literacy (with appendix) Cansu Koyuturk Mona Yavari Emily Theophilou Sathya Bursic Gregor Donabauer ... Raffaele Boiano A. Gabbiadini Davinia Hernández Leo Martin Ruskov D. Ognibene 30 18 0 18 Jun 2023
In-Context Learning through the Bayesian Prism Madhuri Panwar Kabir Ahuja Navin Goyal BDL 34 38 0 08 Jun 2023
Did You Read the Instructions? Rethinking the Effectiveness of Task Definitions in Instruction Learning Fan Yin Jesse Vig Philippe Laban Shafiq R. Joty Caiming Xiong Chien-Sheng Wu ALM 21 39 0 01 Jun 2023
Column Type Annotation using ChatGPT Keti Korini Christian Bizer LMTD 9 26 0 01 Jun 2023
What does the Failure to Reason with "Respectively" in Zero/Few-Shot Settings Tell Us about Language Models? Ruixiang Cui Seolhwa Lee Daniel Hershcovich Anders Søgaard 30 2 0 31 May 2023
Exploring Effectiveness of GPT-3 in Grammatical Error Correction: A Study on Performance and Controllability in Prompt-Based Methods Mengsay Loem Masahiro Kaneko Sho Takase Naoaki Okazaki 46 37 0 29 May 2023
ChatGPT-powered Conversational Drug Editing Using Retrieval and Domain Feedback Shengchao Liu Jiong Wang Yijin Yang Chengpeng Wang Ling Liu Hongyu Guo Chaowei Xiao LM&MA KELM AI4MH 36 39 0 29 May 2023
Zero-shot Visual Question Answering with Language Model Feedback Yifan Du Junyi Li Tianyi Tang Wayne Xin Zhao Ji-Rong Wen 16 13 0 26 May 2023
Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and Evaluation Marius Mosbach Tiago Pimentel Shauli Ravfogel Dietrich Klakow Yanai Elazar 45 122 0 26 May 2023
EDM3: Event Detection as Multi-task Text Generation Ujjwala Anantheswaran Himanshu Gupta Mihir Parmar Kuntal Kumar Pal Chitta Baral 29 5 0 25 May 2023
Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuning Ximing Lu Faeze Brahman Peter West Jaehun Jang Khyathi Raghavi Chandu ... Bill Yuchen Lin Skyler Hallinan Xiang Ren Sean Welleck Yejin Choi 22 26 0 24 May 2023
Self-ICL: Zero-Shot In-Context Learning with Self-Generated Demonstrations Wei-Lin Chen Cheng-Kuang Wu Yun-Nung Chen Hsin-Hsi Chen 21 27 0 24 May 2023
Large Language Models are In-Context Semantic Reasoners rather than Symbolic Reasoners Xiaojuan Tang Zilong Zheng Jiaqi Li Fanxu Meng Song-Chun Zhu Yitao Liang Muhan Zhang ReLM LRM 31 53 0 24 May 2023
Sources of Hallucination by Large Language Models on Inference Tasks Nick McKenna Tianyi Li Liang Cheng Mohammad Javad Hosseini Mark Johnson Mark Steedman LRM HILM 16 188 0 23 May 2023