Pre-training Is (Almost) All You Need: An Application to Commonsense Reasoning

29 April 2020

Papers citing "Pre-training Is (Almost) All You Need: An Application to Commonsense Reasoning"

38 / 38 papers shown

Title
mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humans Yusuke Sakai Hidetaka Kamigaito Taro Watanabe LRM 46 3 0 06 Jun 2024
Automated Program Repair: Emerging trends pose and expose problems for benchmarks J. Renzullo Pemma Reiter Westley Weimer Stephanie Forrest 42 1 0 08 May 2024
Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models Yuqing Wang Yun Zhao VLM ReLM LRM 32 22 0 29 Dec 2023
Filling the Image Information Gap for VQA: Prompting Large Language Models to Proactively Ask Questions Ziyue Wang Chi Chen Peng Li Yang Liu LRM 23 14 0 20 Nov 2023
Event Causality Is Key to Computational Story Understanding Yidan Sun Qin Chao Boyang Albert Li 26 5 0 16 Nov 2023
CASE: Commonsense-Augmented Score with an Expanded Answer Space Wenkai Chen Sahithya Ravi Vered Shwartz 30 0 0 03 Nov 2023
VLIS: Unimodal Language Models Guide Multimodal Language Generation Jiwan Chung Youngjae Yu VLM 30 1 0 15 Oct 2023
Large Language Models and Knowledge Graphs: Opportunities and Challenges Jeff Z. Pan Simon Razniewski Jan-Christoph Kalo Sneha Singhania Jiaoyan Chen ... Gerard de Melo A. Bonifati Edlira Vakaj M. Dragoni D. Graux KELM 30 73 0 11 Aug 2023
Multi-hop Commonsense Knowledge Injection Framework for Zero-Shot Commonsense Question Answering Xin Guan Biwei Cao Qingqing Gao Zheng Yin Bo Liu Jiuxin Cao 26 5 0 10 May 2023
COLA: Contextualized Commonsense Causal Reasoning from the Causal Inference Perspective Zhaowei Wang Quyet V. Do Hongming Zhang Jiayao Zhang Weiqi Wang Tianqing Fang Yangqiu Song Ginny Wong Simon See LRM 36 28 0 09 May 2023
ChatGPT is a Knowledgeable but Inexperienced Solver: An Investigation of Commonsense Problem in Large Language Models Ning Bian Xianpei Han Le Sun Hongyu Lin Yaojie Lu Xianpei Han Shanshan Jiang Bin Dong KELM ELM AI4MH LRM 32 75 0 29 Mar 2023
Natural Language Reasoning, A Survey Fei Yu Hongbo Zhang Prayag Tiwari Benyou Wang ReLM LRM 49 53 0 26 Mar 2023
Language Model Behavior: A Comprehensive Survey Tyler A. Chang Benjamin Bergen VLM LRM LM&MA 27 103 0 20 Mar 2023
The Life Cycle of Knowledge in Big Language Models: A Survey Boxi Cao Hongyu Lin Xianpei Han Le Sun KELM 33 27 0 14 Mar 2023
Event knowledge in large language models: the gap between the impossible and the unlikely Carina Kauf Anna A. Ivanova Giulia Rambelli Emmanuele Chersoni Jingyuan Selena She Zawad Chowdhury Evelina Fedorenko Alessandro Lenci 37 67 0 02 Dec 2022
Evaluate Confidence Instead of Perplexity for Zero-shot Commonsense Reasoning Letian Peng Z. Li Hai Zhao ReLM LRM 18 1 0 23 Aug 2022
Rethinking the Value of Gazetteer in Chinese Named Entity Recognition Qianglong Chen Xiangji Zeng Jiangang Zhu Yin Zhang Bojia Lin Yang Yang Daxin Jiang 30 2 0 06 Jul 2022
Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualization Mutian He Tianqing Fang Weiqi Wang Yangqiu Song 37 29 0 03 Jun 2022
LogiGAN: Learning Logical Reasoning via Adversarial Pre-training Xinyu Pi Wanjun Zhong Yan Gao Nan Duan Jian-Guang Lou NAI GAN LRM AI4CE 41 16 0 18 May 2022
What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization? Thomas Wang Adam Roberts Daniel Hesslow Teven Le Scao Hyung Won Chung Iz Beltagy Julien Launay Colin Raffel 48 167 0 12 Apr 2022
ROCK: Causal Inference Principles for Reasoning about Commonsense Causality Jiayao Zhang Hongming Zhang Weijie J. Su Dan Roth CML LRM 178 24 0 31 Jan 2022
Generalizable Neuro-symbolic Systems for Commonsense Question Answering A. Oltramari Jonathan M Francis Filip Ilievski Kaixin Ma Roshanak Mirzaee NAI 18 8 0 17 Jan 2022
Attention-based Contrastive Learning for Winograd Schemas T. Klein Moin Nabi SSL 34 3 0 10 Sep 2021
Rethinking Why Intermediate-Task Fine-Tuning Works Ting-Yun Chang Chi-Jen Lu LRM 19 29 0 26 Aug 2021
Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases Boxi Cao Hongyu Lin Xianpei Han Le Sun Lingyong Yan M. Liao Tong Xue Jin Xu 21 130 0 17 Jun 2021
A Semantic-based Method for Unsupervised Commonsense Question Answering Yilin Niu Fei Huang Jiaming Liang Wenkai Chen Xiaoyan Zhu Minlie Huang LRM 18 13 0 31 May 2021
Pre-training Universal Language Representation Yian Li Hai Zhao SSL 32 8 0 30 May 2021
Go Beyond Plain Fine-tuning: Improving Pretrained Models for Social Commonsense Ting-Yun Chang Yang Liu Karthik Gopalakrishnan Behnam Hedayatnia Pei Zhou Dilek Z. Hakkani-Tür ReLM VLM AI4MH LRM 11 1 0 12 May 2021
REPT: Bridging Language Models and Machine Reading Comprehension via Retrieval-Based Pre-training Fangkai Jiao Yangyang Guo Yilin Niu Feng Ji Feng-Lin Li Liqiang Nie LRM 34 12 0 10 May 2021
Is Incoherence Surprising? Targeted Evaluation of Coherence Prediction from Language Models Anne Beyer Sharid Loáiciga David Schlangen 27 15 0 07 May 2021
Relational World Knowledge Representation in Contextual Language Models: A Review Tara Safavi Danai Koutra KELM 35 51 0 12 Apr 2021
Improved Customer Transaction Classification using Semi-Supervised Knowledge Distillation Rohan Sukumaran 17 2 0 15 Feb 2021
Improving Commonsense Causal Reasoning by Adversarial Training and Data Augmentation Ieva Staliunaite P. Gorinski Ignacio Iacobacci LRM 162 22 0 13 Jan 2021
Learning to Rationalize for Nonmonotonic Reasoning with Distant Supervision Faeze Brahman Vered Shwartz Rachel Rudinger Yejin Choi LRM 15 42 0 14 Dec 2020
Knowledge-driven Data Construction for Zero-shot Evaluation in Commonsense Question Answering Kaixin Ma Filip Ilievski Jonathan M Francis Yonatan Bisk Eric Nyberg A. Oltramari 19 6 0 07 Nov 2020
Improving Event Duration Prediction via Time-aware Pre-training Zonglin Yang Xinya Du Alexander M. Rush Claire Cardie VLM 16 19 0 05 Nov 2020
COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphs Jena D. Hwang Chandra Bhagavatula Ronan Le Bras Jeff Da Keisuke Sakaguchi Antoine Bosselut Yejin Choi 11 401 0 12 Oct 2020
ProtoQA: A Question Answering Dataset for Prototypical Common-Sense Reasoning Michael Boratko Xiang Lorraine Li Rajarshi Das Timothy J. O'Gorman Daniel Le Andrew McCallum 22 56 0 02 May 2020