Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks

19 February 2015

Jason Weston

Papers citing "Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks"

50 / 600 papers shown

Title
SpaceNLI: Evaluating the Consistency of Predicting Inferences in Space Lasha Abzianidze J. Zwarts Yoad Winter 27 2 0 05 Jul 2023
Are Large Language Models Really Good Logical Reasoners? A Comprehensive Evaluation and Beyond Fangzhi Xu Qika Lin Jiawei Han Tianzhe Zhao Jun Liu Min Zhang ELM LRM 44 32 0 16 Jun 2023
BoardgameQA: A Dataset for Natural Language Reasoning with Contradictory Information Mehran Kazemi Quan Yuan Deepti Bhatia Najoung Kim Xin Xu Vaiva Imbrasaite Deepak Ramachandran LRM 32 41 0 13 Jun 2023
Certified Deductive Reasoning with Language Models Gabriel Poesia Kanishk Gandhi E. Zelikman Noah D. Goodman ELM ReLM LRM 40 0 0 06 Jun 2023
OpenPI-C: A Better Benchmark and Stronger Baseline for Open-Vocabulary State Tracking Xueqing Wu Sha Li Heng Ji 9 3 0 01 Jun 2023
Scaling Data-Constrained Language Models Niklas Muennighoff Alexander M. Rush Boaz Barak Teven Le Scao Aleksandra Piktus Nouamane Tazi S. Pyysalo Thomas Wolf Colin Raffel ALM 38 200 0 25 May 2023
ToMChallenges: A Principle-Guided Dataset and Diverse Evaluation Tasks for Exploring Theory of Mind Xiaomeng Ma Lingyu Gao Qihui Xu 36 23 0 24 May 2023
Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Models Natalie Shapira Mosh Levy S. Alavi Xuhui Zhou Yejin Choi Yoav Goldberg Maarten Sap Vered Shwartz LLMAG ELM 31 117 0 24 May 2023
OpenPI2.0: An Improved Dataset for Entity Tracking in Texts Li Zhang Hainiu Xu Abhinav Kommula Chris Callison-Burch Niket Tandon 38 6 0 24 May 2023
NarrativeXL: A Large-scale Dataset For Long-Term Memory Models A. Moskvichev Ky-Vinh Mai RALM 18 1 0 23 May 2023
Teaching Probabilistic Logical Reasoning to Transformers Aliakbar Nafar K. Venable Parisa Kordjamshidi ReLM LRM 24 3 0 22 May 2023
GEST: the Graph of Events in Space and Time as a Common Representation between Vision and Language Mihai Masala Nicolae Cudlenco Traian Rebedea Marius Leordeanu 14 0 0 22 May 2023
GPT-3.5, GPT-4, or BARD? Evaluating LLMs Reasoning Ability in Zero-Shot Setting and Performance Boosting Through Prompts Jessica Nayeli López Espejel E. Ettifouri Mahaman Sanoussi Yahaya Alassan El Mehdi Chouham Walid Dahhane ELM LRM 34 85 0 21 May 2023
Language Models Meet World Models: Embodied Experiences Enhance Language Models Jiannan Xiang Tianhua Tao Yi Gu Tianmin Shu Zirui Wang Zichao Yang Zhiting Hu ALM LLMAG LM&Ro CLL 36 94 0 18 May 2023
Knowledge Authoring for Rules and Actions Yuheng Wang Paul Fodor M. Kifer LRM 30 2 0 12 May 2023
A Memory Model for Question Answering from Streaming Data Supported by Rehearsal and Anticipation of Coreference Information Vladimir Araujo Alvaro Soto Marie-Francine Moens KELM 22 2 0 12 May 2023
MindGames: Targeting Theory of Mind in Large Language Models with Dynamic Epistemic Modal Logic Damien Sileo Antoine Lernould LRM 16 25 0 05 May 2023
Entity Tracking in Language Models Najoung Kim Sebastian Schuster 55 16 0 03 May 2023
Continual Reasoning: Non-Monotonic Reasoning in Neurosymbolic AI using Continual Learning Sofoklis Kyriakopoulos Artur Garcez NAI LRM 21 0 0 03 May 2023
Learning to Reason and Memorize with Self-Notes Jack Lanchantin Shubham Toshniwal Jason Weston Arthur Szlam Sainbayar Sukhbaatar ReLM LRM LLMAG 98 29 0 01 May 2023
Explainable Verbal Reasoner Plus (EVR+): A Natural Language Reasoning Framework that Supports Diverse Compositional Reasoning Zhengzhong Liang Zeyu Zhang Steven Bethard Mihai Surdeanu ReLM LRM 31 1 0 28 Apr 2023
Scaling Transformer to 1M tokens and beyond with RMT Aydar Bulatov Yuri Kuratov Yermek Kapushev Andrey Kravchenko LRM 25 87 0 19 Apr 2023
Natural Language Reasoning, A Survey Fei Yu Hongbo Zhang Prayag Tiwari Benyou Wang ReLM LRM 49 53 0 26 Mar 2023
A Review on Machine Theory of Mind Yuanyuan Mao Shuang Liu Pengshuai Zhao Qin Ni Xin Lin Liang He 36 2 0 21 Mar 2023
Complex QA and language models hybrid architectures, Survey Xavier Daull P. Bellot Emmanuel Bruno Vincent Martin Elisabeth Murisasco ELM 31 15 0 17 Feb 2023
The Role of Semantic Parsing in Understanding Procedural Text Hossein Rajaby Faghihi Parisa Kordjamshidi C. Teng J. Allen 22 5 0 14 Feb 2023
A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity Yejin Bang Samuel Cahyawijaya Nayeon Lee Wenliang Dai Dan Su ... Tiezheng Yu Willy Chung Quyet V. Do Yan Xu Pascale Fung ReLM LRM 27 1,338 0 08 Feb 2023
Large Language Models Can Be Easily Distracted by Irrelevant Context Freda Shi Xinyun Chen Kanishka Misra Nathan Scales David Dohan Ed H. Chi Nathanael Scharli Denny Zhou ReLM RALM LRM 33 537 0 31 Jan 2023
Causal Reasoning of Entities and Events in Procedural Texts Li Zhang Hainiu Xu Yue Yang Shuyan Zhou Weiqiu You Manni Arora Chris Callison-Burch ReLM LRM 36 35 0 26 Jan 2023
Mind Reasoning Manners: Enhancing Type Perception for Generalized Zero-shot Logical Reasoning over Text Fangzhi Xu Jun Liu Qika Lin Tianzhe Zhao Jian Zhang Lingling Zhang ReLM LRM 20 3 0 08 Jan 2023
A Brain-inspired Memory Transformation based Differentiable Neural Computer for Reasoning-based Question Answering Yao Liang H. Fang Yi Zeng Feifei Zhao OOD 36 2 0 07 Jan 2023
ORCA: A Challenging Benchmark for Arabic Language Understanding AbdelRahim Elmadany El Moatez Billah Nagoudi Muhammad Abdul-Mageed ELM 17 40 0 21 Dec 2022
CoRRPUS: Code-based Structured Prompting for Neurosymbolic Story Understanding Yi Dong Lara J. Martin Chris Callison-Burch 48 7 0 21 Dec 2022
Discovering Language Model Behaviors with Model-Written Evaluations Ethan Perez Sam Ringer Kamilė Lukošiūtė Karina Nguyen Edwin Chen ... Danny Hernandez Deep Ganguli Evan Hubinger Nicholas Schiefer Jared Kaplan ALM 22 367 0 19 Dec 2022
ALERT: Adapting Language Models to Reasoning Tasks Ping Yu Tianlu Wang O. Yu. Golovneva Badr AlKhamissi Siddharth Verma Zhijing Jin Gargi Ghosh Mona T. Diab Asli Celikyilmaz ReLM LRM 34 20 0 16 Dec 2022
The KITMUS Test: Evaluating Knowledge Integration from Multiple Sources in Natural Language Understanding Systems Akshatha Arodi Martin Pömsl Kaheer Suleman Adam Trischler Alexandra Olteanu Jackie C.K. Cheung ELM 33 5 0 15 Dec 2022
TRAC: A Textual Benchmark for Reasoning about Actions and Change Weinan He Canming Huang Zhanhao Xiao Yongmei Liu LLMAG ReLM LRM 20 0 0 25 Nov 2022
Breakpoint Transformers for Modeling and Tracking Intermediate Beliefs Kyle Richardson Ronen Tamari Oren Sultan Reut Tsarfaty Dafna Shahaf Ashish Sabharwal KELM 21 8 0 15 Nov 2022
Towards Human-Centred Explainability Benchmarks For Text Classification Viktor Schlegel Erick Mendez Guzman R. Batista-Navarro 28 5 0 10 Nov 2022
EvEntS ReaLM: Event Reasoning of Entity States via Language Models Evangelia Spiliopoulou Artidoro Pagnoni Yonatan Bisk Eduard H. Hovy LRM ReLM 35 10 0 10 Nov 2022
NAPG: Non-Autoregressive Program Generation for Hybrid Tabular-Textual Question Answering Tengxun Zhang Hongfei Xu Josef van Genabith Deyi Xiong Hongying Zan AIMat LRM 24 5 0 07 Nov 2022
Probing neural language models for understanding of words of estimative probability Damien Sileo Marie-Francine Moens 19 10 0 07 Nov 2022
LMentry: A Language Model Benchmark of Elementary Language Tasks Avia Efrat Or Honovich Omer Levy 29 20 0 03 Nov 2022
An Improved Time Feedforward Connections Recurrent Neural Networks Jin Wang Yongsong Zou Se-Jung Lim AI4TS 27 3 0 03 Nov 2022
Lila: A Unified Benchmark for Mathematical Reasoning Swaroop Mishra Matthew Finlayson Pan Lu Leonard Tang Sean Welleck ... Tanmay Rajpurohit Oyvind Tafjord Ashish Sabharwal Peter Clark Ashwin Kalyan ELM AIMat ReLM LRM 33 0 0 31 Oct 2022
Revisiting Attention Weights as Explanations from an Information Theoretic Perspective Bingyang Wen K. P. Subbalakshmi Fan Yang FAtt 27 6 0 31 Oct 2022
Transfer Learning with Synthetic Corpora for Spatial Role Labeling and Reasoning Roshanak Mirzaee Parisa Kordjamshidi SyDa LRM 27 33 0 30 Oct 2022
Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task Kenneth Li Aspen K. Hopkins David Bau Fernanda Viégas Hanspeter Pfister Martin Wattenberg MILM 22 265 0 24 Oct 2022
ReasonChainQA: Text-based Complex Question Answering with Explainable Evidence Chains Minjun Zhu Yixuan Weng Shizhu He Kang Liu Jun Zhao LRM 25 6 0 17 Oct 2022
Non-Axiomatic Term Logic: A Computational Theory of Cognitive Symbolic Reasoning Kotaro Funakoshi NAI 21 1 0 12 Oct 2022