Title
Evaluation of OpenAI o1: Opportunities and Challenges of AGI Tianyang Zhong Zhengliang Liu Yi Pan Yutong Zhang Yifan Zhou ... Dinggang Shen Andrea Sikora Xiaoming Zhai Dajiang Zhu Tianming Liu ReLM LRM AI4CE ELM VLM 75 99 0 27 Sep 2024
Unexpected Benefits of Self-Modeling in Neural Systems Vickram N. Premakumar Michael Vaiana Florin Pop Judd Rosenblatt Diogo Schwerz de Lucena Kirsten Ziman Michael S A Graziano 25 3 0 14 Jul 2024
Several questions of visual generation in 2024 Shuyang Gu 59 1 0 11 Jul 2024
The Art of Saying No: Contextual Noncompliance in Language Models Faeze Brahman Sachin Kumar Vidhisha Balachandran Pradeep Dasigi Valentina Pyatkin ... Jack Hessel Yulia Tsvetkov Noah A. Smith Yejin Choi Hannaneh Hajishirzi 122 32 0 02 Jul 2024
RouteLLM: Learning to Route LLMs with Preference Data Isaac Ong Amjad Almahairi Vincent Wu Wei-Lin Chiang Tianhao Wu Joseph E. Gonzalez M. W. Kadous Ion Stoica 128 104 0 26 Jun 2024
Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systems David Dalrymple Joar Skalse Yoshua Bengio Stuart J. Russell Max Tegmark ... Clark Barrett Ding Zhao Zhi-Xuan Tan Jeannette Wing Joshua Tenenbaum 96 62 0 10 May 2024
How predictable is language model benchmark performance? David Owen ELM LRM 70 22 0 09 Jan 2024
Inferring Capabilities from Task Performance with Bayesian Triangulation John Burden Konstantinos Voudouris Ryan Burnell Danaja Rutar Lucy G. Cheke José Hernández-Orallo 50 7 0 21 Sep 2023
Large Language Models for Software Engineering: A Systematic Literature Review Xinying Hou Yanjie Zhao Yue Liu Zhou Yang Kailong Wang Li Li Xiapu Luo David Lo John C. Grundy Haoyu Wang 62 415 0 21 Aug 2023
Let's Verify Step by Step Hunter Lightman V. Kosaraju Yura Burda Harrison Edwards Bowen Baker Teddy Lee Jan Leike John Schulman Ilya Sutskever K. Cobbe ALM OffRL LRM 195 1,240 0 31 May 2023
Are Emergent Abilities of Large Language Models a Mirage? Rylan Schaeffer Brando Miranda Oluwasanmi Koyejo LRM 114 436 0 28 Apr 2023
ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks Fabrizio Gilardi Meysam Alizadeh M. Kubli AI4MH 118 926 0 27 Mar 2023
GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models Tyna Eloundou Sam Manning Pamela Mishkin Daniel Rock ELM 66 401 0 17 Mar 2023
GPT-4 Technical Report OpenAI OpenAI OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad ... Shengjia Zhao Tianhao Zheng Juntang Zhuang William Zhuk Barret Zoph LLMAG MLLM 1.5K 14,748 0 15 Mar 2023
Constitutional AI: Harmlessness from AI Feedback Yuntao Bai Saurav Kadavath Sandipan Kundu Amanda Askell John Kernion ... Dario Amodei Nicholas Joseph Sam McCandlish Tom B. Brown Jared Kaplan SyDa MoMe 214 1,646 0 15 Dec 2022
A Rubric for Human-like Agents and NeuroAI Ida Momennejad 107 14 0 08 Dec 2022
Liability regimes in the age of AI: a use-case driven analysis of the burden of proof David Fernández Llorca V. Charisi Ronan Hamon Ignacio E. Sánchez Emilia Gómez 41 7 0 03 Nov 2022
Uncertainty Quantification with Pre-trained Language Models: A Large-Scale Empirical Analysis Yuxin Xiao Paul Pu Liang Umang Bhatt Willie Neiswanger Ruslan Salakhutdinov Louis-Philippe Morency 224 96 0 10 Oct 2022
Improving alignment of dialogue agents via targeted human judgements Amelia Glaese Nat McAleese Maja Trkebacz John Aslanides Vlad Firoiu ... John F. J. Mellor Demis Hassabis Koray Kavukcuoglu Lisa Anne Hendricks G. Irving ALM AAML 308 535 0 28 Sep 2022
Language Models (Mostly) Know What They Know Saurav Kadavath Tom Conerly Amanda Askell T. Henighan Dawn Drain ... Nicholas Joseph Benjamin Mann Sam McCandlish C. Olah Jared Kaplan ELM 124 833 0 11 Jul 2022
Emergent Abilities of Large Language Models Jason W. Wei Yi Tay Rishi Bommasani Colin Raffel Barret Zoph ... Tatsunori Hashimoto Oriol Vinyals Percy Liang J. Dean W. Fedus ELM ReLM LRM 290 2,518 0 15 Jun 2022
The AI Index 2022 Annual Report Daniel T. Zhang Nestor Maslej Erik Brynjolfsson J. Etchemendy Terah Lyons ... Michael Sellitto Ellie Sakhaee Y. Shoham Jack Clark Ray Perrault 42 74 0 02 May 2022
Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback Yuntao Bai Andy Jones Kamal Ndousse Amanda Askell Anna Chen ... Jack Clark Sam McCandlish C. Olah Benjamin Mann Jared Kaplan 256 2,623 0 12 Apr 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 886 13,207 0 04 Mar 2022
Survey of Hallucination in Natural Language Generation Ziwei Ji Nayeon Lee Rita Frieske Tiezheng Yu D. Su ... Delong Chen Wenliang Dai Ho Shu Chan Andrea Madotto Pascale Fung HILM LRM 232 2,435 0 08 Feb 2022
The Turing Trap: The Promise & Peril of Human-Like Artificial Intelligence Erik Brynjolfsson 39 122 0 11 Jan 2022
A General Language Assistant as a Laboratory for Alignment Amanda Askell Yuntao Bai Anna Chen Dawn Drain Deep Ganguli ... Tom B. Brown Jack Clark Sam McCandlish C. Olah Jared Kaplan ALM 120 790 0 01 Dec 2021
Unsolved Problems in ML Safety Dan Hendrycks Nicholas Carlini John Schulman Jacob Steinhardt 260 294 0 28 Sep 2021
The Flaws of Policies Requiring Human Oversight of Government Algorithms Ben Green 55 117 0 10 Sep 2021
The Benchmark Lottery Mostafa Dehghani Yi Tay A. Gritsenko Zhe Zhao N. Houlsby Fernando Diaz Donald Metzler Oriol Vinyals 102 92 0 14 Jul 2021
Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalization John Miller Rohan Taori Aditi Raghunathan Shiori Sagawa Pang Wei Koh Vaishaal Shankar Percy Liang Y. Carmon Ludwig Schmidt OODD OOD 94 278 0 09 Jul 2021
A Survey of Uncertainty in Deep Neural Networks J. Gawlikowski Cedrique Rovile Njieutcheu Tassi Mohsin Ali Jongseo Lee Matthias Humt ... R. Roscher Muhammad Shahzad Wen Yang R. Bamler Xiaoxiang Zhu BDL UQCV OOD 235 1,164 0 07 Jul 2021
Understanding the Capabilities, Limitations, and Societal Impact of Large Language Models Alex Tamkin Miles Brundage Jack Clark Deep Ganguli AILaw ELM 277 267 0 04 Feb 2021
Scaling Laws for Transfer Danny Hernandez Jared Kaplan T. Henighan Sam McCandlish 95 251 0 02 Feb 2021
How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answering Zhengbao Jiang Jun Araki Haibo Ding Graham Neubig UQCV 60 437 0 02 Dec 2020
A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges Moloud Abdar Farhad Pourpanah Sadiq Hussain Dana Rezazadegan Li Liu ... Xiaochun Cao Abbas Khosravi U. Acharya V. Makarenkov S. Nahavandi BDL UQCV 349 1,932 0 12 Nov 2020
Hidden Incentives for Auto-Induced Distributional Shift David M. Krueger Tegan Maharaj Jan Leike 69 52 0 19 Sep 2020
Forecasting AI Progress: A Research Agenda Ross Gruetzemacher Florian E. Dorner Niko Bernaola-Alvarez Charlie Giattino D. Manheim AI4TS 31 31 0 04 Aug 2020
Beyond Accuracy: Behavioral Testing of NLP models with CheckList Marco Tulio Ribeiro Tongshuang Wu Carlos Guestrin Sameer Singh ELM 210 1,110 0 08 May 2020
The Problem with Metrics is a Fundamental Problem for AI Rachel L. Thomas D. Uminsky 116 68 0 20 Feb 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 638 4,921 0 23 Jan 2020
Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methods Eyke Hüllermeier Willem Waegeman PER UD 249 1,427 0 21 Oct 2019
Federated Learning: Challenges, Methods, and Future Directions Tian Li Anit Kumar Sahu Ameet Talwalkar Virginia Smith FedML 132 4,543 0 21 Aug 2019
Machine Learning Testing: Survey, Landscapes and Horizons Jie M. Zhang Mark Harman Lei Ma Yang Liu VLM AILaw 86 752 0 19 Jun 2019
Unpredictability of AI Roman V. Yampolskiy 59 30 0 29 May 2019
Measuring Calibration in Deep Learning Jeremy Nixon Michael W. Dusenberry Ghassen Jerfel Timothy Nguyen Jeremiah Zhe Liu Linchuan Zhang Dustin Tran UQCV 79 492 0 02 Apr 2019
Unmasking Clever Hans Predictors and Assessing What Machines Really Learn Sebastian Lapuschkin S. Wäldchen Alexander Binder G. Montavon Wojciech Samek K. Müller 104 1,021 0 26 Feb 2019
Forecasting Transformative AI: An Expert Survey Ross Gruetzemacher D. Paradice K. Lee AI4TS 21 13 0 24 Jan 2019
Meta-Learning: A Survey Joaquin Vanschoren FedML OOD 76 762 0 08 Oct 2018
Towards Accountable AI: Hybrid Human-Machine Analyses for Characterizing System Failure Besmira Nushi Ece Kamar Eric Horvitz 42 141 0 19 Sep 2018