Large Language Models as General Pattern Machines

10 July 2023

Montse Gonzalez Arenas

Dorsa Sadigh

Papers citing "Large Language Models as General Pattern Machines"

50 / 155 papers shown

Title
By My Eyes: Grounding Multimodal Large Language Models with Sensor Data via Visual Prompting Hyungjun Yoon Biniyam Aschalew Tolera Taesik Gong Kimin Lee Sung-Ju Lee 37 7 0 15 Jul 2024
Affordance-Guided Reinforcement Learning via Visual Prompting Olivia Y. Lee Annie Xie Kuan Fang Karl Pertsch Chelsea Finn OffRL LM&Ro 74 7 0 14 Jul 2024
Commonsense Reasoning for Legged Robot Adaptation with Vision-Language Models Annie S. Chen Alec M. Lessing Andy Tang Govind Chada Laura Smith Sergey Levine Chelsea Finn LM&Ro LRM 33 9 0 02 Jul 2024
SADL: An Effective In-Context Learning Method for Compositional Visual QA Long Hoang Dang T. Le Vuong Le Tu Minh Phuong Truyen Tran ReLM CoGe 48 2 0 02 Jul 2024
Learning Modality Knowledge Alignment for Cross-Modality Transfer Wenxuan Ma Shuang Li Lincan Cai Jingxuan Kang 39 1 0 27 Jun 2024
LICO: Large Language Models for In-Context Molecular Optimization Tung Nguyen Aditya Grover 33 6 0 27 Jun 2024
Open-vocabulary Pick and Place via Patch-level Semantic Maps Mingxi Jia Haojie Huang Zhewen Zhang Chenghao Wang Linfeng Zhao Dian Wang J. Liu Robin Walters Robert Platt Stefanie Tellex LM&Ro 44 5 0 21 Jun 2024
Effective Generative AI: The Human-Algorithm Centaur S. Saghafian Lihi Idan 40 7 0 16 Jun 2024
Off-Policy Evaluation from Logged Human Feedback Aniruddha Bhargava Lalit P. Jain B. Kveton Ge Liu Subhojyoti Mukherjee OffRL 26 2 0 14 Jun 2024
XLand-100B: A Large-Scale Multi-Task Dataset for In-Context Reinforcement Learning Alexander Nikulin Ilya Zisman Alexey Zemtsov Viacheslav Sinii 110 4 0 13 Jun 2024
LLM-Craft: Robotic Crafting of Elasto-Plastic Objects with Large Language Models Alison Bartsch A. Farimani 81 6 0 12 Jun 2024
LLM-Enhanced Bayesian Optimization for Efficient Analog Layout Constraint Generation Guojin Chen Keren Zhu Seunggeun Kim Hanqing Zhu Yao Lai Bei Yu David Z. Pan 28 7 0 07 Jun 2024
Pretraining Decision Transformers with Reward Prediction for In-Context Multi-task Structured Bandit Learning Subhojyoti Mukherjee Josiah P. Hanna Qiaomin Xie Robert Nowak 72 2 0 07 Jun 2024
Open-Endedness is Essential for Artificial Superhuman Intelligence Edward Hughes Michael Dennis Jack Parker-Holder Feryal M. P. Behbahani Aditi Mavalankar Yuge Shi Tom Schaul Tim Rocktaschel LRM 34 21 0 06 Jun 2024
Controlling Large Language Model Agents with Entropic Activation Steering Nate Rahn P. DÓro Marc G. Bellemare LLMSV 30 6 0 01 Jun 2024
Metaheuristics and Large Language Models Join Forces: Toward an Integrated Optimization Approach Camilo Chacón Sartori Christian Blum Filippo Bistaffa Guillem Rodríguez Corominas AIFin 61 3 0 28 May 2024
What is it for a Machine Learning Model to Have a Capability? Jacqueline Harding Nathaniel Sharadin ELM 38 3 0 14 May 2024
Toward Automated Programming for Robotic Assembly Using ChatGPT Annabella Macaluso Nicholas Cote Sachin Chitta 22 3 0 13 May 2024
The Platonic Representation Hypothesis Minyoung Huh Brian Cheung Tongzhou Wang Phillip Isola 80 111 0 13 May 2024
Philosophy of Cognitive Science in the Age of Deep Learning Raphaël Millière AI4CE NAI 40 3 0 07 May 2024
A Philosophical Introduction to Language Models - Part II: The Way Forward Raphael Milliere Cameron Buckner LRM 66 13 0 06 May 2024
Large Language Models estimate fine-grained human color-concept associations Kushin Mukherjee Timothy T. Rogers Karen B. Schloss VLM 40 3 0 04 May 2024
In-Context Symbolic Regression: Leveraging Large Language Models for Function Discovery Matteo Merler Katsiaryna Haitsiukevich Nicola Dainese Pekka Marttinen 40 7 0 29 Apr 2024
Large Language Models as In-context AI Generators for Quality-Diversity Bryan Lim Manon Flageat Antoine Cully 32 4 0 24 Apr 2024
SemEval-2024 Task 9: BRAINTEASER: A Novel Task Defying Common Sense Yifan Jiang Filip Ilievski Kaixin Ma LRM 35 30 0 22 Apr 2024
Experimental Design for Active Transductive Inference in Large Language Models Subhojyoti Mukherjee Anusha Lalitha Aniket Deshmukh Ge Liu Yifei Ma B. Kveton LRM 40 1 0 12 Apr 2024
From Words to Numbers: Your Large Language Model Is Secretly A Capable Regressor When Given In-Context Examples Robert Vacareanu Vlad-Andrei Negru Vasile Suciu Mihai Surdeanu 31 28 0 11 Apr 2024
GenCHiP: Generating Robot Policy Code for High-Precision and Contact-Rich Manipulation Tasks Kaylee Burns Ajinkya Jain Keegan Go Fei Xia Michael Stark S. Schaal Karol Hausman 29 4 0 09 Apr 2024
PREGO: online mistake detection in PRocedural EGOcentric videos Alessandro Flaborea Guido Maria DÁmely di Melendugno Leonardo Plini Luca Scofano Edoardo De Matteis Antonino Furnari G. Farinella Fabio Galasso EgoV 53 11 0 02 Apr 2024
ZeroCAP: Zero-Shot Multi-Robot Context Aware Pattern Formation via Large Language Models Vishnunandan L. N. Venkatesh Byung-Cheol Min LM&Ro 71 2 0 02 Apr 2024
Zero-shot Safety Prediction for Autonomous Robots with Foundation World Models Zhenjiang Mao Siqi Dai Yuang Geng Ivan Ruchkin 35 3 0 30 Mar 2024
LLMSense: Harnessing LLMs for High-level Reasoning Over Spatiotemporal Sensor Traces Xiaomin Ouyang Mani B. Srivastava LRM 32 18 0 28 Mar 2024
Improving Text-to-Image Consistency via Automatic Prompt Optimization Oscar Manas Pietro Astolfi Melissa Hall Candace Ross Jack Urbanek Adina Williams Aishwarya Agrawal Adriana Romero Soriano M. Drozdzal 36 27 0 26 Mar 2024
ReAct Meets ActRe: When Language Agents Enjoy Training Data Autonomy Zonghan Yang Peng Li Ming Yan Ji Zhang Fei Huang Yang Liu LLMAG LRM 49 8 0 21 Mar 2024
Reasoning Abilities of Large Language Models: In-Depth Analysis on the Abstraction and Reasoning Corpus Seungpil Lee Woochang Sim Donghyeon Shin Sanha Hwang Wongyu Seo Jiwon Park Seokki Lee Sejin Kim Sundong Kim LRM 42 19 0 18 Mar 2024
LLM3:Large Language Model-based Task and Motion Planning with Motion Failure Reasoning Shu Wang Muzhi Han Ziyuan Jiao Zeyu Zhang Yingnian Wu Song-Chun Zhu Hangxin Liu LRM 31 32 0 18 Mar 2024
RLingua: Improving Reinforcement Learning Sample Efficiency in Robotic Manipulations With Large Language Models Liangliang Chen Yutian Lei Shiyu Jin Ying Zhang Liangjun Zhang LM&Ro 45 8 0 11 Mar 2024
ItD: Large Language Models Can Teach Themselves Induction through Deduction Wangtao Sun Haotian Xu Xuanqing Yu Pei Chen Shizhu He Jun Zhao Kang Liu LRM 35 10 0 09 Mar 2024
A Survey on Human-AI Teaming with Large Pre-Trained Models Vanshika Vats Marzia Binta Nizam Minghao Liu Ziyuan Wang Richard Ho ... Celeste Shen Rachel Shen Nafisa Hussain Kesav Ravichandran James Davis LM&MA 42 8 0 07 Mar 2024
ReMatch: Retrieval Enhanced Schema Matching with LLMs Eitam Sheetrit Menachem Brief Moshik Mishaeli Oren Elisha 24 11 0 03 Mar 2024
Towards Modeling Learner Performance with Large Language Models Seyed Parsa Neshaei Richard Lee Davis Adam Hazimeh Bojan Lazarevski Pierre Dillenbourg Tanja Kaser AI4Ed 38 5 0 29 Feb 2024
Linear Transformers are Versatile In-Context Learners Max Vladymyrov J. Oswald Mark Sandler Rong Ge 31 13 0 21 Feb 2024
Learning to Learn Faster from Human Feedback with Language Model Predictive Control Jacky Liang Fei Xia Wenhao Yu Andy Zeng Montse Gonzalez Arenas ... N. Heess Kanishka Rao Nik Stewart Jie Tan Carolina Parada LM&Ro 61 34 0 18 Feb 2024
PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMs Soroush Nasiriany Fei Xia Wenhao Yu Ted Xiao Jacky Liang ... Karol Hausman N. Heess Chelsea Finn Sergey Levine Brian Ichter LM&Ro LRM 25 92 0 12 Feb 2024
Towards Unified Alignment Between Agents, Humans, and Environment Zonghan Yang An Liu Zijun Liu Kai Liu Fangzhou Xiong ... Zhenhe Zhang Fuwen Luo Zhicheng Guo Peng Li Yang Liu 32 4 0 12 Feb 2024
Real-World Robot Applications of Foundation Models: A Review Kento Kawaharazuka T. Matsushima Andrew Gambardella Jiaxian Guo Chris Paxton Andy Zeng OffRL VLM LM&Ro 48 45 0 08 Feb 2024
CodeIt: Self-Improving Language Models with Prioritized Hindsight Replay Natasha Butt Blazej Manczak Auke Wiggers Corrado Rainone David W. Zhang Michaël Defferrard Taco S. Cohen ReLM LRM 46 17 0 07 Feb 2024
Fine-Tuned Language Models Generate Stable Inorganic Materials as Text Nate Gruver Anuroop Sriram Andrea Madotto A. Wilson C. L. Zitnick Zachary W. Ulissi 27 56 0 06 Feb 2024
Large Language Models to Enhance Bayesian Optimization Tennison Liu Nicolás Astorga Nabeel Seedat M. Schaar 66 46 0 06 Feb 2024
RAP: Retrieval-Augmented Planning with Contextual Memory for Multimodal LLM Agents Tomoyuki Kagaya Thong Jing Yuan Yuxuan Lou J. Karlekar Sugiri Pranata Akira Kinose Koki Oguri Felix Wick Yang You LLMAG 49 32 0 06 Feb 2024